Posted:-1 days ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

 Design, develop, and maintain robust data pipelinesusing Azure Data Factory (ADF) .- Build ETL/ELT processes that ingest,transform, and load data from various sources into data lakes, warehouses, or databases.- Implement both batch and near real-time data flows.
- Create, schedule, and monitor ADF pipelines. -Implement complex data workflows, including dependency management,parameterization, and dynamic pipeline design . - Integrate ADF with otherAzure services (Blob Storage, Synapse, Databricks, Key Vault, etc.). -Implement logging, alerting, and retry logic for production stability.
- Analyze large datasets to identify trends, issues, andtransformation needs. - Write performant SQL queries and transformations. -Collaborate with data analysts to understand data requirements and structuretransformations accordingly. - Ensure data is accurate, consistent, and alignedwith business logic.
- Quickly diagnose and resolve data quality issues,pipeline failures, or performance bottlenecks. - Perform root cause analysisfor pipeline errors and implement long-term fixes. - Debug and optimize Sparkor SQL transformations in environments like Databricks.
- Implement data validation and quality checks within pipelines.- Perform reconciliation and sanity checks across data sources. - Maintain datadictionaries and metadata repositories.
- Work closely with data architects, analysts, BIdevelopers, and business users. - Translate business data needs into technical implementations.- Document pipeline logic, data flows, and troubleshooting procedures.
- Work closely with data architects, analysts, BIdevelopers, and business users. - Translate business data needs into technical implementations.- Document pipeline logic, data flows, and troubleshooting procedures.
- Optimize ADF pipeline execution time and cost. -Improve query performance using indexing, partitioning, and efficienttransformation logic. - Recommend improvements in data infrastructure andtooling.
 

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Thoucentric logo
Thoucentric

Business Consulting and Services

Bangalore Heads South

RecommendedJobs for You

hubli, mangaluru, mysuru, bengaluru, belgaum