Azure Data Engineer

Prodapt Solutions

5 - 8 years

11 - 19 Lacs

pune chennai bengaluru

Posted:9 hours ago| Platform:

Apply

Skills Required

azure databricks data bricks azure data factory azure data lake python pyspark hadoop big data sql datafactory data lake spark etl

Work Mode

Work from Office

Job Type

Full Time

Job Description

Overview:

Core Responsibilities:

Architect and implement data integration solutions to support business needs.
Develop and manage ETL processes for data ingestion, transformation, and loading.
Collaborate within cross-functional teams (data scientists, analysts, business stakeholders) in an Agile/Scrum setup.
Actively participate in sprint planning, daily stand-ups, retrospectives, and other Agile ceremonies.
Optimize pipelines for performance, reliability, and cost-efficiency.
Ensure data governance, quality, and integrity across the entire data lifecycle.
Implement and enforce data security, compliance, and privacy standards.
Document data architecture, data flows, and processes for knowledge sharing and audit readiness.
Continuously improve workflows by adopting Agile best practices and modern engineering standards.

Experience and Qualification:

Proven experience as a Data Engineer / Data Architect with Microsoft Azure.
Strong expertise in data modeling, data warehousing, and ETL development.
Hands-on experience with Azure Data Factory, Azure Data Lake, and Azure SQL Database.
Exposure to big data and distributed processing technologies (Hadoop, Spark, Databricks).
Proficiency in programming languages such as Python and strong SQL skills.
Familiarity with Agile methodology and experience working in a Scrum team environment.

Technical and Operational Skills:

Azure Data Factory
Azure Data Lake
Azure SQL Database
ETL Development
Data Modeling & Data Warehousing
Python, SQL
Spark, Databricks
Scrum & Agile Delivery

Additional Preferred Skills:

Experience with Azure Synapse Analytics or Cosmos DB.
Knowledge of data governance frameworks (e.g., GDPR, HIPAA, or industry standards).
CI/CD integration for data pipelines (Azure DevOps, GitHub).
Familiarity with real-time data streaming tools (Event Hubs).
Fivetran or Airbyte

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.