RandomTrees logo

Azure Data Engineer - ETL Development

RandomTrees

6 - 11 years

Hyderabad

Posted:1 week ago

Job Description

We are looking for an experienced Azure Data Engineer with strong expertise in Azure Data Factory, Azure Databricks, PySpark, and Snowflake to design, develop, and maintain scalable data pipelines. The ideal candidate should have hands-on experience in ETL development, big data processing, SQL optimization, and integrating data from multiple sources.

Responsibilities

  • Design, develop, test, deploy, and maintain large-scale data pipelines using Azure Data Factory and Azure Databricks.
  • Build and optimize ETL/ELT workflows to extract, transform, and load data from various sources into Snowflake.
  • Use PySpark and Databricks for large-scale data processing and transformation.
  • Develop complex SQL queries and optimize query performance in Snowflake.
  • Troubleshoot data pipeline failures, database issues, and performance bottlenecks.
  • Collaborate with cross-functional teams to gather requirements and design effective data engineering solutions.
  • Ensure data quality, reliability, and consistency across data pipelines and processing workflows.
  • Follow best practices for pipeline performance, code quality, and :
  • 6 - 11 years of experience in data engineering, with hands-on experience building large-scale data pipelines.
  • Strong experience with Azure Data Factory or similar Azure data integration tools.
  • Proficiency in Azure Databricks and PySpark for big data processing and ETL development.
  • Strong SQL skills, including query development and performance optimization in Snowflake.
  • Experience integrating data from multiple sources into cloud-based data warehouses.
  • Strong understanding of ETL/ELT processes and data pipeline design.
  • Good analytical, troubleshooting, and problem-solving skills.

Compensation And Platform

  • CTC range: Competitive market salary based on experience.
  • Cloud Platform: Must have extensive experience with Microsoft Azure.
(ref:hirist.tech)

Skills Required

Azure ETL Development Azure Data Factory Azure Databricks Pyspark BIG Data SQL ETL Data Processing SQL Queries Data Pipeline Data Engineering

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
RandomTrees logo
RandomTrees

RecommendedJobs for You