Azure Data Engineer

JOB TITLE: AZURE DATA ENGINEER

EXPERIENCE: 4+ YEARS

LOCATION: HYDERABAD

SHIFT: 2PM 11 PM

EMPLOYMENT: FULL TIME

Job Summary:

Azure Databricks Engineer

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines in

  Azure Databricks (PySpark/Scala)

• Integrate data from various structured and unstructured data sources into Azure data lake and warehouse solutions
• Work with

  Azure Data Factory (ADF)

  to orchestrate and schedule ETL/ELT workflows
• Optimize existing Spark-based workflows for performance and cost-efficiency
• Collaborate with data scientists, analysts, and business stakeholders to understand data needs
• Implement data governance, quality checks, and monitoring systems
• Support CI/CD pipelines for data engineering workflows using DevOps best practices
• Troubleshoot and resolve data-related technical issues

Required Skills & Experience:

• Proven experience with

  Azure Databricks

  (Spark, Delta Lake)
• Proficiency in

  PySpark

  or

  Scala

• Strong hands-on experience with

  Azure Data Factory (ADF)

  ,

  Azure Data Lake Storage (ADLS)

  ,

  Azure Synapse Analytics

• Understanding of

  distributed computing

  ,

  data partitioning

  , and

  performance tuning

  in Databricks
• Experience with

  CI/CD pipelines

  , version control (e.g., Git), and

  Infrastructure as Code (IaC)

  using tools like Terraform or ARM
• Solid understanding of

  data warehousing

  ,

  ETL/ELT

  , and

  data modeling

• Knowledge of

  SQL

  and familiarity with relational and NoSQL databases
• Familiarity with

  data governance

  tools like

  Purview

  ,

  Unity Catalog

  , or similar

Preferred Qualifications:

• Microsoft Azure or Databricks certifications (e.g.,

  Databricks Certified Data Engineer Associate

  )
• Experience working in Agile environments
• Exposure to real-time data streaming tools (e.g., Kafka, Event Hubs)
• Experience with BI tools like Power BI

Educational Requirements:

• Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or related field

Top of Form

Bottom of Form