Azure Data Engineer

Job Title:

We are seeking a skilled and motivated Data Engineer to join our team in Hyderabad. The ideal candidate will have hands-on experience in designing, developing, and maintaining data pipelines and solutions using Azure services and open-source technologies.

Key Responsibilities:

• Design, develop, and optimize data workflows using Azure Data Factory (ADF).
• Build and maintain scalable data processing solutions using Azure Data Bricks (ADB) with PySpark.
• Write efficient, reusable, and reliable Python and SQL scripts for data transformation and processing.
• Collaborate with data scientists and analysts to understand data requirements and deliver solutions.
• Monitor, troubleshoot, and improve data pipeline performance and reliability.
• Ensure data quality, security, and compliance standards are met.

Required Skills & Qualifications:

• 4+ years of experience in Data Engineering or relevant roles.
• Hands-on experience with Azure Data Factory (ADF) and Azure Data Bricks (ADB).
• Strong proficiency in PySpark, Python, and SQL.
• Experience in designing and implementing ETL/ELT processes.
• Good understanding of data warehousing concepts and data modeling.
• Familiarity with cloud-based data solutions and architecture best practices.
• Excellent problem-solving and communication skills.

Preferred Skills:

• Experience with other Azure services like Azure Data Lake, Azure SQL Database.
• Knowledge of DevOps practices related to data pipelines.
• Ability to work in a dynamic, collaborative environment.

  Role & responsibilities