Azure Data Engineer

Job Title: Data Engineer – Azure DatabricksJob Type: Full-Time

Job Summary: We are looking for an experienced Data Engineer with strong expertise in Azure Data Factory and Azure Databricks (PySpark/SQL) to join our team. The ideal candidate will have a deep understanding of cloud-based data engineering, data ingestion, semantic modeling, and orchestration. This role requires hands-on experience in working with complex data pipelines and cloud ecosystems.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines using Azure Data Factory and Azure Databricks (PySpark or Scala).
• Perform data ingestion and curation from various on-prem and cloud-based sources including Mainframe, SQL Server, and Oracle.
• Optimize and model data structures to support reporting and analytics within tools like Rahona.
• Collaborate with stakeholders to understand metadata requirements and manage metadata using tools like Excel.
• Utilize orchestration tools (e.g., Autosys, Oozie) and promotion/versioning tools (e.g., Git, Jenkins) for CI/CD processes.
• Ensure secure, efficient, and reliable data movement, including through unconventional methods like mailbox ingestion if necessary.

Write and maintain complex SQL queries using T-SQL or PL/SQL.

Must-Have Qualifications:

• Strong expertise in Azure Data Factory and Azure Databricks (PySpark or Scala).
• Proficient in SQL, data ingestion, and curation techniques.
• Cloud certification in Azure, AWS, or GCP.
• Hands-on experience with semantic modeling and data optimization for analytics tools.
• Proficient in at least one programming language: Python, Scala, or Java.
• Experience working with Sqoop, Hadoop, and cloud-based ingestion.

Good to Have:

• Experience with Git/Jenkins for source control and deployment automation.
• Exposure to mailbox-based data file movements.
• Familiarity with Microsoft Excel for metadata management.
• Orchestration experience using Autosys or Oozie.
• Additional cloud certifications and practical exposure across Azure / AWS / GCP.

Preferred Certifications:

• Azure Data Engineer Associate or equivalent cloud data engineering certification.

Job Types: Full-time, Permanent

Pay: ₹507,046.63 - ₹3,500,000.00 per year

Work Location: In person