Job Title: Data Engineer – Azure DatabricksJob Type: Full-Time Job Summary: We are looking for an experienced Data Engineer with strong expertise in Azure Data Factory and Azure Databricks (PySpark/SQL) to join our team. The ideal candidate will have a deep understanding of cloud-based data engineering, data ingestion, semantic modeling, and orchestration. This role requires hands-on experience in working with complex data pipelines and cloud ecosystems. Key Responsibilities: Design, develop, and maintain scalable data pipelines using Azure Data Factory and Azure Databricks (PySpark or Scala). Perform data ingestion and curation from various on-prem and cloud-based sources including Mainframe, SQL Server, and Oracle. Optimize and model data structures to support reporting and analytics within tools like Rahona. Collaborate with stakeholders to understand metadata requirements and manage metadata using tools like Excel. Utilize orchestration tools (e.g., Autosys, Oozie) and promotion/versioning tools (e.g., Git, Jenkins) for CI/CD processes. Ensure secure, efficient, and reliable data movement, including through unconventional methods like mailbox ingestion if necessary. Write and maintain complex SQL queries using T-SQL or PL/SQL. Must-Have Qualifications: Strong expertise in Azure Data Factory and Azure Databricks (PySpark or Scala) . Proficient in SQL , data ingestion , and curation techniques. Cloud certification in Azure , AWS , or GCP . Hands-on experience with semantic modeling and data optimization for analytics tools. Proficient in at least one programming language: Python , Scala , or Java . Experience working with Sqoop , Hadoop , and cloud-based ingestion. Good to Have: Experience with Git/Jenkins for source control and deployment automation. Exposure to mailbox-based data file movements. Familiarity with Microsoft Excel for metadata management. Orchestration experience using Autosys or Oozie . Additional cloud certifications and practical exposure across Azure / AWS / GCP . Preferred Certifications: Azure Data Engineer Associate or equivalent cloud data engineering certification. Job Types: Full-time, Permanent Pay: ₹507,046.63 - ₹3,500,000.00 per year Work Location: In person