Data Engineer ( Azure Databricks, PySpark / Python )

We are looking for a skilled Data Engineer with 6-12 years of experience to design, develop, and maintain scalable data pipelines using Databricks, PySpark, Spark SQL, and Delta Live Tables. The ideal candidate will have a strong understanding of data warehousing concepts, ETL processes, and data modeling.

• Design, develop, and maintain scalable data pipelines using Databricks, PySpark, Spark SQL, and Delta Live Tables.
• Collaborate with cross-functional teams to understand data requirements and translate them into efficient data models and pipelines.
• Implement best practices for data engineering, including data quality and security.
• Optimize and troubleshoot complex data workflows to ensure high performance and reliability.
• Develop and maintain documentation for data engineering processes and solutions.
• Ensure data engineering processes align with industry standards and best practices.

• Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
• Proven experience as a Data Engineer with a focus on Databricks, PySpark, Spark SQL, and Delta Live Tables.
• Strong understanding of data warehousing concepts, ETL processes, and data modeling.
• Proficiency in programming languages such as Python and SQL.
• Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services.
• Excellent problem-solving skills and the ability to work in a fast-paced environment.
• Strong leadership and communication skills, with the ability to mentor and guide team members.