Azure Data Engineer

Role Overview: As an experienced Azure Data Engineer at our company, you will play a key role in designing, developing, and deploying scalable data pipelines using Azure Data Factory, Databricks, and PySpark. Your strong communication skills and expertise in Azure, Databricks, PySpark, SQL, data modeling, data integration, and workflow orchestration will be essential in optimizing data processing workflows and ensuring data quality, security, and compliance with organizational standards. You will collaborate with cross-functional teams to prioritize project requirements and troubleshoot data pipeline issues to enhance performance. Additionally, your ability to effectively communicate technical solutions to non-technical stakeholders will be crucial in this role. Key Responsibilities: - Design, develop, and deploy scalable data pipelines using Azure Data Factory, Databricks, and PySpark - Work with large datasets (500 GB+) to develop and optimize data processing workflows - Collaborate with cross-functional teams to identify and prioritize project requirements - Develop and maintain data models, data integration, and workflow orchestration - Ensure data quality, security, and compliance with organizational standards - Troubleshoot data pipeline issues and optimize performance - Communicate technical solutions to non-technical stakeholders Qualifications Required: - 4+ years of experience in data engineering - Azure certification is mandatory - Strong proficiency in Azure, Databricks, PySpark, SQL, data modeling, data integration, and workflow orchestration - Experience working with large datasets (500 GB+) - Strong communication and interpersonal skills - Ability to work in a 2nd shift - Experience in product engineering is a plus - Minimum 2-3 projects with experience working in large datasets (Note: No additional details of the company were present in the job description.),