Data Engineer - Python/PySpark

As a Lead Data Engineer, your role is crucial in designing, developing, and optimizing pyspark workloads using SQL, Databricks, Python, Azure Cloud, and Power BI. You will be responsible for writing scalable, modular, and reusable code while effectively communicating with client stakeholders and collaborating with cross-functional teams. Your ability to gather requirements and translate them into technical specifications is essential for project success. Key Responsibilities: - Hands-on experience with SQL, Databricks, pyspark, Python, Azure Cloud, and Power BI. - Design, develop, and optimize pyspark workloads. - Write scalable, modular, and reusable code in SQL, Python, and pyspark. - Communicate clearly with client stakeholders and collaborate with cross-functional teams. - Gather requirements and translate business needs into technical specifications. Stakeholder Management: - Engage with stakeholders to gather and analyze requirements. - Provide regular updates and reports on project status and progress. - Ensure alignment of data solutions with business objectives. Shift Requirements: - Ability to work during US shift hours to coordinate with global teams. Qualifications: - Proficiency in SQL, Databricks, PySpark, Python, Azure Cloud, and Power BI. - Strong communication skills, both written and verbal. - Proven ability to work effectively with global stakeholders. - Strong problem-solving skills and attention to detail. Please note that this job requires 3-5 years of experience and will be based in Bengaluru. As a Lead Data Engineer, your role is crucial in designing, developing, and optimizing pyspark workloads using SQL, Databricks, Python, Azure Cloud, and Power BI. You will be responsible for writing scalable, modular, and reusable code while effectively communicating with client stakeholders and collaborating with cross-functional teams. Your ability to gather requirements and translate them into technical specifications is essential for project success. Key Responsibilities: - Hands-on experience with SQL, Databricks, pyspark, Python, Azure Cloud, and Power BI. - Design, develop, and optimize pyspark workloads. - Write scalable, modular, and reusable code in SQL, Python, and pyspark. - Communicate clearly with client stakeholders and collaborate with cross-functional teams. - Gather requirements and translate business needs into technical specifications. Stakeholder Management: - Engage with stakeholders to gather and analyze requirements. - Provide regular updates and reports on project status and progress. - Ensure alignment of data solutions with business objectives. Shift Requirements: - Ability to work during US shift hours to coordinate with global teams. Qualifications: - Proficiency in SQL, Databricks, PySpark, Python, Azure Cloud, and Power BI. - Strong communication skills, both written and verbal. - Proven ability to work effectively with global stakeholders. - Strong problem-solving skills and attention to detail. Please note that this job requires 3-5 years of experience and will be based in Bengaluru.