Manager - Data Engineering

We are seeking a talented individual to join our IT team at Marsh McLennan. This role will be based in Pune/Noida/GGN/Mumbai. This is a hybrid role that has a requirement of working at least three days a week in the office.

As a Data Engineer, you will be responsible for designing and implementing scalable data pipelines using Databricks and the Medallion Architecture. You will handle end-to-end ETL/ELT processes, manage large datasets, and work with tools like Python, PySpark, and AWS S3 to ensure data is transformed and optimized for analytical use. Additionally, knowledge on Informatica, Unix, and Oracle database is also a good to have.

We will count on you to:

• Develop and maintain data pipelines using Databricks and the Medallion Architecture (Bronze, Silver, Gold layers).
• Design and optimize ETL/ELT workflows to ensure data quality and efficiency.
• Write data transformation scripts using Python and PySpark.
• Store and manage data in AWS S3 and integrate with other cloud-based services.
• Use SQL to query, clean, and manipulate large datasets.
• Collaborate with cross-functional teams to ensure data is accessible for business intelligence and analytics.
• Monitor and troubleshoot data pipelines for performance and reliability.
• Document data processes and follow best practices for scalability and maintainability.
• Ingest the data using AWS DMS from disparate sources.

What you need to have:

• Any B.Tech/BE, M.Tech
• 7-10years of experience
• Experience with Databricks and the Medallion Architecture.
• Proficiency in Python, PySpark, and SQL for data processing and transformation.
• Solid experience with ETL/ELT pipelines and cloud-based data solutions, specifically AWS S3.
• Familiarity with version control using Git.
• Understanding of modern data architecture principles and best practices.
• Preferred Qualifications:
• Experience with Delta Lake and other Databricks technologies. Knowledge of additional AWS services (e.g., Redshift, Glue, Lambda, S3, DMS ).

What makes you stand out:

• Excellent verbal and written communication skills, comfortable interfacing with business users
• Good troubleshooting and technical skills
• Able to work independently

Why join our team:

• We help you be your best through professional development opportunities, interesting work and supportive leaders.
• We foster a vibrant and inclusive culture where you can work with talented colleagues to create new solutions and have impact for colleagues, clients and communities.
• Our scale enables us to provide a range of career opportunities, as well as benefits and rewards to enhance your well-being.