Principal Data Engineer

Role Overview: As a Principal Data Engineer (Associate Director) at Fidelity in Bangalore, you will be an integral part of the ISS Data Platform Team. You will have the opportunity to lead a team of senior and junior developers, providing mentorship and guidance, while taking ownership of delivering a subsection of the wider data platform. Your role will involve designing, developing, and maintaining scalable data pipelines and architectures to facilitate data ingestion, integration, and analytics. Collaboration will be a key aspect of your responsibilities as you work closely with enterprise architects, business analysts, and stakeholders to understand data requirements, validate designs, and communicate progress. Your innovative mindset will drive technical advancements within the department, focusing on enhancing code reusability, quality, and developer productivity. By challenging the status quo and incorporating the latest data engineering practices and techniques, you will contribute to the continuous improvement of the data platform. Key Responsibilities: - Lead a team of senior and junior developers, providing mentorship and guidance - Design, develop, and maintain scalable data pipelines and architectures for data ingestion, integration, and analytics - Collaborate with enterprise architects, business analysts, and stakeholders to understand data requirements, validate designs, and communicate progress - Drive technical advancements within the department to enhance code reusability, quality, and developer productivity - Implement data access controls to ensure data security and performance optimization in compliance with regulatory requirements - Utilize expertise in cloud-based data platforms like Snowflake and Databricks to create an enterprise lake house - Demonstrate advanced proficiency in the AWS ecosystem and experience with core AWS data services like Lambda, EMR, and S3 - Design event-based or streaming data architectures using Kafka and exhibit strong skills in Python and SQL - Proficiency in CI/CD pipelines for deploying infrastructure and pipelines, experience with RDBMS and NOSQL offerings, and familiarity with orchestration tools like Airflow Qualifications Required: - Experience in leveraging cloud-based data platforms, particularly Snowflake and Databricks - Advanced proficiency in the AWS ecosystem and core AWS data services like Lambda, EMR, and S3 - Designing event-based or streaming data architectures using Kafka - Strong skills in Python and SQL - Proficiency in CI/CD pipelines for deploying infrastructure and pipelines - Experience with RDBMS and NOSQL offerings - Familiarity with orchestration tools like Airflow *Note: The additional details of the company were not included in the job description provided.,