Principal Consultant

Job Description

Location: PAN India Job Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have over 10 years of experience in data engineering, with a strong background in Azure Data Factory (ADF), Data Lake, Snowflake, Python, and Databricks. The candidate should also have experience in data ingestion into data platforms from source systems via an ODATA adapter using ADF pipelines. Key Responsibilities: Design, develop, and maintain scalable data pipelines and systems. Implement data ingestion processes from various source systems using ADF pipelines and ODATA adapters. Work with Azure Data Factory, Data Lake, Snowflake, Python, and Databricks to build and optimize data solutions. Collaborate with cross-functional teams to understand data requirements and deliver solutions. Ensure data quality and integrity across all data pipelines and systems. Provide technical leadership and mentorship to junior data engineers. Work on projects within the Energy Trading and Risk Management (ETRM) domain. Integrate data solutions with trading systems such as Allegro, RightAngle, and Endur. Mandatory Skills: Azure Data Factory (ADF) Data Lake Snowflake Python Databricks Experience with data ingestion using ODATA adapters and ADF pipelines Experience in the ETRM domain Integration experience with trading systems like Allegro, RightAngle, and Endur Preferred Qualifications: Strong problem-solving and analytical skills Excellent communication and collaboration skills Ability to work in a fast-paced and dynamic environment Experience with other data engineering tools and technologies is a plus Education: Bachelor's or Master's degree in Computer Science, Information Technology, or a related field Certification in relevant technologies is a plus.