Senior Data Engineer

Glencore

7 - 12 years

25 - 30 Lacs

chennai

Posted:Just now| Platform:

Apply

Skills Required

mining automation data modeling data processing refinery analytics monitoring automotive sql logistics

Work Mode

Work from Office

Job Type

Full Time

Job Description

Design and manage scalable data pipelines and ETL/ELT processes using Azure Data Factory, Synapse Analytics, and emerging platforms such as Microsoft Fabric and Databricks.
Collaborate with peers to create and maintain data models and databases in Azure SQL DB and Azure Data Lake.
Ensure data quality, lineage, and availability through rigorous validation, testing, and monitoring practices.
Integrate data from ETRM systems, business applications, refinery control systems, and retail station point-of-sale networks.
Implement real-time analytics solutions using Azure Event Hubs, Stream Analytics, and IoT Hub.
Liaise with multiple functional groups across Glencore Group, the Oil Department and the industrial assets, to provision and deploy infrastructure within Azure.
Implement data governance and security policies using Microsoft Purview and Azure RBAC.
Ensure data quality, lineage, and availability for business-critical applications.
Deliver high-velocity solutions supported by strong coding practices and automation.
Build and maintain multiple pipelines in parallel, managing context switching effectively.
Stay current with modern data technologies and trends, including AI/ML, and advise on their responsible adoption.
Operate independently, driving individual workstreams while contributing to team-wide initiatives

COMPETENCIES

Core Competencies

Bachelor s degree in Computer Science, Information Technology, or equivalent experience.
Data Engineering and Modeling: Strong grasp of core data modeling concepts and techniques, experience designing and managing ETL/ELT pipelines using Azure Data Factory and Synapse Analytics.
Programming Languages: Expert proficiency in SQL, Python, and PySpark for data transformation, validation, and analytics.
Cloud Technologies (Azure):
- Azure Data Factory (ADF)
- Azure Synapse Analytics
- Azure Databricks
- Azure Data Lake Storage Gen2
- Azure SQL
- Azure Functions
Version Control and CI/CD: Experience with Git/GitHub and CI/CD pipelines using GitHub Actions.

More Jobs at Glencore

PowerBI Frontend Developer

Chennai

7.0 - 12.0 yrs

INR 9 - 14 Lacs

Senior Developer(IT Apps Engineer)

Chennai, Tamil Nadu, India

5.0 - 5.0 yrs

Salary: Not disclosed

Junior Python Developer

Chennai, Tamil Nadu

1.0 - 3.0 yrs

Salary: Not disclosed

SAP BW Specialist

Chennai

4.0 - 4.0 yrs

INR 1 - 6 Lacs

SAP FICO Specialist

Chennai

4.0 - 4.0 yrs

INR 1 - 6 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.