THE ROLE
As a Senior Data Platform Engineer, you will lead the design and governance of scalable, secure, and compliant data architectures on Microsoft Azure. You will work across oil trading, refining, and retail fuel operations to align cloud data strategies with business goals, regulatory requirements, and industry best practices.
You will play a hands-on technical role within the data engineering team, interfacing with the CloudOps team in London to design and implement cost effective solutions across our suite of Azure products adhering to best practice principles. Experience in DevOps is highly desirable as you will be responsible for designing CI/CD pipelines using Github Actions and containerization technologies.
In addition, the role will involve exploring new technologies and navigating implementation within Glencore’s private Azure tenant, according to the guidelines enforced at Group level. With these in mind, you will play an advisory role across the Assets, assisting with design and implementation, and on-premises to cloud migrations as required.
This role sits within the Oil Assets IT team, reporting to the Data Engineering Team Lead.
PROFILE
Experienced IT professional with over 10 years of experience, including 2–4 years leading cloud-native data architecture initiatives. Proven track record in designing and delivering scalable, end-to-end data platform solutions across hybrid and multi-cloud environments. Adept at driving best practices in data engineering, modernizing legacy systems, and advising stakeholders on strategic data platform decisions. Strong focus on performance, reliability, and governance across enterprise-grade data ecosystems. Skilled in setting up foundational components, enforcing engineering standards, and enabling team-wide productivity through automation, CI/CD, and reusable frameworks. Plays a key leadership role in a growing data engineering team, working alongside senior and junior data engineers.
RESPONSIBILITIES
Platform Engineering & Architecture
Design and implement scalable, secure, and cost-effective data platform solutions using Azure Synapse Analytics, Azure Data Lake, and related services.
Translate business and regulatory requirements into cloud-native data architectures.
Contribute to the architectural roadmap, including the adoption and integration of Microsoft Fabric for unified data experiences.
Define and enforce platform standards, patterns, and reusable components to accelerate delivery across the team.
CI/CD, Automation & Containerization
Lead the implementation of CI/CD pipelines for data engineering workflows using Azure DevOps and Git.
Automate infrastructure provisioning and deployment using Infrastructure as Code (e.g., Bicep, Terraform).
Develop and maintain containerized data services using Docker, and orchestrate deployments using Kubernetes (AKS).
Establish automated testing, validation, and monitoring practices to ensure data quality and platform reliability.
Team Enablement & Collaboration
Collaborate closely with the other Senior Engineer to co-lead technical direction and ensure consistency across projects.
Mentor and support data engineers and developers, providing guidance on best practices, code reviews, and technical upskilling.
Work cross-functionally with Data Architects, Analysts, and Product Owners to translate business needs into robust data solutions.
Governance, Security & Operations
Implement data governance and lineage practices using Microsoft Purview and Fabric-native tools.
Ensure compliance with security and privacy standards through RBAC, encryption, and secure data handling.
Monitor platform performance and proactively address operational issues and bottlenecks.
Innovation & Continuous Improvement
Stay current with Microsoft’s evolving data ecosystem, including Fabric, and evaluate new tools and services for team adoption.
Drive continuous improvement in engineering workflows, platform scalability, and developer experience.
Maintain understanding of the latest trends and advancements in AI and machine learning, and advise on incorporation of these innovations across the department, alongside governance.
COMPETENCIES
Bachelor’s degree in Computer Science, Information Technology, or equivalent experience.
Excellent understanding of core data modelling concepts and techniques
Ability to manage stakeholders and develop effective relationships across different cultures.
Cloud & Platform: Azure Synapse Analytics, Microsoft Fabric (emerging), Azure Data Lake Gen2, Azure SQL, Azure DatabricksReal-Time & IoT: Azure Event Hubs, Azure Stream Analytics, Azure IoT Hub
Data Engineering: Azure Data Factory, Synapse Pipelines, Spark, Delta Lake, T-SQL, Python
Governance and Security: Microsoft Purview, Key Vault, RBAC, Data Masking, Encryption
Monitoring and Observability: Azure Monitor, Log Analytics, Application Insights
Governance and Security: Microsoft Purview, Key Vault, RBAC, Data Masking, Encryption
Monitoring and Observability: Azure Monitor, Log Analytics, Application Insights
DevOps and Automation: Azure DevOps, Git/GitHub, CI/CD, Bicep, Terraform, YAML pipelines
Containerization and Orchestration: Docker, Kubernetes (AKS), Helm
Desirable:
Exposure to DataOps practices and awareness of advanced Data Architecture patterns
Certifications: Azure Solutions Architect, Azure Data Engineer Associate, Azure DevOps Engineer Expert
Visualisation & BI: Power BI, Azure Analysis Services.
Machine Learning: Azure ML
Who we are
Glencore is one of the world’s largest global diversified natural resource companies and a major producer and marketer of more than 60 commodities that advance everyday life. Through a network of assets, customers and suppliers that spans the globe, we produce, process, recycle, source, market and distribute the commodities that support decarbonisation while meeting the energy needs of today.
With over 150,000 employees and contractors and a strong footprint in over 35 countries in both established and emerging regions for natural resources, our marketing and industrial activities are supported by a global network of more than 50 offices.
Glencore’s customers are industrial consumers, such as those in the automotive, steel, power generation, battery manufacturing and oil sectors. We also provide financing, logistics and other services to producers and consumers of commodities.
Glencore is proud to be a member of the Voluntary Principles on Security and Human Rights and the International Council on Mining and Metals. We are an active participant in the Extractive Industries Transparency Initiative.
We will support the global effort to achieve the goals of the Paris Agreement through our efforts to decarbonise our own operational footprint. We believe that we should take a holistic approach and have considered our commitment through the lens of our global industrial emissions. Against a restated 2019 baseline, we are targeting to reduce our Scope 1, 2 and 3 industrial emissions by 15% by the end of 2026, 25% by the end of 2030, 50% by the end of 2035 and we have an ambition to achieve net zero industrial emissions by the end of 2050, subject to a supportive policy environment. For more information see our 2024-2026 Climate Action Transition Plan and the About our emissions calculation and reporting section in our 2023 Annual Report, available on our website at glencore.com/publications.
Note*: All applications will be subject to potential background checks. You will be informed if this will be the case. Further information about the processing of your personal data will be made available during the application process. We'll seek your explicit consent prior to processing the data.
