Senior Data Engineer

Job Description

Responsible for supporting the delivery of business analysis and consulting processes and procedures for the defined specialism using sound technical capabilities, building and maintaining effective working relationships, ensuring relevant standards are defined and maintained, and supporting delivery of process and system improvements. Specialisms: Business Analysis; Data Management and Data Science; Digital Innovation. You will work with The AppSim team is responsible for driving application simplification across the organization, focusing on reducing operational complexity and technical debt. They work closely with the wider digital delivery and digital core teams to identify and pursue simplification opportunities. The team collaborates with business partners to align simplification efforts with broader transformation goals and drive measurable improvements in operational efficiency. Let me tell you about the role In the AppSim team, a Data Engineer designs and builds scalable data management systems that support application simplification efforts. They develop and maintain databases and large-scale processing systems to enable efficient data collection, analysis, and integration. Key responsibilities include ensuring data accuracy for modeling and analytics, optimizing data pipelines for scalability, and collaborating with data scientists to drive data-driven decision-making. They play a crucial role in supporting the AppSim team s goals by enabling seamless access to reliable data for simplification initiatives. What you will deliver As part of a cross-disciplinary team, you will collaborate with data engineers, software engineers, data scientists, data managers, and business partners to architect, design, implement, and maintain reliable and scalable data infrastructure for moving, processing, and serving data. You will write, deploy, and maintain software to build, integrate, manage, and assure the quality of data. Adhering to software engineering best practices, you will ensure technical design, unit testing, monitoring, code reviews, and documentation are followe'd. You will also ensure the deployment of secure, we'll-tested software that meets privacy and compliance standards, and improve the CI/CD pipeline. Additionally, you will be responsible for service reliability, on-call rotations, SLAs, and maintaining infrastructure as code. By containerizing server deployments and mentoring others, you'll actively contribute to improving developer velocity. What you will need to be successful (experience and qualifications) Essential Deep, hands-on expertise in designing, building, and maintaining scalable data infrastructure and products in complex environments Development experience in object-oriented programming languages (eg, Python, Scala, Java, C#) Advanced knowledge of databases and SQL Experience designing and implementing large-scale distributed data systems Strong understanding of technologies across all stages of the data lifecycle Ability to manage stakeholders effectively and lead initiatives through technical influence Continuous learning approach BS degree in computer science or a related field (or equivalent experience) Desired No prior experience in the energy industry required Skills: Architectural Design, Data Governance, Data Quality Assessments, Data Security, Data Validation, Project Management, PySpark, Python Automation, SQL Databases