Job
Description
As a Software Data Engineer at FTSE Russell, you will be part of a team dedicated to building scalable data systems with real-world impact. Your role will involve designing and developing testable data pipelines using Python and Apache Spark. You will orchestrate data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3. Applying modern software engineering practices will be a key part of your responsibilities, including version control, CI/CD, modular design, and automated testing. Additionally, you will contribute to the development of a lakehouse architecture using Apache Iceberg. Collaboration with business teams to translate requirements into data-driven solutions, building observability into data flows, and implementing basic quality checks are also essential tasks. Participation in code reviews, pair programming, and architecture discussions will be encouraged. Continuous learning about the financial indices domain and sharing insights with the team will be part of your growth journey. **Key Responsibilities:** - Designing and developing scalable data pipelines using Python and Apache Spark - Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3 - Applying modern software engineering practices: version control, CI/CD, modular design, and automated testing - Contributing to the development of a lakehouse architecture using Apache Iceberg - Collaborating with business teams to translate requirements into data-driven solutions - Building observability into data flows and implementing basic quality checks - Participating in code reviews, pair programming, and architecture discussions - Continuously learning about the financial indices domain and sharing insights with the team **Qualifications Required:** - Writes clean, maintainable Python code (ideally with type hints, linters, and tests like pytest) - Understands data engineering basics: batch processing, schema evolution, and building ETL pipelines - Has experience with or is eager to learn Apache Spark for large-scale data processing - Is familiar with the AWS data stack (e.g. S3, Glue, Lambda, EMR) - Enjoys learning the business context and working closely with stakeholders - Works well in Agile teams and values collaboration over solo heroics **Nice-to-haves:** - Experience with Apache Iceberg or similar table formats - Familiarity with CI/CD tools like GitLab CI, Jenkins, or GitHub Actions - Exposure to data quality frameworks like Great Expectations or Deequ - Curiosity about financial markets, index data, or investment analytics This role at FTSE Russell offers you the opportunity to be part of a team that values innovation, quality, and continuous improvement. If you are ready to take your career to the next level and make a significant impact, we welcome your application.,
