Lead Data Engineer

Job Title: Lead Data Engineer

Job Type: Permanent

Relevant Experience: 8+ years experience  in a data-related role with recent experience in the field of cloud data engineering. Experience of cloud data analytics and data warehousing would be an advantage.

Reports to: Engineering Manager – Data & Analytics

Job Description:

We, at Jet2 (UK’s third largest airlines and the second largest tour operator), have set up a state-of-the-art Technology and Innovation Centre in Pune, India. We are recruiting for an experienced and passionate Lead Data Engineer to join our growing Data Engineering program which is focused on making data assets from across our business available in cloud for advanced analytics, data science and automated decision making. These data assets drive mission critical processes across our commercial and operational teams contributing towards profitable growth, competitive advantage, and exceptional customer satisfaction. This is an exciting opportunity to help us become a leading data-drive organisation through the effective use of data.

The successful candidate will play a pivotal role in the success of our Data Engineering program working closely with colleagues across our business and technical teams. You will be designing and building complex data solutions encompassing a wide variety of data sources and will ensure data is cleansed, well structured, and appropriately transformed to support a wide variety of use cases ranging from self-service analytics through to data warehousing and data science. We are looking for a thought-leader in the space of Cloud Data Engineering to not only enable us to deliver solutions efficiently but also evolve our Data Engineering processes and practices to ensure we continue to align with industry best-practice and take advantage of new developments in the Data Engineering landscape.

Key Responsibilities:

The successful candidate will be in a lead role with responsibility for both solution delivery and management of a team of data engineers. The role will operate from our Pune office and collaborate closely with various stakeholders and colleagues in Pune, Leeds and Sheffield.

• Design and deliver scalable and reliable data products to support data consumers across Jet2.com and Jet2Holidays


• Ingest, cleanse and transform data from a wide variety of sources systems into our cloud data lake to support advanced analytics, data warehousing and data science


• Design complex data engineering solutions running on Google’s cloud platform primarily


• Support the continual training and development of your team and the wider data engineering function at Jet2 to keep up to date with developments in data engineering and drive continual improvement across the team


• Help to recruit, train and mentor a team of highly skilled data engineers with a wide range of technical knowledge and experience

Technical Skills & Knowledge:

• Advanced SQL & Python knowledge with experience using a wide variety of source systems including Microsoft SQL Server, APIs, Streaming – Kafka etc.


• Experienced in AWS Data Platform (experience of GCP and Azure also beneficial but delivery will be focused on AWS)


• Specific experience with the following services running on the AWS platform:
  
  
  
  • S3, MWAA, DynamoDB, Glue, Lambda, RDS, SNS/SQS, Kinesis, Cloud watch etc.
  
  
  
  


• Experience working with Infrastructure as Code (IaC), specifically with Terraform (equivalent experience with similar technology also accepted)


• Experience of working in an Agile delivery team using automated build, deployment and testing (CI\CD, DevOps, DataOps)


• Experience with one or more programming language compatible with developing functionality on the above platform (Python preferred)


• Expertise in working with and modelling both structured and unstructured data


• Knowledge or experience in the field of data warehousing and advanced analytics would be essential, specifically any experience in the following area:
  
  
  
  • Dimensional Modelling
  
  
  • Working with Snowflake’s Cloud Data Warehouse
  
  
  • Working with dbt to develop, test, deploy and monitor data transformation code
  
  
  
  

Soft Skills:

• Excellent communication skills – verbal and written


• Strong team and stakeholder management skills – you should have the ability to build strong relationships with people across a wide variety of teams and backgrounds


• Experience working with people across different geographical regions, particularly UK and US


• Excellent planning and time management skills to ensure projects are delivered on time and to requirement with issues being escalated and addressed effectively


• Exceptional documentation and presentation skills – you will be responsible for documenting solution designs for presentation and sign-off as well as delivering internal presentation to support continual development of your team

Leadership & Organisation Skills:

• Lead a team of data engineers working across multiple projects (Senior, Mid, Junior and Graduate level Data and Test Engineers)


• Set individual development goals, monitor, and manage performance, provide timely feedback and take responsibility for professional development of team members


• Collaborate with wider data team including Solution Architects, Specialists, Enterprise Architects, Data Scientists, Data Visualisation Specialists, Analytics Engineers and Test Engineers

Qualification & Certification:

• B.E./B.Tech/ MTech in IT or Computer Science from reputed institute (preferred) or Master Degree in Quantitative Subjects e.g. Mathematics, Statistics & Economics


• Cloud Certification in AWS (GCP, Azure certifications also beneficial) – Architect or Developer


• Any certification or formal training in the following areas would also be highly beneficial:
  
  
  
  • Python
  
  
  • Snowflake Cloud Data Warehouse
  
  
  • dbt
  
  
  • Terraform