EY - GDS Consulting - AI And DATA - AWS Databricks - Senior

8 years

0 Lacs

Posted:1 day ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

At EY, we’re all in to shape your future with confidence.We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.Join EY and help to build a better working world.

Data Engineer – Life Sciences R&D (Senior Level)

Experience: 8+ Years

Role Overview

As a senior Data Engineer, you will be responsible for building robust, scalable, and compliant data pipelines from raw scientific sources to integrated and consumption-ready data products in the R&D landscape. You will partner with architects, domain SMEs, and analysts to develop re-usable components supporting early discovery, development, and regulatory needs.

Key Responsibilities

  • Design and implement pipelines across L1–L3 layers using Databricks and Spark.
  • Develop modular, parameterized ETL processes for large-scale scientific data integration.
  • Implement and maintain STTM mappings and transformation logic with domain BAs.
  • Build metadata-driven orchestration, logging, and observability frameworks.
  • Support performance optimization, validation, and deployment readiness across squads.
  • Collaborate with architects on cloud-native best practices and standards.

Must-Have Skills

  • 8+ years of experience in data engineering, with 3+ in life sciences or R&D settings.
  • Hands-on expertise with Spark, Databricks, Delta Lake, and Python/SQL.
  • Experience in building pipelines with STTM/SDTM alignment and scientific data quality requirements.
  • Good understanding of L1–L3 pipeline layering and governance controls.
  • Familiarity with GxP or other compliance-driven implementations.

Nice-to-Have Skills

  • Exposure to ELNs, LIMS, compound registration systems, or bioassay platforms.
  • Knowledge of Unity Catalog, Matillion, or metadata-driven architecture approaches.
  • Experience with ingestion frameworks, schema evolution, and CI/CD for data.

EY | Building a better working world

EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
EY logo
EY

Professional Services

London

RecommendedJobs for You