Senior Data Engineer

7 years

0 Lacs

Posted:1 day ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Contractual

Job Description

We are seeking a Senior Data Engineer to support our strategic data initiatives. As we implement a Medallion Architecture (Bronze/Silver/Gold layers) and replatform several core transactional systems, this role will be critical in ensuring data quality, governance, and scalability. You will focus on operationalizing Silver and Gold data layers, adapting pipelines to new data sources, and ensuring downstream analytics, dashboards, and reporting remain reliable during this transition.

Key Responsibilities:

Silver/Gold Layer Development

  • Translate raw data from sources (Zuora, CommerceTools, APIs, legacy databases) into curated Silver and Gold tables
  • Apply business logic, standardization, and data quality checks.
  • Partner with analysts and business stakeholders to validate metric definitions.

Replatforming Support

  • Audit existing pipelines for dependencies on legacy data structures.
  • Update models and jobs to consume data from new transactional systems.
  • Ensure lineage tracking and compatibility with downstream reporting and analytics.

Collaboration & Documentation

  • Work closely with engineers, analysts, and business partners to document requirements, transformations, and validations
  • Contribute to metadata tagging and data cataloging (Unity Catalog).
  • Deliver detailed documentation including data dictionaries, constraints (PK, FK), and pipeline logic

Requirements

  • Minimum 7+ years of relevant experience
  • Strong data modeling skills (Kimball methodology) with hands-on Databricks experience.
  • Proficiency in SQL and Python
  • Expertise with Databricks features such as workflows, DLTs, Delta tables, and Unity Catalog
  • Familiarity with Medallion Architecture (Bronze/Silver/Gold layers)
  • Experience with version control systems (GitHub).
  • Solid understanding of data governance, data quality frameworks, and observability practices
  • Ability to work effectively across analytics, product, and engineering teams.

Preferred skills:

  • Experience with replatforming large transactional systems
  • Exposure to subscription and commerce data domains

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You