Walnutt logo

Data Platform Engineer (Team Lead)

Walnutt
Navi mumbai

Posted:4 days ago

Job Description

Company:

Location:

CTC:

Notice Period:


About the role

This role is for a hands-on data engineer who has built CDC pipelines from operational databases into a lakehouse and has run Databricks in production. As Data Platform Team Lead, you’ll own the Databricks lakehouse and the pipelines that feed it. Those pipelines bring in data from the company’s Loan Origination System (LOS) on PostgreSQL and from vendor databases. The data serves reporting, risk, collections, finance and regulatory teams. You’ll also lead a small team of data engineers.


What you’ll do

  • Lead the Databricks lakehouse: ingestion, Delta Lake tables, transformations, orchestration, data quality, Unity Catalog governance and keeping compute costs under control
  • Design and run reliable CDC from the LOS Postgres database, and ingestion from vendor databases, into Databricks
  • Own data contracts, PII/audit requirements, reconciliation, lineage and schema-change management
  • Lead and mentor the team, make the architecture calls, and set priorities with application, product, risk and business teams


What we’re looking for

  • 7-8 years in data engineering or data platform roles, including leading or mentoring engineers
  • Hands-on Databricks in production: Spark, Delta Lake, Unity Catalog and Workflows
  • You’ve built CDC or ingestion from operational databases into a lakehouse (e.g. logical replication, Debezium or DMS into Delta/S3)
  • Good understanding of PostgreSQL as a CDC source, including logical replication and handling schema changes
  • Strong SQL and Python (Scala is a plus)


Apply

select target role as Data Engineer (L3)

Skills Required

Nbfc Loan Origination Postgresql Finance Data Quality Postgres Database Reconciliation Change Management Data Engineering Spark SQL Python

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Walnutt logo
Walnutt

RecommendedJobs for You