Technical Lead

Chennai

Posted:2 days ago

Job Description

Job Summary

We are looking for Data Engineers,

  • Microsoft Fabric experience is mandatory.
  • OneLake knowledge is required.
  • Medallion Architecture experience (Bronze, Silver, Gold layers) is mandatory.
  • Strong experience in PySpark, SQL and data transformation pipelines is required.
  • Candidates focused only on Semantic Models or Reporting Layers may not fit this requirement.
Key Responsibilities

Data Engineer (Microsoft Fabric)

Builds the Bronze, Silver and Gold layers, the reusable framework, and the data quality and reconciliation controls.

Key responsibilities

Build the metadata-driven ingestion and transformation framework

Develop Bronze ingestion, Silver cleansing and conformance, and Gold marts

Implement data quality rules, quarantine handling and reconciliation controls across layers

Build orchestration, scheduling and dependencies in Fabric pipelines

Tune performance, partitioning and capacity use

Support SIT, parallel run and hypercare, and fix defects

Write clean, version-controlled, documented code

Required skills and experience

Data engineering on Spark with PySpark and Spark SQL; Delta Lake

Hands-on Fabric (Lakehouse, Notebooks, Pipelines) or equivalent Synapse or Databricks experience

Strong SQL and dimensional modelling basics

Git and CI/CD practices

Testing and debugging data pipelines

Skill Requirements

Primary Skills

  • Microsoft Fabric
  • PySpark
  • SQL
  • OneLake
  • Delta Lake
  • Medallion Architecture
  • Data Pipelines

Secondary Skills

  • Git
  • CI/CD
  • DevOps Practices
  • Data Quality Frameworks
Must Have Skill
Data Lakes,Data Pipelines,PySpark,Microsoft Fabric
Good to Have Skill
Devops,CI/CD
Other Requirements

Skills Required

Pyspark SQL Data Transformation Data Quality Reconciliation Data Engineering Spark GIT Ci/cd Debugging Devops Spark and big data

Learn the skills this job asks for

See your skill gap for Software Developer →

Free courses, interview questions and practice for each skill.

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
HCLTech logo
HCLTech

Information Technology Services

New Delhi

RecommendedJobs for You

Matrix Comsec logo

Technical Lead

Matrix Comsec

Vadodara

Naythra Applications logo

Technical Lead

Naythra Applications

Bengaluru

National e-Governance Division logo

Technical Lead

National e-Governance Division

Delhi

P

Technical Lead

ParentPay Group

Pune