TECHNICAL LEAD - DATA

4 - 6 years

India

Posted:2 days ago

Job Description

SEI Hiring Manager - Anup Yadav

Data Engineer - dbt & Apache Airflow

Experience: 4-6 years | Employment Type: Full-time | Function: Data Engineering

Key Responsibilities

� Design and develop dbt pipelines and reusable transformation models using complex SQL queries.

� Build modular dbt models across staging, intermediate, and business layers using appropriate materializations such as views, tables, and incremental models.

� Apply dbt concepts including sources, ref(), tests, macros, snapshots, seeds, documentation, lineage, and environment-specific configuration.

� Create and maintain Apache Airflow DAGs to schedule, orchestrate, monitor, and troubleshoot dbt and data-processing workflows.

� Define clear task dependencies, retry behavior, scheduling, parameterization, logging, alerts, and failure-handling mechanisms in Airflow.

� Write efficient SQL using joins, CTEs, aggregations, window functions, subqueries, and data-quality validation logic.

� Analyze and optimize transformation queries for readability, performance, scalability, and maintainability.

� Use Python scripts for workflow utilities, validation, automation, file handling, database interaction, and operational support.

� Work with Oracle databases to understand schemas, tables, views, data types, constraints, query behavior, and connectivity requirements.

� Implement data-quality checks, unit tests, reconciliation controls, and pipeline validation before production deployment.

� Investigate pipeline failures, identify root causes, resolve data issues, and support re-runs or backfills without introducing inconsistencies.

� Participate in requirement analysis, technical design, code reviews, version control, deployment activities, and production support.

� Create and maintain technical documentation for models, DAGs, dependencies, operational procedures, and known limitations.

� Collaborate with data engineers, analysts, architects, QA teams, and business stakeholders to deliver dependable data products.

Required Skills and Qualifications

� 4-6 years of relevant experience in data engineering, analytics engineering, ETL/ELT development, or a comparable role.

� Strong hands-on experience with dbt development and a good understanding of dbt project structure, models, materializations, tests, macros, snapshots, documentation, and lineage.

� Strong SQL skills, including the ability to develop and troubleshoot complex transformation queries.

� Working knowledge of Apache Airflow, including DAG development, task dependencies, scheduling, retries, logging, monitoring, and operational troubleshooting.

� General understanding of Oracle Database concepts, SQL execution, schemas, database objects, and connectivity.

� Working knowledge of Python scripting for automation and data-processing tasks.

� Experience with Git or another version-control system and familiarity with collaborative development practices.

� Good analytical, debugging, problem-solving, documentation, and communication skills.

Preferred Qualifications

� Experience with incremental data processing, data warehousing concepts, dimensional modelling, and data lineage.

� Exposure to CI/CD practices for dbt and Airflow deployments.

� Experience with data-quality frameworks, monitoring, alerting, secrets management, and environment configuration.

� Familiarity with Agile delivery, peer reviews, release processes, and production support.

� Exposure to cloud data platforms or additional relational databases is an advantage.

Expected Technical Competencies

Competency

Expected Level

Practical Expectation


dbt

Strong

Develop models, tests, macros, documentation, and incremental transformations.


SQL

Strong

Write and optimize complex queries using joins, CTEs, aggregations, and window functions.


Apache Airflow

Intermediate

Develop and support DAGs with scheduling, dependencies, retries, logging, and alerts.


Oracle Database

General / Working

Understand schemas, objects, data types, query behavior, and connectivity.


Python

Working

Create scripts for automation, validation, utilities, and data-processing support.


Git / CI-CD

Working

Use branching, pull requests, reviews, and controlled deployment practices.


Success Measures

� Dbt models and Airflow workflows are delivered with clear structure, documentation, tests, and traceable dependencies.

� Transformation logic produces accurate results and meets agreed data-quality and performance expectations.

� Pipeline failures are diagnosed promptly, and recurring issues are reduced through durable fixes and monitoring.

� Code is readable, reusable, reviewable, and aligned with team engineering standards.

Education

� Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline, or equivalent practical experience..

Skills Required:

ETL,Apache Airflow,SQL

Location:

Greater Noida

Desirable Skills:

Python,ETL Development,Oracle Database

Designation:

TECHNICAL LEAD

Skills Required

Apache Data Engineering SQL Queries Data Processing SQL Data Quality Python Automation Operational Support Oracle Reconciliation Requirement Analysis

Learn the skills this job asks for

See your skill gap for Software Developer →

Free courses, interview questions and practice for each skill.

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Coforge logo
Coforge

Information Technology

Gurgaon

RecommendedJobs for You