Paltech Consulting logo

Lead Data Engineer

Paltech Consulting

5 - 10 years

Hyderabad

Posted:15 hours ago

Apply

Job Description

ey Responsibilities

1. Architectural Strategy & Design

    • Architect and scale modern data solutions (ETL/ELT pipelines, data lakes, and data warehouses) across multiple major cloud platforms like

      Databricks, Snowflake, BigQuery,

      or

      Microsoft Fabric

      .
    • Define standard patterns for integrating operational application layers with analytical data systems seamlessly.

2. Hands-on Execution & Engineering Excellence

    • Maintain a hybrid approach by remaining hands-on with architecture blueprints, system design, prototyping, and high-impact code reviews.
    • Lead by example to champion clean code, robust CI/CD pipelines, containerization (Kubernetes/Docker), and reliable distributed systems.
    • Troubleshoot complex architectural bottlenecks across application and data layers.

3. AI & Intelligent Automation

    • Drive the production deployment of

      Agentic AI

      frameworks, autonomous workflows, and sophisticated prompt engineering protocols.
    • Architect robust Retrieval-Augmented Generation (RAG) pipelines that bridge enterprise application microservices with large-scale analytical data stores safely and securely.

4. Technical Leadership & Calibration

    • Mentor, guide, and upskill senior engineers, tech leads, and software architects.
    • Collaborate closely with Practice Owners and Business Leaders to align engineering capabilities with client demands and emerging technology trends.

Skills Required

SQL Data Microsoft Azure Data Engineering Azure Databricks Pyspark ETL

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Work Mode

Work from Office

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Paltech Consulting logo
Paltech Consulting

RecommendedJobs for You

Paltech Consulting logo

Lead Data Engineer

Paltech Consulting

Hyderabad

PFI Innovation Centre India logo

Lead Data Engineer

PFI Innovation Centre India

India

Qentelli logo

Hyderabad

Arup logo

Hyderabad

Navikenz India logo

Lead Data Engineer

Navikenz India

Noida, Bengaluru

MTI Integration Solutions Private Limited logo

Lead Data Engineer

MTI Integration Solutions Private Limited

Hyderabad

Eucloid Data Solutions logo

Lead Data Engineer

Eucloid Data Solutions

Chennai

Milestone Technologies logo

Lead Data Engineer

Milestone Technologies

Hyderabad

Epiroc logo

Bengaluru