T

Lead Data Engineer

TECHBLOCKS

7 years

India

Posted:2 days ago

Job Description

Required Skills & Experience
    • 7+ years of experience in Data Engineering, Data Platform Development or related technical roles.
    • Strong hands-on experience with Databricks.
    • Strong programming experience in Python and PySpark.
    • Advanced SQL skills, including complex queries, joins, aggregations and data transformations.
    • Strong experience with Apache Spark and distributed data processing.
    • Hands-on experience designing and developing ETL/ELT pipelines.
    • Experience with REST APIs and API-based data integrations.
    • Working knowledge of Databricks Unity Catalog, including data governance, access management and metadata.
    • Understanding of Delta Lake and lakehouse architecture.
    • Hands on experience in Databricks AI Genie / or any Agentic AI framework.
    • Working knowledge of CI/CD practices and Git-based development workflows.
    • Experience designing governed data pipelines and maintaining enterprise data quality.
Preferred Skills
    • Hands-on experience integrating enterprise data with Planisware.
    • Experience with Databricks Genie and Databricks-based AI/BI capabilities.
    • Experience with LangGraph, LangChain, Semantic Kernel, CrewAI or similar agentic frameworks.
    • Experience building knowledge graphs using Neo4j or other graph technologies.
    • Experience with RAG, vector search and enterprise data retrieval patterns.
    • Experience implementing automated data quality and pipeline monitoring.
    • Exposure to enterprise project portfolio management (PPM), resource management or financial planning datasets.

Skills Required

Data Engineering Platform Development Python Pyspark SQL Apache Spark Data Processing ETL Rest Apis Data Governance Access Management Ci/cd

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
T
TECHBLOCKS

RecommendedJobs for You

Accord Infosystems logo

Lead Data Engineer

Accord Infosystems

Mumbai

Ecolab logo

Bengaluru

Aptean logo

Bengaluru

Hiringhood logo

Hyderabad

Echidna Software logo

Lead Data Engineer

Echidna Software

Bengaluru

Delta System & Software, Inc. logo

Lead Data Engineer

Delta System & Software, Inc.

Chennai

T

India

Neurealm logo

India