Accord Infosystems logo

Lead Data Engineer

Accord Infosystems

15 - 20 years

37 - 55 Lacs

Mumbai

Posted:4 hours ago

Job Description

Role & responsibilities

Key Responsibilities:-

1. Enterprise Data Modeling & Architecture

  • Lead the design and implementation of enterprise-wide Fact and Dimensional Models across multiple business domains.
  • Establish a Single Version of Truth through standardized data definitions, conformed dimensions and consistent data grains.
  • Drive enterprise data modeling using Kimball methodology, Star Schema, Snowflake Schema and Data Vault 2.0.
  • Build scalable semantic layers and reusable domain-oriented data products.

2. Databricks Lakehouse Engineering

  • Design and maintain scalable ETL/ELT pipelines using Databricks, Apache Spark and PySpark.
  • Implement Delta Lake, Delta Live Tables (DLT) and Databricks Workflows.
  • Drive data processing from raw ingestion through curated and business-ready data layers.
  • Optimize large-scale Spark jobs handling billions of records.

3. Data Governance & Security

  • Implement data governance, access controls and end-to-end data lineage using Unity Catalog.
  • Ensure data quality, consistency, security and regulatory compliance.
  • Establish enterprise data standards and reusable engineering frameworks.

4. AI Integration & Automation

  • Drive AI-enabled engineering practices and automation across the data engineering lifecycle.
  • Explore and implement Agentic Engineering capabilities to improve productivity and operational efficiency.
  • Build AI-ready data platforms supporting advanced analytics and intelligent applications.

5. Business & Stakeholder Collaboration

  • Work closely with business and technology leaders across Retail, Corporate, Risk and Wealth Management.
  • Translate business requirements into scalable enterprise data architecture and data products.
  • Provide technical direction and mentor engineering teams.

Technical Skills & Expertise

  • Databricks:

    Delta Lake, Unity Catalog, Delta Live Tables (DLT), Databricks Workflows.
  • Big Data:

    Apache Spark, PySpark and Python.
  • Data Modeling:

    Kimball Methodology, Fact & Dimensional Modeling, Star Schema, Snowflake Schema, Data Vault 2.0.
  • Data Warehousing:

    Enterprise Data Warehouse, Semantic Layer, Conformed Dimensions and SCD Type 1/2/3.
  • Cloud Platforms:

    Azure (ADLS Gen2, Synapse) or AWS (S3, EMR).
  • Engineering Practices:

    CI/CD, DataOps, Data Quality and Data Observability.
  • Governance:

    Unity Catalog, Data Lineage and Fine-Grained Access Controls.
  • AI & Automation:

    AI-enabled Data Engineering and Agentic Engineering.

Candidate Requirements:

  • BE / BTech in Computer Science, Information Technology or a relevant engineering discipline.
  • 1520 years of overall experience in Data Engineering and Data Architecture.
  • Minimum 5 years of experience in senior technical leadership / architecture roles.
  • Strong experience working with Banking / Financial Services institutions.
  • Proven experience designing enterprise-scale data platforms and dimensional data models.
  • Strong hands-on expertise in Databricks, Spark, PySpark and Python.
  • Experience leading large-scale data engineering initiatives and cross-functional teams.

Skills Required

Data warehousing SQL Azure Data Warehouse Star Modeling Snowflake Microsoft Azure Warehouse

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Work Mode

Work from Office

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Accord Infosystems logo
Accord Infosystems

RecommendedJobs for You

Accord Infosystems logo

Lead Data Engineer

Accord Infosystems

Mumbai

Ecolab logo

Bengaluru

Aptean logo

Bengaluru

Hiringhood logo

Hyderabad

Echidna Software logo

Lead Data Engineer

Echidna Software

Bengaluru

Delta System & Software, Inc. logo

Lead Data Engineer

Delta System & Software, Inc.

Chennai

T

India

Neurealm logo

India