Data Architect

Prodapt Solutions

8 - 12 years

9 - 14 Lacs

chennai

Posted:8 hours ago| Platform:

Apply

Skills Required

data architect snowflake python data engineer ai databricks data warehousing sql data quality iam spark gcp compliance devops kafka data governance terraform aws etl infrastructure as code cloudformation architecture azure

Work Mode

Work from Office

Job Type

Full Time

Job Description

Overview

Role Overview

We are looking for a seasoned Data Architect with strong expertise in Databricks to lead the design, development, and optimization of scalable data platforms and analytics solutions. The role involves defining end-to-end data architecture, building cloud-native data pipelines, and enabling advanced analytics and AI workloads for enterprise environments.

Key Responsibilities

Define enterprise data architecture, including data ingestion, transformation, storage, governance, and consumption layers.
Lead the design and implementation of Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and optimized ETL/ELT pipelines.
Develop scalable data models, metadata frameworks, and integration patterns across structured and unstructured datasets.
Collaborate with data engineering, analytics, ML, and business teams to understand data needs and translate them into architectural solutions.
Define best practices for data quality, lineage, cataloging, security, and lifecycle management.
Drive cloud-based data modernization using Azure/AWS/GCP + Databricks.
Establish data platform governance, including RBAC, data privacy, and compliance controls.
Optimize data performance, storage costs, pipeline reliability, and cluster usage.
Review and guide implementation of notebooks, workflows, Delta Live Tables, and ML/AI workloads.
Create architecture artifacts including HLDs, LLDs, technology standards, and integration patterns.
Provide thought leadership on data strategy, migration paths, and adoption of Databricks features.

Required Skills & Experience

8-12+ years of experience in data engineering/architecture, with at least 35+ years of hands-on Databricks experience.
Strong knowledge of Databricks Lakehouse, Delta Lake, Unity Catalog, Workflows, Model Serving, and cluster management.
Expertise in Python, SQL, PySpark/Spark, and distributed data processing.
Experience designing cloud-native data platforms on Azure/AWS/GCP.
Strong understanding of ETL/ELT frameworks, streaming data (Kafka/Kinesis/Event Hubs), and data integration patterns.
Proven experience driving enterprise data platform migrations or modernization programs.
Solid understanding of data modeling (3NF, Star/Snowflake), data warehousing, and performance tuning.
Knowledge of security frameworks, IAM, encryption, GDPR/PII handling, and data governance practices.
Experience with CI/CD for data, Infrastructure as Code (Terraform/ARM/CloudFormation), and DevOps for data pipelines.
Excellent communication and stakeholder-management skills.

Preferred Qualifications

Databricks certifications (Data Engineer Professional, Lakehouse Architect).
Experience with MLflow, feature stores, and model deployment in Databricks.
Background in enterprise analytics, BI platforms, data mesh, or data product architecture.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Prodapt Solutions

Software Development

Chennai Tamilnadu

Login to

Please Verify Your Phone or Email

Confirm Action

Data Architect