Senior Databricks Data Architect

Databricks Data Architect

Location: Mumbai Onsite

Salary: Negotiable

Immediate Joiners

Experience: 10+ Years

Databricks

Key Responsibilities:

·       Architect and deliver scalable, cloud-native data solutions to support both real-time and batch processing needs.

·       Work closely with business and technical stakeholders to understand business requirements, define data strategy, governance, and architecture standards.

·       Ensure data quality, integrity, and security across platforms and systems.

·       Define data models, data integration patterns, and governance frameworks to support analytics use cases.

·       Collaborate with DevOps and Engineering teams to ensure robust CI/CD pipelines and deliver production-grade deployments.

·       Define and enforce data architecture standards, frameworks, and best practices across data engineering and analytics teams.

·       Implement data governance, security, and compliance measures, including data cataloguing, access controls, and regulatory adherence.

·       Lead capacity planning and performance tuning efforts to optimize data processing and query performance.

·       Create and maintain architecture documentation, including data flow diagrams, data models, entity-relationship diagrams, system interfaces etc.

·       Design clear and impactful visualizations to support key analytical objectives.

Required Skills and Experience:

·       Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.

·       Strong proficiency in Azure Databricks and big data technologies (Apache Spark, Kafka, Event Hub).

·       Deep understanding of data modeling, data lakes, batch and real-time/streaming data processing.

·       Proven experience with high volume data pipeline orchestration and ETL/ELT workflows.

·       Experience designing and implementing data lakes, data warehouses, and lakehouse architectures.

·       Proven experience in designing and implementing data visualization solutions for actionable insights.

·       Strong understanding of data integration patterns, APIs, and message streaming (e.g., Event Hub, Kafka).

·       Experience with metadata management, and data quality frameworks.

·       Excellent problem-solving skills and the ability to translate business needs into technical solutions.

·       Experience with structured and unstructured data ingestion, transformation, and processing at scale.

·       Excellent communication, documentation, and stakeholder management skills.

Preferred Qualifications:

·       Familiarity with lakehouse architectures using Delta Lake.

·       Knowledge of manufacturing/energy domain-specific standards and protocols.

·       Experience with IoT data and time-series analysis.

·       Knowledge of data governance, security, and compliance best practices.