Databricks Architect

10 - 16 years

Bengaluru

Posted:2 weeks ago

Apply

Job Description

About Position:

Were looking for an Database Architect to drive the strategy and implementation of a centralized mapping data factory using Databricks as the transformation engine, enabling self-service, governed, and high-fidelity data products across the organization.

  • Role: Databricks Architect

  • Location: Bangalore

  • Experience:10+years

  • Job Type: Full Time Employment

What You'll Do:

  • Define and own the Mapping Data Factory” vision: reusable transformation components, mapping DSLs or templates, metadata-driven execution.
  • Build a scalable platform where business-defined mappings can be parameterized and executed in Databricks with minimal engineering friction.
  • Integrate with upstream ingestion systems and downstream consumers, ensuring consistent mapping definitions, versioning, and lineage.
  • Lead cross-domain initiatives to standardize data definitions, mapping conventions, and transformation quality guards.
  • Architect metadata-driven orchestration, enabling dynamic mapping execution based on configurations.
  • Embed observability, data contracts enforcement, and self-healing mechanisms into the factory.
  • Collaborate with platform SRE/security to ensure secure and resilient deployments.
  • Evangelize best practices and evolve the platform based on usage metrics and feedback.

Expertise You'll Bring:

  • 8+years in data engineering/platform roles with substantial experience building data transformation platforms.
  • Deep mastery of Python, Databricks, Spark, Delta Lake, and metadata-driven data pipelines.
  • Experience in building or scaling “mapping factories” or transformation engines (e.g., templated ETL/ELT layers).
  • Strong system design, distributed computing, and API/integration design skills.
  • Track record of building platforms that balance flexibility (self-service) and governance.
  • Experience with domain-driven data architecture, data mesh concepts, or similar paradigms.
  • Published internal tooling or frameworks for data mapping/transformations.

Benefits:

  • Competitive salary and benefits package
  • Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
  • Opportunity to work with cutting-edge technologies
  • Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
  • Annual health check-ups
  • Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

  • We support hybrid work and flexible hours to fit diverse lifestyles.
  • Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
  • If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let's unleash your full potential at Persistent - persistent.com/careers

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."

Skills Required

databricks pyspark architect etl python

Work Mode

Work from Office

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now
coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Persistent logo
Persistent

IT Services and IT Consulting

Pune Maharashtra

RecommendedJobs for You

Kolkata, Chennai, Mumbai (all areas)