Databricks Data Architect

11 years

0 Lacs

Posted:1 week ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Contractual

Job Description

About us:

At Xenon7, we work with leading enterprises and innovative startups on exciting, cuttingedge projects that leverage the latest technologies across various domains of IT includingData, Web, Infrastructure, AI, and many others. Our expertise in IT solutions developmentand on-demand resources allows us to partner with clients on transformative initiatives,driving innovation and business growth. Whether it's empowering global organizations orcollaborating with trailblazing startups, we are committed to delivering advanced,impactful solutions that meet today's most complex challenges.

About the Client:

Join one of the Fortune 500 leaders in the pharmaceutical industry that is lookinginnovate and expand our technological capabilities. The person would join a product teamworking on their self-service company-wide platform that enables all the teams andbusiness units to deploy their AI solutions, making them accessible across the entirecompany.

Role Overview:

We are seeking a Data Architect to lead the architectural design and strategy for a largescale lakehouse migration. This role involves defining the technical roadmap, datagovernance, and best practices for leveraging Databricks and cloud-native tooling. Youwill play a key role in shaping the future data platform, ensuring scalability, security, andperformance across data domains.

Responsibilities:

  • Design end-to-end architecture for the lakehouse migration, aligning with business and technical goals
  • Establish data governance frameworks using Unity Catalog and support lineage, access, and compliance
  • Guide engineering teams on scalable data modeling and processing strategies using PySpark and SQL
  • Define standards for workflow orchestration, code quality, and CI/CD using Git-based tools
  • Evaluate and optimize system architecture for performance, cost, and maintainability
  • Collaborate with cloud architects and platform teams to integrate with AWS/Azure services as needed
  • Document architectural decisions, patterns, and migration plans

Requirements

  • Bachelor's or Master's degree in Computer Science, Data Science, or a related field
  • 11+ years of experience in data architecture or senior data engineering roles
  • Proven expertise in Databricks platform, especially Unity Catalog, workflows, and notebooks
  • Deep understanding of lakehouse architecture concepts and implementation
  • Strong hands-on experience with PySpark, Python, and SQL
  • Familiarity with Git (Bitbucket or GitHub) and CI/CD processes
  • Excellent communication and stakeholder management skills
  • Availability to start within 2 weeks

Nice to Have:

  • Experience with Snowflake or other modern data platforms
  • Cloud architecture knowledge in AWS or Azure
  • Exposure to Jenkins or other orchestration/automation frameworks

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You