Databricks Architect

Position Name : Databricks Architect

Location : Pune

Experience : Min 12+ years

About Jade Global

Jade Global is a premier global IT services and solutions firm committed to helping clients drive business transformation through enterprise applications, AI/ML, cloud platforms, automation, and managed services. As a trusted partner for industry leaders across Hi-Tech, Healthcare, Manufacturing, and Financial Services, we bring deep domain knowledge, agility, and a relentless focus on client success.

About Position

Jade Global is seeking an experienced data engineering or cloud data architecture (including 2–3+ years on Databricks and data platform migration experience). We are looking for an experienced Databricks Architect to lead the design, implementation, and migration of enterprise data platforms to the Databricks Lakehouse Platform. This role involves architecting scalable data pipelines, modernizing legacy systems, and enabling advanced analytics and AI capabilities. The ideal candidate will have hands-on experience in migrating workloads from traditional data platforms (e.g., Hadoop, Teradata, Snowflake, on-prem systems) to Databricks on Azure/AWS/GCP.

Key Responsibilities:

• Architect and deliver end-to-end data & AI solutions on Databricks Lakehouse (Delta Lake, Spark, MLflow, Unity Catalog, etc.)
• Lead migration projects from on-premises or legacy platforms (e.g., Hadoop, Teradata, SQL Server, Snowflake, Cloudera) to Databricks on the cloud
• Design and implement scalable ETL/ELT pipelines using PySpark, SQL, Delta Lake, and Databricks WorkflowsOptimize data pipelines for cost, scalability, and performance
• Collaborate with infrastructure, security, and DevOps teams to establish cloud-native, production-grade Databricks environments
• Define and implement data governance and access control using tools like Unity Catalog or Azure Purview
• Partner with data scientists to operationalize ML workflows using MLflow, Feature Store, and Databricks Notebooks
• Apply best practices in CI/CD, testing, and automation for Databricks deployments
• Act as a technical advisor and lead for Databricks enablement and migration initiatives across the enterprise

Required Skills & Experience:

• 10+ years of experience in data engineering or cloud data architecture
• Minimum 2–3 years of hands-on experience with Databricks on Azure, AWS, or GCP
• Proven experience leading migration projects from:
• On-prem systems (Hadoop, Teradata, SQL Server, Oracle) or
• Cloud platforms (Snowflake, Redshift, Synapse) to Databricks
• Proficiency in Apache Spark / PySpark, SQL, and Delta Lake
• Deep understanding of data lakehouse architecture and data modeling
• Experience with cloud-native services (e.g., Azure Data Lake, AWS S3, Azure Data Factory, AWS Glue)
• Familiarity with CI/CD pipelines, Git-based version control, and Databricks Repos
• Strong knowledge of data governance frameworks and tools (Unity Catalog, Purview, Immuta)
• Excellent communication skills to interface with technical and business stakeholders

Preferred Qualifications

• Databricks Certified (Data Engineer, Data Architect, or Machine Learning Associate)
• Experience with MLflow, Feature Store, or building ML pipelines in Databricks
• Prior experience in consulting or client-facing roles
• Exposure to real-time data streaming (Kafka, Kinesis, Structured Streaming)

Why Jade Global?

• Award-winning enterprise partner (Oracle, Salesforce, ServiceNow, Boomi, and more)
• Diverse global culture with over 2,000 employees
• High-growth environment with opportunities for innovation and leadership
• Hybrid work flexibility and inclusive leadership culture