Databricks SME

**Need to be Databricks SME ***

Location - offshore ( Anywhere from India - Remote ) - Need to work in EST Time (US shift)

Need 12+ Years of experience.

5 Must Haves:

1. Data Expertise -- worked in Azure Data Bricks/Pipeline/ Shut Down Clusters--2 or more years' experience

2. Unity Catalog migration -- well versed--done tera form scripting in Dev Ops--coding & understand the code--understanding the logics of the behind the scenes--automate functionality

3. Tera Form Expertise -- code building --- 3 or more years

4. Understanding data mesh architecture -- decoupling applications -- ability to have things run in Parallel -- clear understanding -- 2 plus years of experience Microsoft Azure Cloud Platform

5. Great problem Solver

Key Responsibilities:

• Architect, configure, & optimize Databricks Pipelines for large-scale data processing within an Azure Data Lakehouse environment.
• Set up & manage Azure infrastructure components including Databricks Workspaces, Azure Containers (AKS/ACI), Storage Accounts, & Networking.
• Design & implement a monitoring & observability framework using tools like Azure Monitor, Log Analytics, & Prometheus / Grafana.
• Collaborate with platform & data engineering teams to enable microservices-based architecture for scalable & modular data solutions.
• Drive automation & CI / CD practices using Terraform, ARM templates, & GitHub Actions/Azure DevOps.

Required Skills & Experience:

• Strong hands - on experience with Azure Databricks, Delta Lake, & Apache Spark.
• Deep understanding of Azure services: Resource Manager, AKS, ACR, Key Vault, & Networking.
• Proven experience in microservices architecture & container orchestration.
• Expertise in infrastructure-as-code, scripting (Python, Bash), & DevOps tooling.
• Familiarity with data governance, security, & cost optimization in cloud environments.

Bonus:

• Experience with event - driven architectures (Kafka / Event Grid).
• Knowledge of data mesh principles & distributed data ownership.

Interview: Two rounds of interviews (1st with manager & 2nd with the team)

Job Type: Full-time

Pay: ₹3,400,000.00 - ₹4,500,000.00 per year

Schedule:

• US shift