Cloud Architect

0 years

0 Lacs

Posted:10 hours ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

hands-on Azure Data Platform Architect

platform-focused architect role

Azure, Databricks, IaC, and DevOps

Databricks platform setup, governance, automation, cost optimization, and best practices

Key Responsibilities

1. Databricks Platform Architecture

  • Set up and configure Databricks workspaces, clusters, schemas, RBAC, and security.
  • Define and enforce best practices:
  • Cluster policies
  • Workspace standards
  • Cost control
  • Job orchestration rules
  • Automate Databricks (clusters, jobs, configurations) using

    Terraform/Bicep

    .
  • Implement observability:
  • Failed job alerts
  • Cost and usage insights
  • Performance reporting

2. ADF onitoring & Automation

  • Review and assess pipeline quality (not develop pipelines).
  • Automate extraction of ADF metrics (failures, slow pipelines, cost insights).
  • Configure integration runtimes and automate ADF operations when required.

3. DevOps (CI/CD) Enablement

  • Implement CI/CD for Databricks and ADF using

    Azure Repos/GitHub + Azure DevOps

    .
  • Ensure controlled promotion from DEV → TEST → PROD.
  • Not responsible for full project management pipelines—only deployment pipelines.

4. Infrastructure-as-Code (IaC)

  • Use

    Terraform/Bicep

    to automate deployments of:
  • Data product resource groups
  • ADF
  • Key Vault
  • Databricks
  • Basic networking components (deep expertise not required)

5. Data Platform Governance (Long Term)

  • Help define platform policies and governance strategy:
  • Cataloging
  • Sensitivity labels
  • Data mesh / data product standards

6. Cost Optimization

  • Generate Databricks usage and billing reports.
  • Identify expensive or inefficient workloads.
  • Recommend cost optimization strategies.

Required Skills

  • Strong experience in

    Azure Databricks administration & platform design

    .
  • Hands-on experience with

    Terraform/Bicep

    for Databricks/Azure automation.
  • Good understanding of

    Azure DevOps or GitHub CI/CD

    .
  • Familiarity with Azure services (Key Vault, ADF, Storage, Functions, etc.).
  • Good scripting skills (Python/PowerShell).
  • Ability to design best practices, policies, automation, and cost optimization.

Nice-to-Have

  • Experience with data observability practices.
  • Exposure to data governance frameworks."

Mock Interview

Practice Video Interview with JobPe AI

Start DevOps Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
KPI Partners logo
KPI Partners

Business Consulting and Services

Newark CA

RecommendedJobs for You

pune, maharashtra, india

noida, uttar pradesh, india

chennai, tamil nadu, india

bengaluru, karnataka, india

mumbai, maharashtra, india