UST logo

Senior Azure Databricks Architect / Data Engineer

5 - 9 years

0 Lacs

karnataka

Posted:1 day ago| Platform: Shine logo

Apply

Skills Required

apache spark acr networking python bash scripting data governance security cost optimization kafka communication skills azure databricks delta lake azure resource manager aks key vault microservices architecture container orchestration infrastructureascode iac devops pipelines eventdriven architectures event grid data mesh principles distributed data ownership crossteam collaboration problemsolving agile delivery

Work Mode

On-site

Job Type

Full Time

Job Description

As an Azure Data Engineer, your role involves architecting, configuring, and optimizing Databricks Pipelines for large-scale data processing within an Azure Data Lakehouse environment. Your key responsibilities include: - Architect, configure, and optimize Databricks Pipelines for large-scale data processing within an Azure Data Lakehouse environment - Set up and manage Azure infrastructure components including Databricks Workspaces, AKS/ACI, Storage Accounts, and Networking - Design and implement monitoring and observability frameworks using Azure Monitor, Log Analytics, Prometheus, and Grafana - Collaborate with platform and data engineering teams to enable microservices-based architectures for scalable data solutions - Drive automation and CI/CD practices using Terraform, ARM Templates, and GitHub Actions / Azure DevOps The qualifications and experience required for this role include: - Strong hands-on experience with Azure Databricks, Delta Lake, and Apache Spark - In-depth knowledge of Azure Resource Manager, AKS, ACR, Key Vault, and Networking - Proven experience with microservices architecture and container orchestration - Expertise in Infrastructure-as-Code (IaC), Python / Bash scripting, and DevOps pipelines - Familiarity with data governance, security, and cost optimization in cloud environments Bonus skills that would be advantageous for this role: - Experience with event-driven architectures (Kafka / Event Grid) - Understanding of data mesh principles and distributed data ownership In addition to technical skills, soft skills are also essential for this role: - Excellent communication and cross-team collaboration skills - Strong problem-solving mindset and ability to work in Agile delivery environments If you are ready to join immediately and possess the required skills and experience, please share your details via email at nitin.patil@ust.com for quick processing. Act fast for immediate attention!,

More Jobs at UST

Architect II - Technical SAP ABAP

Bengaluru

12 - 15 yrs
|

INR 0 - 0 Lacs

Lead I - SAP FICO with PS (Project Systems) and RAR

Bengaluru

5 - 7 yrs
|

INR 0 - 0 Lacs

Lead II - SAP ABAP

Bengaluru

7 - 9 yrs
|

INR 0 - 0 Lacs

Procurement

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

Manual & Python Automation

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
UST logo
UST

IT Services and IT Consulting

Aliso Viejo CA

RecommendedJobs for You

UST logo

Senior Azure Databricks Architect / Data Engineer

UST

karnataka

UST logo

Senior Azure Databricks Architect / Data Engineer

UST

karnataka