AWS/Databricks Lead

5 - 10 years

Mumbai

Posted:6 days ago

Job Description

Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients’ most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With nearly 245,000 employees and business partners across 65 countries, we deliver on the promise of helping our clients, colleagues, and communities thrive in an ever-changing world. Wipro is an Equal Employment Opportunity employer and makes all employment and employment-related decisions without regard to a person's race, sex, national origin, ancestry, disability, sexual orientation, or any other status protected by applicable law.

 

Website

http://www.wipro.com

Job Description

Expereince: 8 to 12 Years

Role Summary:

The primary responsibility of this role is to implement and manage comprehensive observability and monitoring for Databricks and Apache Spark workloads. The objective is to ensure high platform reliability, optimal performance, and transparent cost tracking.

Key Responsibilities:-

Continuously monitor Spark jobs, clusters, SQL warehouses, and data pipelines to identify performance issues, failures, or breaches of service level agreements (SLAs).- Develop intuitive dashboards and automated alerts by leveraging Databricks system tables, including those for jobs, clusters, billing, audits, and query history.- Proactively address operational challenges through troubleshooting, root cause analysis, and performance tuning of Spark workloads.- Facilitate cost, usage, and capacity transparency across Databricks environments, empowering teams to optimise resource allocation.- Seamlessly integrate Databricks monitoring capabilities with enterprise-grade tools such as Azure Monitor, Log Analytics, or similar platforms.

Required Skills:-

Demonstrated, hands-on expertise in working with Databricks and Apache Spark for both batch and streaming processes.- In-depth understanding of Databricks system tables, job orchestration, cluster management, and workflow automation.- Experience with data and platform observability frameworks, as well as advanced alerting and monitoring solutions.- Proficiency in SQL, PySpark, and dashboard creation to deliver actionable operational insights.

 

Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.

Demonstrated, hands-on expertise in working with Databricks and Apache Spark for both batch and streaming processes.- In-depth understanding of Databricks system tables, job orchestration, cluster management, and workflow automation.- Experience with data and platform observability frameworks, as well as advanced alerting and monitoring solutions.- Proficiency in SQL, PySpark, and dashboard creation to deliver actionable operational insights.

Skills Required

Cloud AWS Administration Microsoft Azure Cloud Azure

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Work Mode

Work from Office

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Wipro logo
Wipro

Information Technology & Services

Bengaluru

RecommendedJobs for You