Technical Lead - I Azure DataB

5 - 7 years

15 - 17 Lacs

Posted:1 day ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

As a Technical Lead Azure DataBricks you will be part of an agile team to build healthcare applications and implement new features while adhering to the best coding development standards.

Responsibilities: - Design and develop ETL/ELT solutions on Azure Databricks, Delta Lake, Spark, and PySpark Develop, implement, and deploy large scale data pipelines empowering machine learning algorithms, insights generation, business intelligence dashboards, reporting and new data products

Partner with Client Technology to create and maintain the technical architecture of the Enterprise Delta Lake to consolidate data from many systems into a single source for machine learning and reporting analytics Design, build, optimize, and manage modern large scale data pipelines (ETL/ELT processing) to support data integration for analytics, machine learning features, and predictive modeling

Consume data from a variety of sources (Live streaming from Kafka, Azure Event Hub, RDBMS, APIs, FTPs and other Cloud storage) and formats (Excel, CSV, XML, JSON, Parquet, Unstructured) Write advanced/complex SQL with performance tuning and optimization Identify ways to improve data reliability, data integrity, and system efficiency and quality Experience: - 5 - 7 YearsLocation: - Mumbai Pune Bangalore

Educational Qualifications: - Engineering Degree BE / ME / BTech / M Tech / B.Sc. / M.Sc. Technical certification in multiple technologies is desirable.

Skills: -Mandatory Technical Skills: - Should have minimum 2 years of working experience in Databricks Strong knowledge of data architecture principles such as Data Lake, Databricks Delta Lake, Data Warehousing, and more Must have minimum 2 years of working experience in Apache Spark (PySpark/Spark SQL) Should have minimum 2 years of working experience in Python

Must have minimum 3 years of working experience in SQL along with designing complex data schemas and query performance optimization Strong understanding of processing live data streaming from Azure Event Hub Must have working experience in at least one of the Cloud platforms, namely, Azure, AWS, or GCP

Strong understanding of Terraform, Kafka Should have working experience in CI/CD technology Must have working experience in Git Our commitmentTo combine the best of IT services, consulting, products, accelerators, and frameworks with a client-first mindset and next-gen tech understanding.

Mock Interview

Practice Video Interview with JobPe AI

Start Business Intelligence Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

noida, gurugram, delhi / ncr

pune, delhi / ncr, mumbai (all areas)