Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in greater kolkata area
>
Strategic HR Solutions
>
Azure Databricks Engineer - ETL Pipeline

Azure Databricks Engineer - ETL Pipeline

Strategic HR Solutions

0 years

0 Lacs

greater kolkata area

Posted:1 month ago| Platform:

Apply

Skills Required

azure databricks etl pipeline timing data adf pyspark sql vault git jenkins devops design engineering analytics tuning processing strategy storage service deployment configuration versioning consistency governance cataloging workflow code planning support debugging

Work Mode

On-site

Job Type

Full Time

Job Description

Description

Work Mode : HybridWork Timing : 12:00 noon 9:00 PMLocation : PAN India Office (Except Gurgaon, Coimbatore, Kolkata, Vijayawada)Notice Period : Immediate or Serving NP (= < 21 Days)

Primary Skills

Azure Data Factory (ADF), Azure Databricks, Pyspark, SQL ADLS, ADB, Azure Services / Key Vault, Git / Jenkins / Azure Devops, CICD.We are seeking an experienced

Azure Databricks Engineer to design, build, and optimize data engineering pipelines and analytics solutions on Microsoft Azure.

We are seeking an experienced Azure Databricks Engineer to design, build, and optimize data engineering pipelines and analytics solutions on Microsoft Azure.The ideal candidate will have strong hands-on skills in Azure Data Factory (ADF), Azure Databricks, PySpark, SQL, ADLS, and experience with Azure DevOps /Git / CI-CD, along with various Azure cloud services.

Key Responsibilities

Design, build, and maintain large-scale data ingestion, transformation, and ETL pipelines using ADF and Azure Databricks.
Develop high-performance PySpark scripts & notebooks for data processing.
Optimize cluster usage, performance tuning, parallel processing, and caching strategy in Databricks.
Implement data workflows using Delta Lake, structured streaming, and batch processing.
Utilize Azure Data Lake Storage (ADLS) for structured/semi-structured data storage.

Integrate Pipelines Across Azure Services Such As

Azure Key Vault
Azure Event Hub
Azure Service Principal-based authentication
Azure SQL / Synapse Analytics
Manage deployment, configuration, and versioning of Databricks notebooks and jobs.
Ensure data accuracy, validation, and consistency across ETL pipelines.
Implement best practices for data governance, cataloging, lineage, and security.
Work with stakeholders to understand business rules and convert them into ETL logic.
Use Git, Jenkins, or Azure DevOps for version control and CI/CD workflow automation.
Build automated deployment pipelines for Databricks notebooks, clusters, and ADF components.
Manage release cycles, code branching, tagging, and environment management.
Work closely with data architects, analysts, BI teams, and business leads to deliver end-to-end cloud data solutions.
Participate in design sessions, code reviews, sprint planning, and requirement analysis.
Provide support for production pipelines and debugging issues in real-time.

Education

Bachelors or Masters degree in Computer Science, IT, Data Engineering, or a related field.

(ref:hirist.tech)

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

Strategic HR Solutions

RecommendedJobs for You

Azure Databricks Engineer - ETL Pipeline

Strategic HR Solutions

greater kolkata area

Azure Databricks Engineer - ETL Pipeline

Strategic HR Solutions

greater kolkata area

Login to

Please Verify Your Phone or Email

Confirm Action

Azure Databricks Engineer - ETL Pipeline