Senior Data Engineer

0 years

13 - 16 Lacs

Posted:6 hours ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

About The Opportunity

Opportunity in the Enterprise Cloud Data & Analytics sector, focused on building scalable, production-grade data platforms and analytics pipelines for high-volume business use-cases. The team operates across modern Azure data tooling to deliver reliable ETL, streaming, and analytics solutions that power reporting, ML, and operational systems.

Role Title:

Senior Data Engineer — Full-time | Pune, Maharashtra, IndiaRole & Responsibilities
  • Design, build and optimise scalable ETL/ELT data pipelines in Databricks using PySpark, Python and SQL for batch and near-real-time workloads.
  • Author and orchestrate data workflows using Azure Data Factory and Databricks jobs; manage scheduling, parameterisation and failure-recovery strategies.
  • Implement reliable data ingestion from diverse sources (Azure Storage, ADLS, HDFS, Kafka, REST APIs, databases) and ensure schema evolution handling.
  • Develop automated unit and integration tests, CI/CD pipelines and version-controlled deployments using Git and Azure DevOps to ensure production readiness.
  • Collaborate with data consumers, analysts and platform engineers to define data models, SLAs, monitoring and observability for pipelines.
  • Drive performance tuning, cost optimisation and data quality checks; triage pipeline incidents and implement long-term fixes and runbooks.

Skills & Qualifications

Must-Have
  • Databricks
  • PySpark
  • Python
  • SQL
  • Azure Data Factory
  • Azure Data Lake

Preferred

  • Kafka
  • REST APIs
  • Azure DevOps
Benefits & Culture Highlights
  • Fast-paced engineering culture with strong ownership, mentorship and opportunities to own end-to-end production systems.
  • Opportunity to work on cloud-native data platforms, observability and automation across the Azure ecosystem.
  • Hybrid work model in Pune with competitive compensation, learning budget and regular tech knowledge-sharing forums.

How to Stand Out:

Candidates who demonstrate hands-on production deployments of Databricks-based pipelines, strong PySpark optimisation experience and a track record of implementing CI/CD for data workloads will be prioritised.Skills: databricks,devops,snowflake,restapi,spark,pyspark,aws,dbt,python,azure,kafka,git,airflow,sql,ETL

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

pune, mumbai (all areas)