D

Python / Databricks Engineer

Duxxel

12 Lacs

Chennai

Posted:5 days ago

Job Description

  • Design Python-based Databricks pipelines for ingestion, transformation, enrichment, validation and publication of DER/VPP data.
  • Build scalable batch and near-real-time workloads using Spark, Delta Lake, notebooks, jobs and workflows.
  • Implement data-quality, reconciliation, lineage, auditability and observability controls.
  • Optimise partitioning, throughput, query performance, reliability, maintainability and cloud cost.
  • Support feature engineering and productionisation of telemetry, dispatch and platform analytics.
  • Deliver Python packages, tests, validation checks, workflow definitions and dashboard-ready datasets.

Must have skills:

Python; Databricks; PySpark/Apache Spark; Delta Lake; SQL; ETL/ELT; batch and streaming pipelines; data quality; lineage; performance tuning; Azure; Git/CI/CD; PostgreSQL

Pay: From ₹1,200,000.00 per year

Work Location: Hybrid remote in Chennai, Tamil Nadu

Skills Required

Python Spark Data Quality Reconciliation Analytics Pyspark Apache Spark SQL ETL Performance Tuning Azure GIT

Job Type

Contractual

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
D
Duxxel

RecommendedJobs for You