Python Data Engineer

Python Data Engineer

Job Highlights

• Experience:

  3 8 Years

• CTC:

  Open (Up to 40 LPA)

• Location:

  Pune / Remote

• Employment Type:

  Full-Time

Python-centric Data Engineer

Roles & Responsibilities

• Design, develop, and optimize data ingestion and transformation pipelines using Python
  
• Apply object-oriented design principles to create modular, reusable, and maintainable data components
  
• Work with distributed data processing systems such as

  Hadoop and Spark

• Build and enforce data quality, validation, and testing frameworks
  
• Collaborate with analysts, data scientists, and product teams to ensure reliable data availability
  
• Participate in code reviews, CI/CD pipelines, and automation workflows
  
• Contribute to data architecture evolution and integration with cloud-based ecosystems
  

Technical Skills

Core Expertise

Python Programming

• Strong object-oriented programming skills and design patterns
  
• Experience with

  pandas, PySpark, dask

  , or custom ETL frameworks
• Writing unit-tested, scalable, and well-documented code (

  pytest, unittest

  )

Data Engineering

• Hands-on experience building and maintaining

  ETL / ELT pipelines

• Exposure to

  Hadoop / Spark

  for distributed data processing
• Strong SQL skills; experience with databases like

  PostgreSQL, Redshift

• Familiarity with

  CI/CD tools

  (Jenkins, GitHub Actions)
• Exposure to

  Infrastructure as Code

  (Terraform)
• Basic knowledge of

  AWS data services

  (S3, Lambda, Step Functions, Glue, DynamoDB)

Qualifications

• Bachelors or Masters degree in Engineering, Technology, or related field
  
• 3 – 8 years of experience in data engineering or backend development
  
• Strong foundation in data modeling, pipeline orchestration, and data quality
  
• Proven experience in Python-based data pipeline development
  
• Excellent problem-solving and communication skills
  

Good to Have

• Experience with

  Apache Airflow, Luigi, or Prefect

• Exposure to

  real-time streaming platforms

  (Kafka, Kinesis)

Industry Type

IT Services & Consulting

Department

Engineering – Data & Analytics

Role Category

Data Engineering

Key Skills (Naukri Search Tags)

Python, Data Engineer, PySpark, Pandas, Hadoop, Spark, ETL, ELT, SQL, AWS, Airflow, CI/CD, Terraform, Big Data

Mail : hr6@venpastaffing.com