Data Engineer

Viraaj HR Solutions Private Limited

3 years

15 - 25 Lacs

indore madhya pradesh india

Posted:4 days ago| Platform:

Apply

Skills Required

data technology etl analytics ml design pyspark sql apache airflow scheduling monitoring storage redshift query contracts checks testing pipeline aws collaborative engineering automation code compensation engagement hadoop spark kafka python azure

Work Mode

On-site

Job Type

Full Time

Job Description

Primary Title: Data Engineer

About The Opportunity

A specialist talent and HR solutions firm serving enterprise technology, fintech, and retail clients is hiring an on-site Data Engineer in India. This role sits within high-growth data platform programs focused on building scalable, reliable ETL pipelines and analytics-ready data sets for business stakeholders and downstream ML consumers.Role & Responsibilities

Design, build and operate robust ETL/ELT data pipelines to ingest, transform and deliver large-scale datasets for analytics and ML.
Author PySpark jobs and SQL-based transformations to implement reusable, performant data models and tables.
Orchestrate workflows using Apache Airflow; implement scheduling, retries, and monitoring for production jobs.
Work with cloud storage and warehousing solutions (S3, Redshift) to optimise cost, partitioning and query performance.
Collaborate with data consumers and engineers to define schemas, data contracts, and data quality checks; implement automated testing and observability.
Troubleshoot production incidents, tune pipeline performance, and implement CI/CD for data workloads.

Skills & Qualifications

Must-Have (skills)

Python
PySpark
SQL
Apache Airflow
AWS S3
ETL pipelines

Preferred (skills)

AWS Redshift
Apache Kafka
dbt

Additional Qualifications

3+ years of hands-on experience building production data pipelines and data models in cloud environments.
Proven track record working on on-site, collaborative engineering teams in India; strong ownership of production systems.
Familiarity with CI/CD for data engineering, automated testing, and data observability practices.

Benefits & Culture Highlights

Work on enterprise-level data platform projects with clear ownership and growth pathways.
Collaborative engineering culture with emphasis on automation, code reviews and operational excellence.
Competitive compensation aligned to market and opportunities for technical skill development.

Location: On-site in India. Candidates must be available for full-time on-site engagement. To apply, please submit a resume highlighting pipeline projects, code samples or links to relevant repositories and a short note on your role in delivered data solutions.
Skills: aws,hadoop,big data,dbt,sql,spark,apache kafka,python,azure,etl

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Viraaj HR Solutions Private Limited

Login to

Please Verify Your Phone or Email

Confirm Action

Data Engineer