5 - 10 years

1 Lacs

Posted:1 day ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

Role Overview
We are seeking a highly skilled Data Engineer with deep hands-on expertise in SQL andPySpark, strong fundamentals in data architecture, and proven experience in buildingscalable ETL pipelines. You will be responsible for designing, developing, optimizing,and managing data workflows that ensure high-quality, reliable, and accessible data foranalytics and reporting.

Key Responsibilities
* Design, implement, and maintain scalable, production-grade ETL pipelinesusing PySpark and SQL.* Develop robust data integration processes ensuring data accuracy,consistency, and timeliness.* Perform advanced SQL queries, data profiling, and root-cause analysis fordata quality issues.* Optimize data pipelines for performance, cost efficiency, and scalability indistributed systems.* Implement strong data security, governance, and access control measures perregulatory standards.* Monitor and troubleshoot pipeline issues with a focus on quick resolution andminimal downtime.

* Work closely with DevOps to deploy and manage data engineering workloads in a
cloud environment.* Prepare and maintain comprehensive documentation, including data flowdiagrams and technical specs.* Stay updated with evolving tools, frameworks, and best practices in the dataengineering ecosystem.

Qualifications
* Bachelor's or Master's degree in Computer Science, Information Technology, or arelated field.* Strong hands-on programming experience in Python (PySpark) and advancedSQL.

* Proven experience designing and developing end-to-end data pipelines in real-
world environments.

* Strong background in ETL frameworks (e.g., Apache Spark, Flink, Airflow).
* Experience with cloud platforms: AWS / Azure / GCP.* Good understanding of data warehousing, dimensional modeling, anddistributed computing.* Ability to work with large-scale datasets and optimize data transformations.* Strong analytical, debugging, and problem-solving skills.* Excellent communication and collaboration abilities.* Ability to thrive in an agile, fast-paced, delivery-focused environment.

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

hubli, mangaluru, mysuru, bengaluru, belgaum