Data Engineer

Advance Career Solutions

5 - 8 years

15 - 18 Lacs

Hyderabad

Posted:3 months ago| Platform:

Apply

Skills Required

Airflow Pyspark Python

Work Mode

Hybrid

Job Type

Full Time

Job Description

Key Responsibilities Design, develop, and maintain scalable ETL pipelines using PySpark . Build and orchestrate data workflows using Apache Airflow . Develop reusable Python modules for data ingestion and transformation. Collaborate with data scientists and analysts to understand data needs and build robust solutions. Optimize Spark jobs for performance and cost-efficiency. Monitor and troubleshoot data pipeline failures and latency issues. Required Skills Strong hands-on experience in Python programming. In-depth knowledge of PySpark and big data processing. Proficiency in developing and scheduling DAGs in Apache Airflow . Experience working with SQL , data lakes , and data warehouses . Familiarity with Git , Linux , and CI/CD tools.

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Advance Career Solutions

Business Consulting and Services

Los Angeles

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Data Engineer