Posted:6 days ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Role Overview: As a PySpark ETL Lead, you will be responsible for driving the data integration efforts in analytics and data warehousing projects. Your role will involve developing and managing PySpark scripts, creating ETL workflows, and ensuring efficient data processing and integration across systems. Key Responsibilities: - Lead ETL development using PySpark - Design and schedule data workflows - Optimize data processing performance - Collaborate with cross-functional teams Qualifications Required: - Strong in PySpark and Python for ETL and data processing - Experience with ETL pipeline design, data integration, and data warehousing - Proficient in SQL and working with large datasets - Familiarity with workflow schedulers (Airflow, Cron, etc.) - Hands-on with Big Data tools (Hive, HDFS, Spark SQL) - Good to have: Experience with cloud platforms (AWS, Azure, GCP),

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

chennai, tamil nadu, india

Hyderabad, Telangana, India

Bhubaneswar, Odisha, India