Lead Data Engineer (AWS + Pyspark)

8 years

0 Lacs

Posted:3 weeks ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

About Us

Decision Point develops analytics and big data solutions for CPG, Retail, and Consumer-focused industries. We collaborate with global Fortune 500 clients to provide analytical insights and solutions that drive sales and marketing strategies.

Role Description

ETL Developer

Responsibilities

  • Design, develop, and maintain scalable ETL workflows using

    PySpark

    on

    AWS

    platforms (S3, Glue, EMR, Lambda, Redshift, etc.)
  • Gather, transform, and integrate data from multiple structured and unstructured sources
  • Ensure high performance, reliability, and scalability of data pipelines
  • Implement data validation, error handling, and quality checks
  • Collaborate with data engineers, analysts, and business stakeholders to understand requirements
  • Optimize ETL jobs for cost and performance in cloud environments
  • Prepare technical documentation and maintain data process standards

Must-Have Qualifications

  • 8+ years of hands-on experience as an

    ETL Developer

  • Strong programming skills in

    PySpark

    and

    Python

  • Solid experience with

    AWS services

    (S3, Glue, EMR, Lambda, Redshift, Athena, CloudWatch)
  • Proficiency in SQL and database concepts
  • Strong understanding of data modeling and ETL best practices
  • Excellent problem-solving and debugging skills


Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You