Posted:3 days ago| Platform: Linkedin logo

Apply

Skills Required

data pyspark sql etl aws unix hadoop optimization testing analytics technology stack design storage pipeline writing devops gitlab code governance orchestration apache airflow

Work Mode

On-site

Job Type

Full Time

Job Description

Job Title: Lead Data Engineer

Location: Pune, Gurgaon, Bangalore, Chennai

Primary Skills

Experience


  • Good Understanding of Cloud, Hadoop and DW concepts.
  • Hands on experience in Pyspark and strong knowledge on Dataframes, RDD and SparkSQL
  • Hands on experience in Pyspark performance optimization techniques.
  • Hands on Experience in developing, testing, and maintaining applications on AWS Cloud.
  • Strong hold on AWS Data Analytics Technology Stack (Glue, S3, Lambda, Lake formation, Athena, Event Bridge)
  • Design and implement scalable and efficient data transformation/storage solutions with open table formats such as DELTA, Iceberg, Hudi.
  • Experience in using DBT (Data Build Tool) with snowflake/Athena/Glue for ELT pipeline development.
  • Experience in Writing advanced SQL and PL SQL programs.
  • Hands On Experience for building reusable components using Snowflake and AWS Tools/Technology
  • DevOps & CI/CD for Data – Experience using GitLab Actions or similar tools for version control, CI/CD, and infrastructure-as-code for data pipelines.


Good to Have

  • Exposure to data governance or lineage tools such as Immuta and Alation is added advantage.
  • Experience in using Orchestration tools such as Apache Airflow or Snowflake Tasks is added advantage.
  • Knowledge on Ab-initio ETL tool is a plus

More Jobs at Stackave Solutions

Full Stack Engineer - Java

Gurugram, Haryana, India

Experience: Not specified

|

Salary: Not disclosed

Java Software Engineer- Spring Boot, Spring  batch experience

Gurugram, Haryana, India

4.0 - 7.0 yrs
|

Salary: Not disclosed

Java Developer

Delhi, India

4.0 - 8.0 yrs
|

Salary: Not disclosed

Enterprise Architect - Capital Markets

haryana

18.0 - 22.0 yrs
|

Salary: Not disclosed

Full Stack Engineer - Java

Gurugram, Haryana, India

Experience: Not specified

|

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Stackave Solutions logo
Stackave Solutions

RecommendedJobs for You

Option Us logo

Data Engineer

Option Us

pune

Winjit Technologies logo

Data Engineer

Winjit Technologies

bengaluru

Data Engineer

MEEDEN LABS PRIVATE LIMITED

bangalore

RCG Global Services logo

Data Engineer

RCG Global Services

chennai

Revolite Infotech Pvt. Ltd logo

Data Engineer

Revolite Infotech Pvt. Ltd

chennai

Priceline.com logo

Data Engineer

Priceline.com

mumbai

PwC India logo

Data Engineer

PwC India

bengaluru, karnataka, india

Nurturing Nexis Hr Consulting Llp logo

Data Engineer

Nurturing Nexis Hr Consulting Llp

pune, bengaluru

Data Engineer

INNOVANT.AI

bengaluru, karnataka, india

Bridgenext logo

Data Engineer

Bridgenext

pune, maharashtra