Lead Data Engineer/ Architect- TOP MNC

Visioncraft Consulting

8 - 13 years

25 - 35 Lacs

pune bengaluru delhi / ncr

Posted:1 month ago| Platform:

Apply

Skills Required

pyspark glue data warehousing etl aws unix dw concept data engineering architecture modeling sql pipeline design data pipeline architecting data modeling

Work Mode

Hybrid

Job Type

Full Time

Job Description

Company- TOP MNC

Location- Chennai, Delhi NCR, Pune, Bangalore

Notice Period- 0- 60 Days

Pyspark, SQL, ETL, AWS,Glue, Unix, DW concept

Good Understanding of Cloud, Hadoop and DW concepts.

Exposure to data governance or lineage tools such as Immuta and Alation is added advantage.
Hands on experience in Pyspark and strong knowledge on Dataframes, RDD and SparkSQL
Experience in using Orchestration tools such as Apache Airflow or Snowflake Tasks is added advantage.
Hands on experience in Pyspark performance optimization techniques.
Knowledge on Ab-initio ETL tool is a plus
Hands on Experience in developing, testing, and maintaining applications on AWS Cloud.
Strong hold on AWS Data Analytics Technology Stack (Glue, S3, Lambda, Lake formation, Athena, Event Bridge)
Design and implement scalable and efficient data transformation/storage solutions with open table formats such as DELTA, Iceberg, Hudi.
Experience in using DBT (Data Build Tool) with snowflake/Athena/Glue for ELT pipeline development.
Experience in Writing advanced SQL and PL SQL programs.
Hands On Experience for building reusable components using Snowflake and AWS Tools/Technology

DevOps & CI/CD for Data Experience using GitLab Actions or similar tools for version control, CI/CD, and infrastructure-as-code for data pipelines

More Jobs at Visioncraft Consulting

Hiring Intern For IT Technical Recruitment - Only Female -Remote

gurugram

Experience: Not specified

Salary: Not disclosed

Data Scientist / US based Analytics Firm, Noida / WFO

noida, greater noida, delhi / ncr

4.0 - 9.0 yrs

INR 25 - 40 Lacs

Lead Data Engineer/ Architect- TOP MNC

pune, bengaluru, delhi / ncr

8.0 - 13.0 yrs

INR 25 - 35 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.