Jobs
Interviews
ITC Infotech logo

Senior Data Engineer(Lead)

6 years

0 Lacs

mumbai maharashtra india

Posted:2 weeks ago| Platform: Linkedin logo

Apply

Skills Required

data engineering design etl apache spark pyspark scala aws azure support analytics reporting ml orchestration monitoring pipeline maintenance logic resolve analysis adf

Work Mode

On-site

Job Type

Full Time

Job Description

Responsibilities



  • Around 6+ years of experience in data engineering or cloud computing data development
  • Design, develop, and optimize ETL/ELT data pipelines using Apache Spark (PySpark or Scala), AWS Glue, and Azure Data Factory
  • Work with structured and unstructured data to build scalable ingestion and transformation workflows across cloud platforms.
  • Build data lake and data warehouse solutions using

    AWS S3, Azure Data Lake,AWS Glue

  • Collaborate with data scientists, analysts, and application developers to support advanced analytics, reporting, and ML workflows
  • Implement job orchestration, monitoring, and error handling for reliable pipeline execution.
  • Maintenance and support of Data Pipeline.
  • Data load monitoring
  • Data Validation and quality checks
  • Identify and optimize ingestion pipelines in consultation with Customer
  • Data: L2/L3 Support
  • Investigate Glue job failures and restart
  • Fix minor transformation logic or input data issues
  • Resolve dependency failures in Glue workflows
  • Tune job configurations
  • Impact Analysis and RCA
  • 8x5 support model


Qualifications



Education details


BTECH, BCA, MTECH,MCA,BSC,MSC


Required Skills


AWS Glue, ADF,ADB, Immediate Joiner

More Jobs at ITC Infotech

Salesforce Marketing Cloud Developer

Bengaluru

4 - 9 yrs
|

INR 6 - 13 Lacs

Open Text - VIM - Product Lead / Manager

Kolkata, West Bengal, India

10 - 10 yrs
|

Salary: Not disclosed

Salesforce Marketing Cloud Developer

Bengaluru

4 - 8 yrs
|

INR 8 - 13 Lacs

Salesforce Developer

Bengaluru

3 - 8 yrs
|

INR 7 - 17 Lacs

Trade Finance Functional Tester

Bengaluru

5 - 10 yrs
|

INR 10 - 17 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
ITC Infotech logo
ITC Infotech

Information Technology and Services

Bengaluru

RecommendedJobs for You

ITC Infotech logo

Senior Data Engineer(Lead)

ITC Infotech

mumbai, maharashtra, india

ITC Infotech logo

Senior Data Engineer(Lead)

ITC Infotech

mumbai, maharashtra, india

ITC Infotech logo

Senior Data Engineer(Lead)

ITC Infotech

mumbai, maharashtra, india