Senior Software Engineer - Data Engineer

Info Edge

1 - 3 years

10 - 15 Lacs

noida

Posted:19 hours ago| Platform:

Apply

Skills Required

java data engineering spark airflow scala kafka etl elt aws

Work Mode

Work from Office

Job Type

Full Time

Job Description

Roles and Responsibilities :

Design, develop, test, and deploy large-scale data pipelines using Airflow to extract, transform, and load (ETL) data from various sources into AWS cloud storage solutions.
Collaborate with cross-functional teams to identify business requirements and design scalable data architectures that meet those needs.
Develop high-quality code in Scala or Java to implement ETL processes and integrate them with Kafka messaging systems for real-time event processing.
Troubleshoot complex issues related to pipeline failures and optimize system performance for improved efficiency.

Job Requirements :

1-3 years of experience in Data Engineering with expertise in Airflow, Scala/Java programming languages.
Strong understanding of big data technologies such as Spark and familiarity with AWS services including S3 buckets, Lambda functions, etc.
Experience working on ETL projects involving multiple source systems and large datasets; ability to work independently on complex problems.

More Jobs at Info Edge

Corporate Sales/B2B Sales II 99Acres II Chennai

Chennai

2 - 6 yrs

INR 7 - 12 Lacs

Senior Executive

Noida

Experience: Not specified

INR 4 - 8 Lacs

Virtual walk-in | Inside Sales | Naukri FastForward

Noida

Experience: Not specified

INR 4 - 5 Lacs

Tele calling executive- Job Hai || Info Edge || Freshers

Noida

Experience: Not specified

INR 1 - 2 Lacs

Inside Sales | Jeevansaathi.com

Noida

Experience: Not specified

INR 3 - 6 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Java Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.