Big Data Engineer- Scala, Spark, AWS, Hadoop

Coforge

3 - 8 years

15 - 25 Lacs

noida hyderabad greater noida

Posted:2 days ago| Platform:

Apply

Skills Required

scala hadoop spark aws

Work Mode

Work from Office

Job Type

Full Time

Job Description

Job

Shift-

About the Role-

Key Responsibilities-

Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale, complex data processing.
Build and maintain data pipelines using Spark (Scala) for both structured and unstructured datasets.
Architect and operationalize data engineering and analytics platforms (AWS preferred; Hortonworks, Cloudera, or MapR experience a plus).
Implement and manage AWS services including EMR, Glue, Kinesis, DynamoDB, Athena, CloudFormation, API Gateway, and S3.
Work on real-time streaming solutions using Kafka and AWS Kinesis.
Support ML model operationalization on AWS (deployment, scheduling, and monitoring).
Analyse source system data and data flows to ensure high-quality, reliable data delivery for business needs.
Write highly efficient SQL queries and support data warehouse initiatives using Apache NiFi, Airflow, and Kylo.
Collaborate with cross-functional teams to provide technical leadership, mentor team members, and strengthen the data engineering capability.
Troubleshoot and resolve complex technical issues, ensuring scalability, performance, and security of data solutions.

Mandatory Skills & Qualifications-

Solid hands-on experience in Big Data Technologies (AWS, Scala, Hadoop and Spark Mandatory)
Proven expertise in Spark with Scala
Hands-on experience with: AWS services (EMR, Glue, Lambda, S3, CloudFormation, API Gateway, Athena, Lake Formation)

Aarushi.Shukla@coforge.com (Scala-AWS experience is mandatory)

More Jobs at Coforge

ServiceNow ITSM Developer

Pune, Greater Noida, Hyderabad

3 - 8 yrs

INR 15 - 30 Lacs

Snowflake Admin

Hyderabad

5 - 8 yrs

INR 15 - 25 Lacs

Coforge is Hiring Automation Tester(Selenium with Python, Pytest, AWS)

Hyderabad

6 - 10 yrs

INR 15 - 27 Lacs

Full Stack .Net Developer

Greater Noida

4 - 9 yrs

INR 15 - 30 Lacs

Etl Testing Engineer

Gurugram

4 - 9 yrs

INR 10 - 18 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.