AWS-Scala Developer (Big Data)

Coforge

0 years

0 Lacs

noida uttar pradesh india

Posted:6 days ago| Platform:

Apply

Skills Required

aws scala developer data engineering design spark analytics dynamodb api kafka support ml model deployment scheduling analyze sql apache nifi airflow leadership resolve scalability security hadoop

Work Mode

On-site

Job Type

Full Time

Job Description

We are seeking a highly skilled Big Data Engineer with deep expertise in Big Data technologies and AWS Cloud Services. The ideal candidate will bring strong hands-on experience in designing, architecting, and implementing scalable data engineering solutions while driving innovation within the team.

Key Responsibilities-

Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale, complex data processing.
Build and maintain data pipelines using Spark (Scala) for both structured and unstructured datasets.
Architect and operationalize data engineering and analytics platforms (AWS preferred; Hortonworks, Cloudera, or MapR experience a plus).
Implement and manage AWS services including EMR, Glue, Kinesis, DynamoDB, Athena, CloudFormation, API Gateway, and S3.
Work on real-time streaming solutions using Kafka and AWS Kinesis.
Support ML model operationalization on AWS (deployment, scheduling, and monitoring).
Analyze source system data and data flows to ensure high-quality, reliable data delivery for business needs.
Write highly efficient SQL queries and support data warehouse initiatives using Apache NiFi, Airflow, and Kylo.
Collaborate with cross-functional teams to provide technical leadership, mentor team members, and strengthen the data engineering capability.
Troubleshoot and resolve complex technical issues, ensuring scalability, performance, and security of data solutions.

Mandatory Skills & Qualifications-

Solid hands-on experience in Big Data Technologies (AWS, Scala, Hadoop and Spark Mandatory)
Proven expertise in Spark with Scala
Hands-on experience with: AWS services (EMR, Glue, Lambda, S3, CloudFormation, API Gateway, Athena, Lake Formation)

More Jobs at Coforge

ServiceNow ITSM Developer

Pune, Greater Noida, Hyderabad

3 - 8 yrs

INR 15 - 30 Lacs

Snowflake Admin

Hyderabad

5 - 8 yrs

INR 15 - 25 Lacs

Coforge is Hiring Automation Tester(Selenium with Python, Pytest, AWS)

Hyderabad

6 - 10 yrs

INR 15 - 27 Lacs

Full Stack .Net Developer

Greater Noida

4 - 9 yrs

INR 15 - 30 Lacs

Etl Testing Engineer

Gurugram

4 - 9 yrs

INR 10 - 18 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.