Big Data Engineer ( AWS, Spark & Scala )

Coforge Ltd

Are you passionate about building scalable data solutions using cutting-edge technologies? Join Coforge Ltd as a Big Data Engineer and be part of a dynamic team driving innovation in cloud-based data engineering.

Company:

Experience Required:

Job Locations:

Send your CV to:

For queries, contact via WhatsApp:

Key Responsibilities-

• Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale, complex data processing.

• Build and maintain data pipelines using Spark (Scala) for both structured and unstructured datasets.
• Architect and operationalize data engineering and analytics platforms (AWS preferred; Hortonworks, Cloudera, or MapR experience a plus).

• Implement and manage AWS services including EMR, Glue, Kinesis, DynamoDB, Athena, CloudFormation, API Gateway, and S3.
• Work on real-time streaming solutions using Kafka and AWS Kinesis.

• Support ML model operationalization on AWS (deployment, scheduling, and monitoring).
• Analyze source system data and data flows to ensure high-quality, reliable data delivery for business needs.

• Write highly efficient SQL queries and support data warehouse initiatives using Apache NiFi, Airflow, and Kylo.

• Collaborate with cross-functional teams to provide technical leadership, mentor team members, and strengthen the data engineering capability.

• Troubleshoot and resolve complex technical issues, ensuring scalability, performance, and security of data solutions.

Mandatory Skills & Qualifications-

• Solid hands-on experience in Big Data Technologies (AWS, Scala, Hadoop, and Spark Mandatory)
• Proven expertise in Spark with Scala
• Hands-on experience with: AWS services (EMR, Glue, Lambda, S3, CloudFormation, API Gateway, Athena, Lake Formation)

About Company:-

Coforge is a leading global IT solutions organization, enabling its clients to transform at the intersect of unparalleled domain expertise and emerging technologies to achieve real-world business impact.

A focus on very select industries, a detailed understanding of the underlying processes of those industries and partnerships with leading platforms provides us a distinct vantage.

We leverage AI, Cloud and Insight driven technologies, allied with our industry expertise, to transform client businesses into intelligent, high growth enterprises.

Coforge is an Indian publicly traded IT software and services company, operating in many countries.

The company's stock trades on the Bombay Stock Exchange and on the National Stock Exchange of India under the ticker symbol COFORGE.