Senior Data Engineer

Senior Data Engineer Cochin / Trivandrum /

Experience:

Location:

Onboarding:

Core Responsibilities

• Architect & design

  scalable data solutions using AWS (EMR, Glue, Lambda, S3, EC2).

• Build and manage

  data pipelines with

  PySpark and Scala

  for batch and streaming workloads.

• Develop & optimize

  data stores using

  Cassandra

  (OLTP) and

  Elasticsearch

  (analytics).

• Implement streaming

  solutions with

  Kafka

  ,

  SNS/SES

  for real-time and asynchronous data.

• Orchestrate workflows

  via

  Apache Airflow

  for complex data dependencies.

• Collaborate

  with product and app teams to convert requirements into data models.

• Monitor and optimize

  pipelines for cost, performance, and scalability.

• Lead & mentor

  a team of data engineers.

Required Technical Skills

• Primary:

  PySpark, Scala, EMR, Cassandra, Airflow, Kafka

• Mandatory:

  AWS, PySpark, Scala, EMR, Cassandra, Airflow, Lambda, Kafka

• Good to Have:

  Snowflake

• Tools/Concepts:

  AWS data ecosystem (EMR, Glue, Lambda, S3, EC2), data architecture, pipeline optimization

Soft Skills

• Excellent communication & presentation skills
• Strong analytical & problem-solving ability
• Team player with leadership potential
• Adaptable and proactive in learning emerging technologies

Qualifications

• Bachelor's or Master's degree in Computer Science, Data Science, or related field
• Experience in consulting/contracting roles preferred
• Must adhere to Information Security Management policies

share cv to [HIDDEN TEXT]