Data Migration Lead

Java

Key Responsibilities:

• Lead the

  design, development, and deployment

  of scalable and reliable data processing systems using Java and Apache Spark in a cloud environment.
• Architect and implement

  big data processing pipelines

  utilizing technologies such as Apache Spark and cloud-native services.
• Develop and manage

  serverless applications

  and integrate them with cloud services to build efficient and maintainable solutions.
• Use container orchestration tools (e.g., Amazon EKS or equivalent) to manage microservices-based applications.
• Design and implement

  workflow orchestration solutions

  (e.g., Apache Airflow) for managing complex data pipelines.
• Collaborate with cross-functional teams (including product, data, and operations teams) to define technical requirements and ensure smooth integration across services.

• Mentor and guide

  development teams on Java best practices, cloud architecture, and data engineering principles.
• Monitor and optimize the

  performance and cost-efficiency

  of deployed solutions in cloud environments.
• Stay updated on emerging technologies, tools, and best practices to continuously drive technical excellence and innovation.

Required Skills:

• Strong hands-on experience in

  Java

  development.
• Proficiency in

  Apache Spark

  for distributed data processing.
• Experience with

  cloud platforms

  and services (e.g., EMR, Lambda, EKS, Airflow, or their equivalents).
• Solid understanding of

  serverless architectures

  and

  microservices

  design.
• Demonstrated leadership and team mentoring experience.
• Excellent

  problem-solving

  ,

  communication

  , and

  collaboration

  skills.