Data Engineer

Job Title: Tech Lead

We are seeking a dynamic and experienced Tech Lead with a strong foundation in Java and Apache Spark to join our team. In this role, you will lead the development and deployment of scalable cloud-based data solutions, leveraging your expertise in AWS and big data technologies.

Key Responsibilities:

·                     Lead the design, development, and deployment of scalable and reliable data processing solutions on AWS using Java and Spark.

·                     Architect and implement big data processing pipelines using Apache Spark on AWS EMR.

·                     Develop and deploy Serverless applications using AWS Lambda, integrating with other AWS services.

·                     Utilize Amazon EKS for container orchestration and microservices management.

·                     Design and implement workflow orchestration using Apache Airflow for complex data pipelines.

·                     Collaborate with cross-functional teams to define project requirements and ensure seamless integration of services.

·                     Mentor and guide team members in Java development best practices, cloud architecture, and data engineering.

·                     Monitor and optimize performance and cost of deployed solutions across AWS infrastructure.

·                     Stay current with emerging technologies and industry trends to drive innovation and maintain a competitive edge.

Required Skills:

·                     Strong hands-on experience in Java development.

·                     Proficiency in Apache Spark for distributed data processing.

·                     Experience with AWS services including EMR, Lambda, EKS, and Airflow.

·                     Solid understanding of Serverless architecture and microservices.

·                     Proven leadership and mentoring capabilities.

·                     Excellent problem-solving and communication skills.

Job Title: SME

We are seeking a highly skilled and motivated Engineering Lead to join our team as a Cloud and Data Engineer. The ideal candidate will possess extensive expertise in cloud technologies and data engineering, with a proven ability to orchestrate cutting-edge technology to connect various applications within the cloud environment.

Key Responsibilities:

·                     Lead the design and implementation of cloud-based solutions for data engineering projects.

·                     Orchestrate the integration of diverse applications and data sources across the cloud.

·                     Coordinate with various teams to ensure smooth connectivity, data transfer, and overall functionality..

·                     Provide guidance and mentorship to junior engineers in both cloud and data engineering domains.

·                     Stay updated with the latest advancements in cloud and data technologies, as well as best practices.

Qualifications:

·                     Minimum of 8+ years of experience in cloud engineering, data engineering, or related fields.

·                     Strong expertise in cloud platforms (preferably AWS) and data engineering tools.

·                     Proficiency in application and data integration within cloud environments.

·                     Experience with SPARK is a significant advantage.

·                     Excellent problem-solving skills and ability to work in a fast-paced environment.

·                     Strong leadership and communication skills.