Big Data Engineer With AWS

Role Overview: You will play a crucial role in developing scalable data pipelines, integrating APIs, and optimizing big data solutions on AWS. Key Responsibilities: - Design, develop, and maintain scalable data processing pipelines using Spark/PySpark and Hadoop on AWS. - Implement and optimize data workflows on AWS EMR, EC2, and ECS. - Develop and integrate RESTful APIs and AWS Gateway services using Scala/Java. - Collaborate with cross-functional teams to understand data requirements and deliver robust solutions. - Ensure data quality, performance, and reliability across all systems. - Participate in code reviews, testing, and deployment processes. Qualification Required: - 3-5 years of experience in Big Data Engineering. - Strong hands-on experience with Spark/PySpark, Hadoop, and AWS services. - Proficiency in Scala or Java for backend and API development. - Experience with AWS EMR, EC2, ECS, and API Gateway. - Solid understanding of RESTful API design and integration. - Familiarity with CI/CD pipelines and version control (e.g., Git). - Excellent problem-solving and communication skills. Additional Details: The company prefers candidates with experience in data security and compliance within cloud environments, exposure to data lake architectures, real-time data processing, as well as knowledge of containerization tools like Docker and orchestration with Kubernetes.,