AWS Data Engineer

About StatusNeo: At StatusNeo, we are committed to redefining the way businesses operate. As a leader in digital transformation, we leverage cutting-edge technologies and innovative strategies to empower organizations around the globe. Our partnerships with industry giants and our commitment to continuous learning and improvement provide an unparalleled platform for professional growth. Embrace a career at StatusNeo, where we value diversity, inclusivity and foster a hybrid work culture. Role: Data Engineer Location: Gurugram Key experience: - 3+ years of experience with AWS services including SQS, S3, Step Functions, EFS, Lambda, and OpenSearch. - Strong experience in API integrations, including experience working with large-scale API endpoints. - Proficiency in PySpark for data processing and parallelism in large-scale ingestion pipelines. - Experience with AWS OpenSearch APIs for managing search indices. - Terraform expertise for automating and managing cloud infrastructure. - Hands-on experience with AWS SageMaker, including working with machine learning models and endpoints. - Strong understanding of data flow architectures, document stores, and journal-based systems. - Experience in parallelizing data processing workflows to meet strict performance and SLA requirements. - Familiarity with AWS tools like CloudWatch for monitoring pipeline performance. Additional Preferred Qualifications: - Strong problem-solving and debugging skills in distributed systems. - Prior experience in optimizing ingestion pipelines with a focus on cost-efficiency and scalability. - Solid understanding of distributed data processing and workflow orchestration in AWS environments. Soft Skills: - Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams. - Ability to work in a fast-paced environment and deliver high-quality results under tight deadlines. - Analytical mindset, with a focus on performance optimization and continuous improvement.,