Senior Associate/ Manager - AWS Data Engineer

• Senior Associate/ Manager - AWS Data Engineer (Contractual Role) We are seeking a highly skilled Senior Associate/ Manager - AWS Data Engineer to join our team in Kochi
• The ideal candidate will have experience in designing, developing, and deploying data engineering solutions on AWS
• The role is contractual for 6 months

Responsibilities

• Design, develop, and deploy data engineering solutions on AWS, leveraging AWS services such as S3, DynamoDB, and Redshift
• Develop and maintain ETL processes using PySpark and AWS Glue, ensuring data quality and integrity
• Collaborate with cross-functional teams to design and implement data pipelines, ensuring seamless integration with existing systems
• Develop and maintain CI/CD pipelines using tools such as Jenkins or AWS CodePipeline, ensuring efficient and automated deployment of data engineering solutions
• Write efficient and scalable SQL queries to extract insights from large datasets, using tools such as AWS Redshift or Amazon Athena
• Troubleshoot and resolve issues related to data engineering solutions, ensuring minimal downtime and maximum uptime
• Stay up-to-date with the latest AWS services and features, and apply this knowledge to improve existing solutions and develop new ones

Requirements

• 6-13 years of experience in data engineering, with a focus on AWS and AWS services
• Strong experience in developing and deploying data engineering solutions using Python, PySpark, and AWS Glue
• Excellent knowledge of SQL and ability to write efficient and scalable queries
• Experience with CI/CD pipelines and tools such as Jenkins or AWS CodePipeline
• Strong understanding of cloud computing and data engineering principles
• Excellent problem-solving skills and ability to troubleshoot complex issues
• Strong communication and collaboration skills, with the ability to work with cross-functional teams