Aws Data Engineer

Job Title

• Must have atleast 5+ yrs of overall IT experience and 3+ years' experience working as a Data Engineer working on AWS platform with Python and Pyspark programming and SQL
• Python Application Development - Object oriented programming, test driven development using Pytest, implementing modules & packages, developing production ready frameworks and working with core and extended Python libraries, working with files, database, API, familiar with PEP coding standards, GIT version control
• Hands-on experience on developing data pipelines using AWS Data Services like S3, Lambda, Glue, Step Functions, RDS, Redshift, Event Bridge, DynamoDB, SNS, SQS, IAM, EMR, EC2, ECS, Fargate, SSM, Secrets Manager, Codepipeline, Cloudformation
• Must have good knowledge on SQL (Joins, Aggregations, Window Functions etc.)
• Good to have knowledge on data transformation using Pyspark
• Has good understanding and experience of Devops, CI/CD for AWS applications
• Must have experience of Agile development methodologies
• Strong written communication skills
• Must have good problem solving skills

Experience Required

• Prepare High Level and Detail Design based on requirements for development team to progress
• Work with Architect, Tech Leads and business for requirement/solution design clarifications
• Provide estimate for effort and timeline for application development
• Provide inputs for test strategy and planning
• Clearly articulate merits and pitfalls in different solution approaches
• Work with Development teams to enable delivery of solution as per the architecture/design by frequent reviews and providing clarifications and technical support required to team
• Support testing, deployment and implementation
• Communicating in a timely manner any potential roadblocks and impediments which may impact development effort
• Collaborate with other development and support teams if required
• Take ownership of code development till production implementation
• Prior experience with application delivery using an Onshore/Offshore model in Agile projects