AWS Data Engineer

AWS Data Engineer

Exp: 5-10 yrs

Location: Chennai

Must attend the walkin drive on 29th Nov - Venue Address- Tata Consultancy ServicesLtd., Sholinganallur, Old Mahabalipuram, Chennai - 600 119, India

Must-Have**

(Ideally should not be more than 6)

· Expertise in Python programming for data transformation, automation, and backend development.

· Practical experience working with AWS services such as S3, Glue, Lambda, Athena, and DynamoDB for data ingestion, processing, and analytics.

· Skilled in developing and managing RESTful APIs using Swagger (OpenAPI) for design, documentation, and testing.

· Capable of handling data migration and schema transformation tasks using AWS tools.

· Proficient in managing RDS and Aurora databases, including setup, configuration, and optimization.

· Adept at query optimization and performance improvement for high-volume data environments.

Responsibility of / Expectations from the Role

· Design, develop, and maintain data pipelines and ETL processes using Python.

· Work with large-scale datasets, ensuring data quality, integrity , and Security.

· Implement cloud-native solutions on AWS(e.g., S3, Glue, Lambda, Athena and DynamoDB etc.) · Optimize data workflows for performance, scalability and cost efficiency.

· Manage data lake and data warehouse environment.

· Automate deployment and monitoring of data pipelines using CI/CD best practices.