We are seeking a hands-on Python AWS Data Engineer to design, develop, and maintain robust ETL pipelines and cloud-based data solutions. The ideal candidate will have strong expertise in Python, Spark, SQL , and AWS services , with experience in building scalable data pipelines, implementing data transformations, and ensuring high-quality, maintainable code.

You will collaborate closely with data architects, analysts, and business stakeholders to enable data-driven decision-making while working in an Agile environment .

Key Responsibilities

Design, develop, and maintain ETL pipelines using Python, Spark , and AWS services.

Build, test, debug, and document Python and Spark applications .

Work with AWS services including S3, ECS, Lambda, Glue, DynamoDB, SQS, SNS, IAM, and Athena .

Write and optimize SQL queries, joins, and stored procedures for relational databases.

Implement unit tests and validation using Pytest or Unittest frameworks.

Collaborate with DevOps teams to maintain CI/CD pipelines using Git, Jenkins/Bamboo .

Ensure scalability, performance, and reliability of data pipelines.

Participate in Agile ceremonies and contribute to sprint planning, code reviews, and retrospectives.

Document solutions, data flows, and ETL transformations for knowledge sharing and compliance.

Requirements Required Skills Experience

38 years of hands-on experience in Python, Spark, SQL , and ETL development.

Strong experience with AWS cloud services and cloud-native data solutions.

Proficiency in ETL architecture and pipeline design.

Experience with unit testing frameworks like Pytest and Unittest.

Solid understanding of RDBMS, SQL queries, joins, stored procedures .

Exposure to CI/CD and build automation tools (Git, Jenkins/Bamboo).

Familiarity with Bitbucket, GitHub, Jira, Splunk, PostgreSQL is a plus.

Excellent verbal and written communication skills .

Ability to work in Agile/Scrum environments.

Investment Management domain knowledge is an added advantage.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Neorealm Solutions

IT Services and IT Consulting

Bangalore Karnataka

Login to

Please Verify Your Phone or Email

Confirm Action

Python AWS Data Engineer