Senior Data Engineer AWS & Python

Location: Bangalore 

Experience Level: 5+ Years  

Employment Type: Full-Time  

Role Overview

We are seeking a seasoned ETL Developer with deep expertise in AWS serverless architecture and Python programming. The ideal candidate will architect and optimize data pipelines using AWS Lambda, Step Functions, and Glue Jobs, ensuring scalable, cost-efficient, and high-performance ETL workflows across diverse data domains.

Key Responsibilities

- Design, develop, and maintain ETL pipelines using AWS Glue, Lambda, and Step Functions  

- Implement scalable data ingestion, transformation, and orchestration workflows  

- Optimize Python-based data processing scripts for performance and maintainability  

- Collaborate with data architects and business stakeholders to understand requirements and translate them into technical solutions  

- Monitor, troubleshoot, and enhance existing ETL jobs for reliability and efficiency  

- Ensure data quality, lineage, and governance across all stages of the pipeline  

- Document technical designs, workflows, and operational procedures 

Required Skills & Qualifications

- 5+ years of hands-on experience in ETL development and data engineering  

- Strong proficiency in Python for data manipulation, scripting, and automation  

- Deep understanding of AWS services, especially:  

  - AWS Lambda event-driven compute workflows  

  - AWS Step Functions orchestration of distributed services  

  - AWS Glue – serverless ETL and data cataloging  

- Experience with structured and semi-structured data formats (CSV, JSON, Parquet)  

- Familiarity with data lakes, S3, and cloud-native data architecture  

- Strong problem-solving skills and ability to work independently in a fast-paced environment  

- Excellent communication and documentation skills  

Preferred Qualifications

- Experience with CI/CD pipelines and infrastructure-as-code (e.g., CloudFormation, Terraform)  

- Exposure to data warehousing solutions like Redshift, Snowflake, or BigQuery  

- Knowledge of data governance, security, and compliance best practices  

- Certification in AWS (e.g., AWS Certified Data Analytics or Developer Associate)