Data Engineer

Job Title: Data Engineer – Python & AWS

Location:

Experience:

Employment Type:

🔹 About the Role

Data Engineer (L3)

🔹 Key Responsibilities

• Design, develop, and maintain ETL/ELT data pipelines using

  Python

  and

  AWS Glue, Lambda, EMR, Step Functions

  , etc.
• Build and manage data lakes & warehouses using

  S3, Redshift, Athena, Lake Formation

  .
• Implement data ingestion from

  RDBMS, APIs, streaming sources, and on-prem systems

  .
• Optimize data workflows for performance, cost, and reliability.
• Develop reusable Python-based frameworks for ingestion, transformation, and validation.
• Work with stakeholders to define data requirements and ensure governance.
• Manage data infrastructure using

  Terraform or CloudFormation

  .
• Implement data quality, monitoring, and alerting using

  CloudWatch, Glue Catalog

  , etc.
• Support security & compliance (IAM, encryption, data masking, GDPR).
• Collaborate with DevOps/ML teams to integrate pipelines with analytics & AI workflows.

🔹 Mandatory Skills & Qualifications

✔ Bachelor’s/Master’s in Computer Science or related field

✔ 5–8 years of experience as a Data Engineer

✔ Strong Python experience (pandas, boto3, PySpark, SQLAlchemy)

✔ Deep expertise in AWS services:

Glue, Lambda, EMR, S3, Redshift, Athena, Step Functions

IAM, CloudWatch, Kinesis, ECS/EKS

✔ Strong SQL & NoSQL (PostgreSQL, DynamoDB, MongoDB)

✔ Expertise in data modeling, schema design & ETL orchestration

✔ Experience with Git & CI/CD pipelines

✔ Knowledge of data governance, lineage & cataloging

✔ Strong debugging, optimization & performance tuning skills

🔹 Preferred Skills

• Experience with

  Apache Spark / PySpark

  on EMR
• Knowledge of

  Airflow, dbt

  , or similar orchestration tools
• Experience with

  Docker, Kubernetes

  , DevOps workflows
• Exposure to ML pipelines or real-time streaming (Kafka, Kinesis)
• Familiarity with AWS Glue Studio, DataBrew, Lake Formation

🔹 Soft Skills

• Excellent communication & analytical skills
• Ability to work independently and cross-functionally
• Strong problem-solving mindset
• Adaptable to fast-paced cloud environments