Quality Assurance Engineer

Position Title:

Experience:

Location:

Employment Type:

Description:

QA / Data Validation Engineer

Tech Stack:

• Languages / Runtime:

  Python 3.11, SQL

• Containerization & Orchestration:

  Kubernetes (EKS)

• Workflow Orchestration:

  Prefect

• Parallel Task Runner:

  Ray

• Data Storage & Processing:

  AWS Aurora RDS, PostgreSQL (cached storage), S3 buckets

• CI/CD:

  Bitbucket using Helm chart and Terraform

Responsibilities:

• Develop automated validation tests for data ingestion and transformation pipelines.
• Ensure deduplication, reconciliation, and data quality rules are enforced.
• Build reusable mock datasets for regression testing and dual-run cutover validation.
• Collaborate with Data Engineers to identify, reproduce, and resolve defects in pipelines.
• Maintain and enhance validation frameworks to ensure data accuracy and consistency.

Preferred Skills:

• Experience with automated testing frameworks for data pipelines.
• Strong SQL skills for writing complex validation and reconciliation queries.
• Proficiency in Python for test automation and data validation scripting.
• Exposure to AWS (S3, RDS) and CI/CD pipelines (Bitbucket, Terraform).