Data Engineer

Job Title: Data Engineer

Location: Remote

Experience: 6+ years

Role Overview

Data Engineer

Key Responsibilities

• Review

  AWS Architecture (ARC)

  and validate usage of AWS resources like

  Step Functions, Lambda, DynamoDB, DocumentDB, S3, IAM roles, etc.

• Develop and maintain

  test automation scripts

  using

  PyTest framework

  .
• Configure and modify

  GitLab CI/CD pipelines (gitlab-ci.yaml)

  to trigger and manage automated tests.
• Integrate

  Xray REST API

  with test scripts and link automation with

  Jira Xray plug-in

  .
• Implement

  SonarQube

  for static code analysis of test framework repositories.
• Generate detailed execution reports using

  Allure Reporting

  framework.
• Work with

  Kafka

  for event-driven testing and validation of data streams.
• Collaborate with architects, developers, and QA teams to ensure test coverage and data reliability.
• Ensure best practices in

  Python coding, automation, and DevOps integration

  .

Mandatory Skills

• Strong programming skills in

  Python

  .
• Hands-on experience with

  AWS services

  (Step Functions, Lambda, DynamoDB, DocumentDB, S3, IAM).
• Expertise in

  PyTest

  framework for test automation.
• Experience with

  GitLab CI/CD

  , including pipeline configuration.
• Knowledge of

  Xray REST API

  integration with automation frameworks.
• Experience with

  SonarQube

  for static code analysis.
• Proficiency in

  Allure Reports

  setup and usage.
• Working knowledge of

  Kafka

  for messaging/event-driven systems.

Preferred / Nice-to-Have Skills

• Experience in

  data pipelines and ETL workflows

  .
• Knowledge of

  Agile methodologies

  (Scrum/Kanban).
• Familiarity with

  cloud security practices

  and compliance.
• Strong debugging, problem-solving, and stakeholder communication skills.