AI with AWS Bedrock

Job Summary

The Test Automation Engineer will be responsible for building and maintaining robust test automation frameworks using Python and/or Java. The role involves creating automated test suites across functional, regression, performance, and integration areas, along with supporting the testing of AI/ML models. The engineer will work closely with product and engineering teams to understand requirements, design test strategies, and ensure product quality. This position also includes contributing to CI/CD pipelines, improving testing efficiency through new tools and AI-driven solutions, and maintaining strong documentation and best practices.

Role and responsibilities

• Design, develop, and maintain test automation frameworks using Python and/or Java.
• Build automated test suites for functional, regression, performance, and integration testing.
• Participate in testing of AI/ML models, including validating outputs, datasets, model accuracy, and edge-case behaviors.
• Implement AI-assisted testing tools and contribute to developing intelligent test solutions.
• Collaborate with cross-functional teams to understand product requirements and convert them into test strategies.
• Identify root causes of defects and work with engineering teams to resolve them.
• Perform code reviews, maintain test documentation, and ensure best testing practices.
• Contribute to CI/CD pipelines with automated quality gates.
• Continuously evaluate and integrate new tools, frameworks, and AI capabilities to improve test efficiency.

Required Skills and Qualification

• Bachelors degree in computer science, Engineering, or related field (or equivalent experience).
• Strong experience in test automation using Python and/or Java.
• Solid understanding of testing methodologies, QA processes, and automation principles.
• Exposure to AI/ML concepts such as model training, model inference, datasets, bias, and evaluation metrics.
• Experience working with API testing tools (e.g., Postman, REST Assured, PyTest).
• Hands-on experience with automation frameworks like Selenium, Playwright, Cypress, or Robot Framework.
• Familiarity with CI/CD platforms (Jenkins, GitHub Actions, GitLab CI, etc.).
• Strong analytical and debugging skills.
• Preferred Qualifications

Preferred Skills

• Experience testing AI/ML pipelines or platforms.
• Understanding of LLMs, NLP, generative AI, or ML workflows.
• Knowledge of cloud platforms (AWS, Azure, GCP).
• Experience with containerization tools (Docker, Kubernetes).
• Familiarity with data validation, data quality tools, or synthetic data generation.
• Experience with test-case generation using AI tools.