AI Tester

Job Title :

Experience:

Location:

Contract Duration:

Work Time:

We are seeking a skilled and detail-oriented AI Test Engineer to join our team working on cutting-edge AI agents. In this role, you will be responsible for ensuring the quality, reliability, and performance of AI-driven systems by designing and executing test cases, validating data, and collaborating with developers and data scientists.

Responsibilities:-

Test Planning & Strategy

Develop comprehensive test plans covering functional, regression, performance, and edge-case testing.

Collaborate with developers and data scientists to define acceptance criteria for AI behavior.

Test Case Design & Execution

Design and execute test cases to validate AI agent functionality and accuracy.

Test AI decision-making processes, responses, and interactions.

Data Validation

Verify training data quality and test AI agents’ ability to handle diverse inputs.

Identify and report potential issues with data bias or robustness.

Performance & Scalability Testing

Evaluate system performance under load and edge cases.

Identify bottlenecks and optimize AI agent performance.

Bug Reporting & Tracking

Document and track issues using Jira, Trello, or similar tools.

Collaborate with developers for timely resolutions.

Automation & CI/CD

Develop automated test scripts for AI systems.

Integrate automation into CI/CD pipelines for continuous testing.

Collaboration

Work with cross-functional teams (developers, data scientists, product managers).

Participate in agile ceremonies and contribute QA insights.

Technical Skills:-

Strong knowledge of software testing methodologies (functional, regression, performance, usability).

Familiarity with AI/ML concepts: NLP, reinforcement learning, neural networks.

Hands-on experience with test automation tools (Selenium, pytest, etc.).

Proficiency in Python, Java, or JavaScript for scripting.

Knowledge of API testing tools (Postman, REST Assured).

Experience with CI/CD pipelines (Jenkins, GitLab CI, GitHub Actions).

AI-Specific Testing Skills:-

Testing AI agent behavior, response accuracy, adaptability.

Data validation and testing models for bias/fairness.

Familiarity with frameworks like TFX, MLflow, or similar.

Soft Skills:-

Strong analytical and problem-solving abilities.

Excellent communication and documentation skills.

High attention to detail and focus on quality delivery.

Nice-to-Have Skills:-

Experience with cloud platforms (AWS, Azure, GCP).

Knowledge of containerization tools (Docker, Kubernetes).

Familiarity with Git, Jira, Confluence.

Qualifications:-

Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.

2–3 years of software testing experience, including at least 1–2 years testing AI/ML systems.

Certifications in software testing (ISTQB) or AI/ML (TensorFlow Developer, etc.) are a plus.