Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Jobs

Interviews

Home
>
Jobs in bengaluru
>
Scrumconnect
>
AI Automation Test Engineer

AI Automation Test Engineer

Scrumconnect

3 - 6 years

5 - 8 Lacs

bengaluru

Posted:4 hours ago| Platform:

Apply

Skills Required

product quality automation data analysis manager quality assurance data management gcp machine learning performance testing sql python

Work Mode

Work from Office

Job Type

Full Time

Job Description

Position Overview

We are seeking a passionate AI Automation Test Engineer to join our innovative UK based stealth startup, in Bengaluru. This role offers an exciting opportunity to shape the testing strategy for cutting-edge AI products while working in a fast-paced, dynamic environment. Youll be instrumental in ensuring the quality and reliability of our AI-driven solutions through comprehensive automated testing frameworks.
Key Responsibilities AI/ML Testing

Design and implement automated testing frameworks specifically for AI/ML models and systems
Develop test strategies for model performance, accuracy, bias detection, and robustness
Create automated pipelines for data validation, model training verification, and inference testing
Implement A/B testing frameworks for AI model comparison and evaluation
Test Automation Development
- Build and maintain end-to-end test automation suites using modern testing frameworks
- Develop API testing automation for microservices and ML model endpoints
- Create performance and load testing automation for AI inference systems
- Design automated regression testing for continuous integration/deployment pipelines
  Quality Assurance
  - Collaborate with AI/ML engineers to define testing requirements and acceptance criteria
  - Establish quality gates and metrics for AI model deployment
  - Conduct exploratory testing of AI features and user experiences
  - Monitor and analyse test results, providing actionable insights to development teams
    Infrastructure & DevOps
    - Set up and maintain testing environments and test data management systems
    - Integrate automated tests with CI/CD pipelines using tools like Jenkins, ArgoCD, or GitHub Actions
    - Implement monitoring and alerting for test execution and system health
    - Manage test data pipelines and synthetic data generation for AI model testing
      Required Qualifications Technical Skills
      - Programming : Proficiency in Python, with experience in testing frameworks (pytest, unittest, Robot Framework)
      - AI/ML Testing : Understanding of machine learning concepts, model evaluation metrics, and testing methodologies
      - Automation Tools : Hands-on experience with Selenium, Appium, or similar web/mobile automation tools
      - API Testing : Experience with REST/GraphQL API testing using tools like Postman, Newman, or requests library
      - Version Control : Proficient with Git and collaborative development workflows
        Experience Requirements
        
        3-6 years of experience in test automation and quality assurance
        
        1-2 years of experience testing AI/ML systems or data-driven applications
        
        Experience with cloud platforms (AWS, Azure, or GCP) and containerization (Docker, Kubernetes)
        
        Familiarity with databases (SQL and NoSQL) and data validation techniques
        Preferred Qualifications
        
        Experience with MLOps tools and practices (MLflow, Kubeflow, or similar)
        
        Knowledge of performance testing tools (JMeter, Locust, or K6)
        
        Understanding of data science workflows and model lifecycle management
        
        Experience with monitoring tools (Prometheus, Grafana, ELK stack)
        
        Background in statistics or data analysis
        What We Offer Compensation & Benefits
        
        Competitive salary up to 20b915,00,000 per annum
        
        Performance-based bonuses and annual increments
        
        Comprehensive health insurance for you and your family
        Professional Growth
        
        Opportunity to work with cutting-edge AI technology in stealth mode
        
        Direct impact on product development and company direction
        
        Mentorship from experienced AI and engineering leaders
        
        Learning budget for courses, conferences, and certifications
        Work Environment
        
        Modern office space in Bengaluru with all necessary amenities
        
        Collaborative, innovation-driven culture
        
        Regular team events and knowledge-sharing sessions
        About the Role
        As an early-stage team member, youll have the unique opportunity to build testing practices from the ground up, directly influence product quality, and grow with the company. This position is ideal for someone who thrives in ambiguous environments, enjoys solving complex technical challenges, and wants to be part of building something revolutionary in the AI space.
        
        Note : Due to our stealth mode status, specific product details will be shared during the interview process with qualified candidates who sign appropriate confidentiality agreements.
        Application Process
        Interested candidates should submit their resume along with:
        
        Brief cover letter explaining interest in AI testing and startup environments
        
        Any relevant certifications or achievements in testing or AI/ML domains
        
        We are an equal opportunity employer committed to diversity and inclusion. All qualified applicants will receive consideration regardless of race, gender, age, religion, sexual orientation, or disability status.

More Jobs at Scrumconnect

Junior HR Operations Executive

Bengaluru

1 - 3 yrs

INR 3 - 4 Lacs

Senior DevSecOps Engineer

Bengaluru

10 - 16 yrs

INR 40 - 45 Lacs

Legal Compliance Officer

Bengaluru

2.0 - 4.0 yrs

INR 4 - 6 Lacs

DevOps Engineer

Bengaluru

2.0 - 4.0 yrs

INR 25 - 30 Lacs

DevOps Engineer

Bengaluru

4.0 - 5.0 yrs

INR 6 - 7 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Machine Learning Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Scrumconnect

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

AI Automation Test Engineer