Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in india
>
MyRemoteTeam Inc
>
Software Testing Specialist

Software Testing Specialist

MyRemoteTeam Inc

0 years

0 Lacs

india

Posted:2 days ago| Platform:

Apply

Skills Required

software testing ai evaluation evaluator test reasoning analyze logical authorization research logic json yaml communication consulting

Work Mode

Remote

Job Type

Part Time

Job Description

AI Agent Evaluation Analyst Application Form

Email-Sandeep.patel@truelancer.com

We’re Hiring: AI Task Evaluator – TAU Framework (Remote | Contract)

leading global AI company

AI Agent

Role Overview

AI-agent conversations and task trajectories

The
agent’s reasoning
and tool usage are logical and consistent.
The
policies
(privacy, accuracy, authorization) are respected.
The
final outcome
matches the correct “golden path.”
The
conversation flow
is realistic, clear, and aligned with the user’s intent.

quality assurance, research, and logic-based evaluation

Key Responsibilities

Review agent–user interactions and identify logical gaps or policy violations.
Validate tool sequences and end results against golden sets.
Flag inconsistencies, missing steps, or unrealistic actions.
Annotate errors and reasoning issues clearly and concisely.
Suggest edge cases or task improvements to enhance coverage and realism.

What We’re Looking For

Excellent
analytical and critical-thinking
skills.
Strong attention to
detail and logical consistency
.
Ability to understand structured workflows (JSON/YAML reading familiarity is a plus).
Clear
English communication and documentation
skills.
Background in
QA, consulting, linguistics, research, or systems analysis
preferred.

More Jobs at MyRemoteTeam Inc

Python Developer

India

6.0 - 6.0 yrs

Salary: Not disclosed

DevOps Engineer

India

6.0 - 6.0 yrs

Salary: Not disclosed

ReactJS Developer

Chennai, Tamil Nadu, India

6.0 - 6.0 yrs

Salary: Not disclosed

Frontend Developer

Pune, Maharashtra, India

6.0 - 6.0 yrs

Salary: Not disclosed

DevOps Engineer

Pune, Maharashtra, India

6.0 - 6.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.