AI Agent Evaluation Analyst

0 years

0 Lacs

Posted:5 days ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Contractual

Job Description

We’re looking for smart, curious minds who love to pick apart systems, challenge assumptions, and improve how AI agents think and act.


AI Agent Evaluation Analyst


What you’ll do:

  • Evaluate task designs for clarity, logic, and realism
  • Review AI decision paths and identify inconsistencies or edge cases
  • Analyze policy definitions for gaps or unclear implications
  • Suggest improvements to test coverage and scenario design
  • Document findings clearly and systematically


What we’re looking for:

  • Excellent analytical and logical reasoning
  • Keen attention to detail — you can spot contradictions and vague instructions a mile away
  • Comfortable reading structured data formats (JSON/YAML)
  • Great written English and communication skills
  • Background in consulting, case solving, Olympiads, or systems thinking is a big plus


If you love solving logical puzzles, stress-testing systems, and thinking about “what could go wrong,” we’d love to hear from you.


Apply now and help shape how next-gen AI agents are evaluated and improved.


for more information, connect with me at sagar.gupta@truelancer.com

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You