953 Evaluator Jobs - Page 6

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Preference Ranking Model Evaluator Type: Freelance Compensation: $25–$35/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses based on quality, coherence, and helpfulness. Assign preference rankings to pairs or sets of model outputs. Follow detailed labeling guidelines and adjust based on evolving criteria. Provide brief written explanations for ranking decisions when required....

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Sports Content Evaluator Type: Contract Compensation: $45–$70/hour Location: Remote Role Responsibilities Evaluate and score AI-generated commentary, reports, and tactical analyses across multiple sports. Assess the depth of sports knowledge, player understanding, and situational awareness in AI outputs. Identify factual inaccuracies, tactical misinterpretations, or tone/style mismatches in AI analyses. Evaluate how AI performance varies ac...

Preventive maintenance. * Troubleshooting and repairing malfunctioning equipment, appliances, and apparatus. * Overseeing the purchasing and maintenance of the electrical mechanical equipment. * They maintain accurate records of all electrical and mechanical work, including blueprints, schematics, maintenance logs and inspection reports. * AutoCAD 2D or 3D engineering design and development knowledge. * HT/LT Transmission line and switchgear, VCB , ACB knowledge. * Plc and hmi troubleshooting with various of driver and motors. * Conveyor and bucket evaluator Preventive maintenance. * Day/ night shift changes and emergency breakdown attend. * Must experience in electrical and basic knowledge ...

Dear All, Greetings from PBOplus !! We are hiring for AI & LLM Engineer – PLOT (ODIF + OSIF) Location: Remote / Delhi NCR Experience: 2–5 years Reporting To: Product Lead, PLOT AI Division Role Overview We are building AI copilots for manufacturing execution through our twin platforms — ODIF (On Day In Full) for human performance and OSIF (One Shift In Full) for process intelligence. You will lead the LLM and AI agent layer — transforming PLOT’s massive structured data (WBS, 3TSOP, production, and compliance datasets) into interactive, queryable AI systems using LangChain and LangGraph frameworks. Key ResponsibilitiesFor ODIF (Human Performance AI) · Build an LLM-based Chat Engine using RAG ...

About the Role We are building a high-quality evaluation workforce to help train and improve next-generation AI systems. As an RLHF (Reinforcement Learning from Human Feedback) Evaluator , you will review, compare, and rate AI-generated responses to enhance model safety, reasoning, and overall performance. No coding required — strong reasoning and analytical skills are key. Responsibilities Compare multiple AI responses and select the better one based on clarity, accuracy, and reasoning quality. Evaluate outputs for safety, bias, fairness, toxicity , and policy alignment. Score responses using structured rubrics (numeric or categorical). Identify hallucinations, factual inaccuracies, and pol...

Role: AI Prompt Evaluator (Prompt Reviewer) — Remote (India) Role & Responsibilities Review and rate prompts and model outputs against detailed annotation guidelines to assess accuracy, relevance, safety, and alignment. Label content for toxicity, bias, hallucination, instruction-following, and factuality; flag edge cases and ambiguous prompts for escalation. Use annotation platforms to create high-quality training examples, maintain consistent labels, and meet productivity + accuracy targets. Provide constructive feedback to prompt engineers and data teams—document failure modes, suggest prompt modifications, and propose test cases. Participate in calibration sessions to ensure inter-annota...

Jaipur, Rajasthan, India Department Inspections Job posted on Dec 06, 2025 Employment type Permanent What You’ll Own : Leading a team of i1/i7 Evaluators and ensuring smooth inspection operations. Keeping track of inspection quality metrics, adherence to SOPs & customer experience standards. Training and upskilling evaluators regularly to improve inspection depth and accuracy. Responding to field-level evaluator queries on inspection, process,& app usage. Reviewing inspection reports, diagnosis accuracy, and feedback loops for continuous improvement. Driving consistency & accuracy in checkpoints, photos, videos & app data inputs. Coordinating with city operations team to improve different pa...

Jaipur, Rajasthan, India Department Inspections Job posted on Dec 06, 2025 Employment type Permanent What You’ll Own : Leading a team of i1/i7 Evaluators and ensuring smooth inspection operations. Keeping track of inspection quality metrics, adherence to SOPs & customer experience standards. Training and upskilling evaluators regularly to improve inspection depth and accuracy. Responding to field-level evaluator queries on inspection, process,& app usage. Reviewing inspection reports, diagnosis accuracy, and feedback loops for continuous improvement. Driving consistency & accuracy in checkpoints, photos, videos & app data inputs. Coordinating with city operations team to improve different pa...

with strong hands-on technician or mechanic experience. The ideal candidate will inspect cars at customer locations, perform detailed evaluations, and ensure accurate reporting. Driving license, field mobility, and prior OEM experience are mandatory. Roles & Responsibilities Conduct on-site car inspections at customer locations. Evaluate vehicle condition including engine, body, chassis, tires, and interiors. Perform test drives to assess mechanical health. Generate accurate evaluation reports. Communicate findings in basic English. Follow company guidelines for fair and consistent evaluations. Required Skills & Qualifications 4 6 years of experience as a technician/mechanic. Qualification: ...

Overview We are seeking individuals with high emotional intelligence, ideally with backgrounds in teaching, coaching, counseling, customer experience, or other people-focused roles, to join our team as Conversation Sentiment Evaluators. This role involves reviewing short AI–user conversations (typically 5–10 minutes per task) and determining whether the AI’s response met the user’s needs and emotional expectations. What You’ll Do • Review brief text-based conversations between users and an AI assistant. • Assess user sentiment: Were they satisfied, neutral, frustrated, confused, or disengaged? • Identify emotional cues, tone shifts, and contextual signals. • Provide clear, concise evaluation...

Job description Job Responsibilities : Technically evaluate the Cars/Old cars Submit a report for each Cars according to the defined process Estimate the repair work needed by the used Cars Estimate the market price of the Cars based on the inspection. We are looking for: Minimum 3 -10yrs of Relevant Experience (car driven skills+DL Mandatory) Experience in the after-sales with a trust Strong customer handling skills Industry Type: Automobile (Automobile Dealers) Department: Truevalue Employment Type: Full Time, Permanent Education UG: Any Graduate Key Skills Skills highlighted with ‘‘ are preferred keyskills interview venue-Address: B-64, Phase 7,2nd floor 11:00 am onwards Industrial Area, ...

Company Description Imperial Fragrances & Flavours Pvt Ltd, established in post-independence India, has been a pioneer in the fragrance and flavors industry for over 70 years. As leaders in fragrance export, the company serves manufacturers across seven categories in more than 20 countries. Driven by the vision to create olfactory memories and inspire daydreams, Imperial Fragrances bridges Eastern traditions and Western modernity. With a commitment to creativity and originality, the company strives to make the world a better place through its distinctive and innovative creations. Role Description The Trainee Evaluator will be responsible for supporting the fragrance evaluation process, analy...

Job description Job Responsibilities : Technically evaluate the Cars/Old cars Submit a report for each Cars according to the defined process Estimate the repair work needed by the used Cars Estimate the market price of the Cars based on the inspection. We are looking for: Minimum 3 -10yrs of Relevant Experience (car driven skills+DL Mandatory) Experience in the after-sales with a trust Strong customer handling skills Industry Type: Automobile (Automobile Dealers) Department: Truevalue Employment Type: Full Time, Permanent Education UG: Any Graduate Key Skills Skills highlighted with ‘‘ are preferred keyskills interview venue-Address: B-64, Phase 7,2nd floor 11:00 am onwards Industrial Area, ...

CXG is a global customer experience agency servicing premium and luxury brands. It helps brands reach profitable growth by turning transactional moments into relationships and emotional experiences. With a network of 170+ customer experience experts across 70 countries, we help brands evaluate the experiences they deliver, and work with them to develop programs that support a strong experience and business culture. Description Are you a premium or luxury brand shopper or fan? If the answer is yes, then we are looking for you? We are looking for shoppers who are keen on sharing their opinion about their experience in an assigned luxury store. As a CXG Evaluator, you will conduct discreet eval...

Gold Loan Evaluator, Watch live camera/webcam footage from branches to monitor gold-handling procedures. Check photos of sealed gold packets sent by branches. Confirm gold is packed, sealed, labeled, and stored correctly. Ensure workspace cleanliness and compliance with gold-handling rules

We are currently looking for long-term participants for our new project, MILKY WAY! During this Search Engine Evaluation project , participants will evaluate the quality of queries made by internet users while navigating through different MAP applications . The entries to evaluate will be of varied nature, from user intent to authentication of data accuracy. Purpose: Thanks to this project, we will help develop and optimize current and future map and geo-localization applications, to produce more accurate and intuitive maps in terms of location, search functions and more! Main requirements: · You are a native or fluent speaker of English · You are currently based in India , and you have been...

We are hiring multiple Car Evaluators for a major client dealing in used cars. Eligibility: Min. 4 years of exp. as Technician in OEM ITI / Diploma Degree Evaluate and identify issues in vehicle Age - Max. 35 years Must have Driving License Know how to drive 2 & 4-wheeler No Service Advisor and no Plant / Manufacturing based exp. Job Description: Leads will be assigned by concerned Team Leader Visit the customer's place to do the proper inspection of a car Click the images of the parts of the car and upload it on the app Ensuring the proper submission of reports on the app Estimate repair cost Strong knowledge of vehicle components such as chassis, panels, paint, engine, clutch, gearbox, bra...

We are looking for intellectually curious people, passionate about the bigger picture of how technology industry is evolving, ready to ask difficult questions and deal with complicated scenarios! If you are creative and a problem solver, this is the place to be as will be supporting you to fast-forward your career! We enhance each employee’s potential through personal development through a wide range of learning tools both formal and informal. LSEG is a leading global financial markets infrastructure and data provider. Our purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth. Our purpose is the foundation on which our culture is bui...

ABOUT SPINNY Spinny is India’s most trusted full-stack platform for buying and selling cars - backed by marquee investors including Tiger Global, Accel, Elevation Capital, ADQ and Westbridge Capital. Our mission is simple but ambitious: to bring trust, transparency, and delight back into the used car buying experience. With operations across 80+ cities and over a million customers served, we’re now entering our next phase of growth—scaling our platform, deepening customer engagement, and expanding our product ecosystem to cut across the car ownership spectrum. If you’re passionate about leading high-impact city operations, you’ll feel right at home! We operate through two key sales channels ...

Role: AI Prompt Evaluator (Prompt Reviewer) — Remote (India) Role & Responsibilities Review and rate prompts and model outputs against detailed annotation guidelines to assess accuracy, relevance, safety, and alignment. Label content for toxicity, bias, hallucination, instruction-following, and factuality; flag edge cases and ambiguous prompts for escalation. Use annotation platforms to create high-quality training examples, maintain consistent labels, and meet productivity + accuracy targets. Provide constructive feedback to prompt engineers and data teams—document failure modes, suggest prompt modifications, and propose test cases. Participate in calibration sessions to ensure inter-annota...

About Turing Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L Role Overview As a Software Enginee...

About Turing Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L Role Overview As a Software Enginee...

About Turing Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L Role Overview As a Software Enginee...

About Turing Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L Role Overview As a Software Enginee...

About Turing Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L Role Overview As a Software Enginee...