Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in bengaluru
>
Amazon
>
AI Benchmarking Specialist

AI Benchmarking Specialist

Amazon

0 - 6 years

4 - 5 Lacs

bengaluru

Posted:11 hours ago| Platform:

Apply

Skills Required

training root cause analysis automation manager quality assurance french audit documentation artificial intelligence continuous improvement quality compliance recruitment

Work Mode

Work from Office

Job Type

Full Time

Job Description

The Seller AI team within International Seller Services organization is focused on helping sellers with the right set of Gen-AI/LLM powered tools and agentic solutions that can enable them to accelerate business growth on Amazon. Our primary focus lies in handling annotations for training, measuring, and improving Artificial Intelligence (AI) and Large Language Models (LLMs), enabling Amazon to deliver a superior seller experience to our sellers worldwide. The AI Benchmarking Associate supports the evaluation of AI systems by designing and executing benchmarking and audit activities to assess model quality, compliance, robustness, and fairness. The role combines elements of AI auditing, quality assurance, and traditional audit-style documentation and stakeholder communication. By joining us, you will play a pivotal role in shaping the future of selling on Amazon for sellers worldwide.
As part of your role, you will have the opportunity to, Assist in planning and executing benchmarking exercises for AI models, including defining test plans, metrics, and acceptance criteria across accuracy, robustness, bias, and reliability. Support content accuracy, relevancy, and privacy checks by reviewing datasets, model outputs, and data handling practices, escalating potential regulatory risks. Vali data based on specific annotation guidelines, ensuring the accuracy and quality of the collected information Prepare clear audit and benchmarking reports, including error ratings, root-cause analysis, and recommendations, and contribute to presentations for senior stakeholders. Maintain organized audit documentation, evidence, and benchmarking datasets to support internal review You will work closely with your team members and managers to drive process efficiencies and explore opportunities for automation You will strive to enhance the productivity and effectiveness of the data generation by contributing to the development and continuous improvement of AI audit methodologies, checklists, and test frameworks as regulations and best practices evolve

More Jobs at Amazon

Amazon AWS - Delivery Consultant (Migrations)

Pune, Bengaluru

7 - 12 yrs

INR 20 - 35 Lacs

ML Data Associate

Chennai

Experience: Not specified

INR 2 - 4 Lacs

Amazon Customer Support Role - VCS-Work From Home - West Bengal

Kolkata

Experience: Not specified

INR 3 - 3 Lacs

Amazon Customer Support Role - VCS-Work From Home - Uttar Pradesh

Ghaziabad

Experience: Not specified

INR 3 - 4 Lacs

Salesforce Developer, DSP Tech, Last Mile

Hyderabad, Telangana, India

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Artificial Intelligence Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

Amazon

Software Development

Seattle WA

Login to

Please Verify Your Phone or Email

Confirm Action

AI Benchmarking Specialist