Gen AI Testing Professional

7 - 12 years

12 - 16 Lacs

Posted:3 hours ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

  • Design and execute test strategies for Gen AI models including LLMs image generators and multimodal systems
  • Create and maintain test cases and prompt libraries to evaluate model output quality eg relevance coherence creativity factual accuracy
  • Test model behaviour across different scenarios languages and user intents eg hallucinations bias toxicity safety risks
  • Perform manual and automated testing of Gen AI APIs chatbots and content generation tools
  • Validate input output behaviour prompt testing response evaluation token level analysis
  • Collaborate with engineering teams to implement prompt evaluation frameworks log monitoring and output scoring systems
  • Track model performance metrics BLEU ROUGE perplexity toxicity score etc and suggest areas for improvement
  • Conduct fairness bias and safety testing to ensure compliance with ethical and regulatory guidelines
  • Assist in evaluating AB experiments and fine tuning model behaviours
  • Document issues clearly and contribute to root cause analysis with dev teams
  • Mock Interview

    Practice Video Interview with JobPe AI

    Start Job-Specific Interview
    cta

    Start Your Job Search Today

    Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

    Job Application AI Bot

    Job Application AI Bot

    Apply to 20+ Portals in one click

    Download Now

    Download the Mobile App

    Instantly access job listings, apply easily, and track applications.

    coding practice

    Enhance Your Skills

    Practice coding challenges to boost your skills

    Start Practicing Now
    Virtusa logo
    Virtusa

    Information Technology and Services

    Southborough

    RecommendedJobs for You