Job
Description
Role: QA - LLM Engineer / QA Architect Experience: 9 to 15 years Location: Chennai or Bangalore or Hyderabad or Pune or Nagpur Notice: Immediate to 2 weeks Fulltime Job Summary: At Perficient QA LMM Engineer is a technical role that demands creativity and innovation to design effective strategies for testing software products. This position involves developing, executing, and debugging automated test scripts, with a strong focus on prompt engineering, output quality evaluation, and AI-driven implementations. The ideal candidate excels at leading cross-functional teams and translating large language model (LLM) concepts into practical, business-aligned strategies. Required Skills: Proven experience in QA and Testing projects within agile development environments. Strong background in Functional, Regression, Integration, and System Testing. Proficiency in Python and APIs to develop and integrate open-source libraries into unit and integration tests. Hands-on experience with test automation projects using tools such as Postman, Selenium, Cypress, JavaScript, TypeScript, Playwright, JMeter, etc. Solid understanding of Natural Language Processing (NLP) and Large Language Models (LLMs), including architecture knowledge (e.g., GPT) and experience with related toolsets (e.g., OpenAI API). Expertise in using data manipulation libraries to integrate data preprocessing and ingestion workflows into LLM evaluation pipelines. Experience in prompt engineering with focus on evaluating output quality, prompt response structure, metadata, and consistency across diverse use cases. Proven track record of testing and evaluating chatbots and conversational AI products. Familiarity with ethical AI principles, bias mitigation, and responsible model evaluation. Excellent communication skills with the ability to work across cross-functional teams and sharing insights and strategies related to LLMs. If interested, please fill the basic details. Current Location: Preferred Location: Years of Experience Current CTC: Expected CTC: Contact No: Email id: Recent Employer: Notice Period: Graduated Year: Thanks, Prakash Morasa Prakash.Morasa@Perficient.Com
