Posted:3 days ago|
Platform:
Work from Office
Full Time
Role Proficiency:
Leverage specialist testing knowledge to define and implement testing best practices and environment strategy for an enterprise
Outcomes:
Measures of Outcomes:
Outputs Expected:
Test Strategy:
Knowledge Management:
Test Reporting:
Test DesignDevelopmentExecution:
Test Planning:
Skill Examples:
Knowledge Examples:
Job Title: GenAI Testing Automation Expert Job Overview: We are seeking a skilled GenAI Testing Automation Expert to lead the design, development, and execution of automated testing frameworks for Generative AI systems. The role involves working with LLMs, AI agents, and automation tools to ensure robust, scalable, and reliable testing processes. Key Responsibilities: Design and implement automated test suites for GenAI models and workflows Develop and run structured test cases, including unit, integration, and SIT test cases Evaluate GenAI outputs using contextual comparison methodologies and validation metrics Collaborate with development teams to integrate testing into CI/CD pipelines Use tools like LangChain, AgentGPT, SageMaker, and custom APIs for automation Analyze test results and provide actionable insights for model improvement Maintain documentation for test frameworks and ensure compliance with data standards Required Skills & Qualifications: 3-5 years of experience in automation testing, preferably with AI/ML systems Proficiency in Python and automation frameworks Experience with GenAI platforms (e.g., OpenAI, Amazon SageMaker, LangChain) Strong understanding of LLM behavior, prompt engineering, and evaluation techniques Familiarity with APIs, cloud platforms, and version control tools Excellent problem-solving and communication skills
Test Automation,Test Automation Framework,Building Automation
UST
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Practice Python coding challenges to boost your skills
Start Practicing Python Nowbengaluru
5.0 - 5.5 Lacs P.A.
pune, maharashtra
Salary: Not disclosed
thiruvananthapuram, kerala
Salary: Not disclosed
Trivandrum, Kerala, India
Salary: Not disclosed
Thiruvananthapuram
0.5 - 0.6 Lacs P.A.
20.0 - 25.0 Lacs P.A.
bengaluru
15.0 - 20.0 Lacs P.A.
bengaluru
30.0 - 45.0 Lacs P.A.
bengaluru
7.0 - 17.0 Lacs P.A.
hyderabad, chennai, mumbai (all areas)
30.0 - 45.0 Lacs P.A.