Job
Description
Job Summary Professional skilled in evaluating and assessing the performance, accuracy, and safety of AI systems that generate content autonomously. They ensure these systems function as intended and avoid generating undesirable or harmful outputs, including bias, hallucinations, or privacy violations. GenAI testers utilize various techniques, including functional testing, adversarial testing, and bias testing, to identify and address potential issues in AI powered systems. Job Title: GenAI Tester Working Hours: 2 PM to 11 PM IST Location-Bangalore/Pune/Hyderabad Job Description: We are seeking a dedicated and detail-oriented GenAI Azure Chatbot Tester to join our team. The ideal candidate will be responsible for ensuring the quality and performance of our Azure-based chatbot solutions. This role requires a strong understanding of AI technologies, excellent problem-solving skills, and the ability to work collaboratively in a fast-paced environment. Key Responsibilities: Testing and Validation: Conduct comprehensive testing of Azure-based chatbot solutions to ensure functionality, performance, and reliability. Develop and execute test cases, scripts, plans, and procedures (manual and automated). Identify, document, and track defects and inconsistencies in chatbot behavior. Perform prompt-based testing to evaluate the chatbot's responses to various user inputs and scenarios. Quality Assurance: Ensure that the chatbot meets all specified requirements and standards. Perform regression testing to verify that new code changes do not adversely affect existing functionalities. Collaborate with developers to resolve issues and improve chatbot performance. User Experience Testing: Evaluate the chatbot's user interface and user experience. Provide feedback on conversational flow, response accuracy, and overall user satisfaction. Suggest improvements to enhance user engagement and interaction. Performance Monitoring: Monitor chatbot performance metrics and analyze data to identify areas for improvement. Conduct load testing to ensure the chatbot can handle high volumes of interactions. Report on performance trends and recommend optimizations. Documentation and Reporting: Maintain detailed documentation of test cases, test results, and defect reports. Prepare and present test reports to stakeholders. Ensure all testing activities are well-documented and traceable. Collaboration and Support: Work closely with cross-functional teams, including developers, product managers, and customer support. Provide support during the deployment and post-deployment phases. Participate in team meetings and contribute to project planning and review sessions. Qualifications: Proven experience in software testing, preferably with AI or chatbot technologies. Strong knowledge of Azure services and tools. Proficiency in test automation tools and frameworks. Excellent analytical and problem-solving skills. Strong communication and collaboration abilities. Ability to work independently and manage multiple tasks simultaneously. Flexibility to work from 2 PM to 11 PM IST. Preferred Skills: Experience with natural language processing (NLP) and machine learning (ML). Familiarity with Agile methodologies. Knowledge of scripting languages such as Python or JavaScript. Show more Show less
