Test Architect

Test Architect Technical Lead 2 -Immediate joiners only

12+ years

Bangalore -WFO only 5 days.

Please don&apost apply high ctc candidates. We have Budget.

Note candidate need to have AI LLMs, Azure DevOps, Knowledge on C#, Test Automation.

1. Perform functional, performance, and security testing on cloud-native services deployed on Microsoft Azure.
2. Design and implement automated test suites for APIs, service components, and AI pipelines.
3. Automate the evaluation of AI system outputs to ensure accuracy, consistency, and safety of responses.
4. Collaborate with developers and data scientists to establish service-level quality metrics and observability hooks.
5. Validate services against AI regulatory frameworks and ensure traceability, fairness, and robustness in outcomes.
6. Participate in threat modelling and security validation of exposed APIs and AI services.
7. Provide feedback early in the lifecycle to reduce defects and improve design.
8. Mentor junior testers, encourage continuous learning, and contribute to a culture of innovation.

9. AI & Cloud Expertise

• Familiarity with LLM evaluation techniques, output scoring, and validation frameworks.
• Understanding of key concepts such as prompt engineering, RAG, model orchestration, and hallucination detection.
• Experience in testing for accuracy, relevance, and consistency of AI model predictions/generations
• Defining Performance Metrics for AI services and testing for the same
• Awareness of AI safety, bias detection, and explainability techniques.
• Experience ensuring compliance with AI regulations and standards (e.g., NIST AI RMF, EU AI Act).
• Strong belief in ethical AI practices, transparency, and end-user
• What we are looking for:
• 12+ years of experience in software testing, QA, or validation roles for cloud-native applications using Microsoft and .NET technologies.
• Proficient in designing automated testing frameworks
• Hands-on experience with Azure DevOps, CI/CD pipelines, and containerized test environments.
• Strong understanding of API testing, performance profiling, and security testing (including OWASP top 10).
• Excellent problem-solving skills, with the ability to analyse complex technical challenges and propose scalable solutions.
• Experience working in Agile teams and collaborating across global R&D locations
• Demonstrated ability to mentor junior team members fostering a culture of continuous learning and innovation

Note candidate need to have AI LLMs, Azure DevOps, Knowledge on C#, Test Automation.

About The Client:

How to Apply:

About VARITE:

Equal Opportunity Employer:

Unlock Rewards: Refer Candidates and Earn.

If you&aposre not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you&aposll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.

Exp Req

0 - 2 Yrs. - INR 5,000

2 - 6 Yrs. - INR 7,500

6 + Yrs. - INR 10,000