Architect II - Software Testing

12 - 15 years

5 Lacs

Posted:3 days ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

Role Proficiency:

Leverage specialist testing knowledge to define and implement testing best practices and environment strategy for an enterprise

Outcomes:

  1. Participate in test maturity assessments
  2. Conduct evaluation of new/emerging tools and frameworks
  3. Implement Best Practices Guidelines and Methodologies
  4. Analyse Patterns of Issues in projects and propose solutions
  5. Develop Test Data and Environment Strategy for an Enterprise
  6. Implement Test Reporting Frameworks

Measures of Outcomes:

  1. Test Coverage
  2. Test Automation Coverage
  3. Savings from Optimization
  4. Savings from Automation
  5. Defect Removal efficiency
  6. No: of Kaizens initiated and implemented
  7. Cost savings for the customer
  8. Cost saving from carrying out Test Optimization exercise
  9. Continuous service improvements

Outputs Expected:

Test Strategy:

  1. Define and implement test strategy
  2. Define and baseline tool strategies
  3. Define and document test environment and test data strategies
  4. Perform feasibility study for recommended solutions


Knowledge Management:

  1. Publish best practices and guidelines
    standardswhite paperetc.


Test Reporting:

  1. Conduct cost benefit analysis


Test DesignDevelopmentExecution:

  1. Create strategies for test optimization
  2. Carry out gap analysis and identify improvement areas
  3. Identify program goals and define KPI's and SLA's
  4. Identify and implement industry wide best practices


Test Planning:

  1. Perform test maturity assessments
    provide recommendations and define roadmaps
  2. Identify candidate for automation by prioritization

Skill Examples:

  1. Ability to define test strategies
  2. Ability to manage and evaluate the test tools and frameworks
  3. Ability to Create re-usable assets
  4. Ability to identify test practice gaps and provide recommendations
  5. Ability to perform test maturity assessments
  6. Ability to define service improvement roadmaps

Knowledge Examples:

  • Knowledge of Automation Techniques
    1. Knowledge of Testing methodologies
    2. Knowledge of Test Automation tools and frameworks
    3. Knowledge of Automation ROI analysis
    4. Knowledge of industry wide KPI's
    5. Knowledge of Test Data and Test Env requirement identification

    Additional Comments:

    Job Title: GenAI Testing Automation Expert Job Overview: We are seeking a skilled GenAI Testing Automation Expert to lead the design, development, and execution of automated testing frameworks for Generative AI systems. The role involves working with LLMs, AI agents, and automation tools to ensure robust, scalable, and reliable testing processes. Key Responsibilities: Design and implement automated test suites for GenAI models and workflows Develop and run structured test cases, including unit, integration, and SIT test cases Evaluate GenAI outputs using contextual comparison methodologies and validation metrics Collaborate with development teams to integrate testing into CI/CD pipelines Use tools like LangChain, AgentGPT, SageMaker, and custom APIs for automation Analyze test results and provide actionable insights for model improvement Maintain documentation for test frameworks and ensure compliance with data standards Required Skills & Qualifications: 3-5 years of experience in automation testing, preferably with AI/ML systems Proficiency in Python and automation frameworks Experience with GenAI platforms (e.g., OpenAI, Amazon SageMaker, LangChain) Strong understanding of LLM behavior, prompt engineering, and evaluation techniques Familiarity with APIs, cloud platforms, and version control tools Excellent problem-solving and communication skills


Required Skills

Test Automation,Test Automation Framework,Building Automation

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
UST logo
UST

IT Services and IT Consulting

Aliso Viejo CA

RecommendedJobs for You