Python Automation - Gen AI + Pytest

HEXAWARE looking for Gen AI + Pytest - Python Automation

Experience - Min 9 yrs in Python Automation

Notice - Immediate to 30 Days

Role Summary

testing and validating agentic and generative AI solutions

Key Responsibilities

• Test Planning & Execution

  : Design and run test plans for AI models and agentic workflows.

• Automation

  : Build PyTest-based automated tests to validate model behavior (accuracy, latency, consistency).

• Model Evaluation

  : Use metrics like BLEU, ROUGE, and domain-specific benchmarks to assess LLM/GenAI outputs.

• Fine-Tuning Validation

  : Validate LoRA, QLoRA, PEFT results and improvements in inference pipelines.

• GPU Performance Monitoring

  : Analyze throughput, latency, and memory usage to detect regressions.

• Collaboration

  : Work with AI engineers to define quality gates for deployment readiness.

• Documentation

  : Report validation results and optimization recommendations.

Required Skills & Qualifications

• Programming

  : Strong Python skills; experience with PyTest.

• AI Testing Experience

  : Familiarity with NVIDIA platforms (NIM, Triton, Nemo).

• Evaluation Metrics

  : BLEU, ROUGE, perplexity, latency, throughput.

• GPU Profiling

  : Understanding of performance metrics and model quantization.

• Agentic AI Knowledge

  : Prompt validation, vector databases, agentic workflows.

• Soft Skills

  : Analytical, detail-oriented, collaborative, and adaptable to evolving tech.

Technology Stack

• NVIDIA AI Stack

  : NIM, Triton Inference Server, Nemo Framework.

• Programming

  : Python.

• Testing Framework

  : PyTest.

Ideal Candidate Profile

Someone with:

• Hands-on experience in

  AI model validation

  and

  GPU performance analysis

  .
• Strong Python automation skills.
• Familiarity with

  LLM fine-tuning techniques

  and

  agentic AI evaluation

  .
• Ability to work in a fast-paced, evolving AI environment.

Interested Candidates can share their profile to MichaelJacksonA@hexaware.com mentioning "Python Automation"