Sr. Python GenAI Tester (AWS Stack)

Job Title: Sr. Python GenAi Tester (AWS Stack)

Experience: 5+ Years

Location: Hyderabad (Hybrid)

Share your cv to

[HIDDEN TEXT]

Job Summary

Key Requirements (8 Points)

• Test LLM outputs on AWS Bedrock using boto3.
• Validate fine-tuned LLMs on AWS SageMaker with deepchecks.
• Verify langchain prompts in AWS environments.
• Test RAG pipelines with AWS OpenSearch and langchain.
• Validate AI agents (crewai/autogen) on AWS Lambda.
• Test n8n agentic workflows (e.g., n8n.io/workflows/6270).
• Ensure deployment stability on Amazon ECS/EKS with Docker.
• Monitor performance with Amazon CloudWatch and wandb.
  

Must-Have Skills

• 5+ years of QA automation, 2 years testing GenAI/LLMs using Python
• Expertise in AWS Bedrock, SageMaker, Lambda, boto3.
• Proficiency in deepchecks, langchain, crewai, autogen, wandb.
• Experience testing n8n workflows, RAG, prompts.
  

Preferred Skills

• AWS certification (Machine Learning/Solutions Architect).
• Familiarity with llama-index, n8n templates