QA Automation Test Engineer- Python

Python Automation Test Engineer:

5-8yrs

Location: Hyderabad

Test generative AI solutions on AWS, validating LLMs, RAG, prompts, and agentic workflows with n8n and Python libraries like deepchecks, Ragas and LangChain.

Key Requirements (8 Points)

1. Test LLM outputs on AWS Bedrock using boto3.
2. Validate fine-tuned LLMs on AWS SageMaker with deepchecks.
3. Verify langchain prompts in AWS environments.
4. Test RAG pipelines with AWS OpenSearch and langchain.
5. Validate AI agents (crewai/autogen) on AWS Lambda/equivalent
6. Test n8n agentic workflows (e.g., n8n.io/workflows/6270).
7. Ensure deployment stability on Amazon ECS/EKS with Docker.
8. Monitor performance with Amazon CloudWatch and wandb.

Must-Have Skills

• 2 years testing GenAI/LLMs using Python
• 4+ years experience in QA Automation
• Expertise in AWS Bedrock, SageMaker, Lambda, boto3.
• Proficiency in deepchecks, langchain, crewai, autogen, wandb.
• Experience testing n8n workflows, RAG, prompts.