AI Tester Experience(python/JavaScript)

We are hiring for AI Tester

Experience: 3 to 5 Years

Job Type: Full-Time

Location: Noida (Hybrid Working Model)

Roles & Responsibilities:

1. AI & LLM Evaluation:

● Design and execute evaluation strategies for Large Language Models (LLMs), focusing on metrics like Accuracy, Hallucination, Tone, and Relevance.

● Identify and document AI-specific defects.

2. Automation & Scripting:

● Develop and maintain automated test scripts using Python or JavaScript/TypeScript to validateAI pipelines.

● Utilize tools like Playwright or Selenium for UI testing of AI-integrated web applications API & Integration Testing:

● Perform robust API testing using Postman or programmatic methods (Rest Assured/Python Requests) to validate AI model endpoints.

● Ensure efficient token usage, latency standards, and proper error handling in API responses.

4. CI/CD & DevOps Integration:

● Integrate automated AI evaluation suites into Jenkins pipelines for continuous testing.

● Analyze logs and metrics using tools like CloudWatch or Datadog to identify performance bottlenecks

Skills:

● AI/LLM Exposure: Practical understanding of Generative AI concepts, Prompt Engineering, and

LLM Evaluation techniques (RAG, Fine-tuning concepts).

● Programming: Hands-on experience with Python (highly preferred for AI tasks) or

JavaScript/TypeScript.

● API Testing: Proficient in Postman (creating collections, assertions) and testing RESTful APIs.

● Core QA Tools: Experience with Git for version control, Jira for defect tracking, and Jenkins for CI/CD.

● Data Handling: Comfortable working with JSON/JSONL formats and handling data for test scenarios.

Desired Skills:

● Familiarity with AI Evaluation frameworks like DeepEval, Ragas.

● Experience with cloud platforms (AWS: EC2, Lambda, S3) for setting up test environments.

● Knowledge of Docker basics for containerized testing.

● Basic understanding of Performance Testing tools (JMeter/k6).

interested candidates share cv on hr@resolink.in

Job Type: Full-time

Pay: ₹500,000.00 - ₹2,000,000.00 per year

Benefits:

• Flexible schedule
• Health insurance

Education:

• Bachelor's (Preferred)

Experience:

• AI Tester: 3 years (Required)
• AWS: 1 year (Required)
• JavaScript: 1 year (Required)
• Python: 1 year (Required)
• APIs: 1 year (Required)
• CI/CD: 1 year (Required)

Work Location: In person