AI Tester Experience(python/JavaScript)

3 - 5 years

5 - 20 Lacs

Posted:16 hours ago| Platform: GlassDoor logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

We are hiring for AI Tester

Experience: 3 to 5 Years

Job Type: Full-Time

Location: Noida (Hybrid Working Model)

Roles & Responsibilities:

1. AI & LLM Evaluation:

● Design and execute evaluation strategies for Large Language Models (LLMs), focusing on metrics like Accuracy, Hallucination, Tone, and Relevance.

● Identify and document AI-specific defects.

2. Automation & Scripting:

● Develop and maintain automated test scripts using Python or JavaScript/TypeScript to validateAI pipelines.

● Utilize tools like Playwright or Selenium for UI testing of AI-integrated web applications API & Integration Testing:

● Perform robust API testing using Postman or programmatic methods (Rest Assured/Python Requests) to validate AI model endpoints.

● Ensure efficient token usage, latency standards, and proper error handling in API responses.

4. CI/CD & DevOps Integration:

● Integrate automated AI evaluation suites into Jenkins pipelines for continuous testing.

● Analyze logs and metrics using tools like CloudWatch or Datadog to identify performance bottlenecks

Skills:

● AI/LLM Exposure: Practical understanding of Generative AI concepts, Prompt Engineering, and

LLM Evaluation techniques (RAG, Fine-tuning concepts).

● Programming: Hands-on experience with Python (highly preferred for AI tasks) or

JavaScript/TypeScript.

● API Testing: Proficient in Postman (creating collections, assertions) and testing RESTful APIs.

● Core QA Tools: Experience with Git for version control, Jira for defect tracking, and Jenkins for CI/CD.

● Data Handling: Comfortable working with JSON/JSONL formats and handling data for test scenarios.

Desired Skills:

● Familiarity with AI Evaluation frameworks like DeepEval, Ragas.

● Experience with cloud platforms (AWS: EC2, Lambda, S3) for setting up test environments.

● Knowledge of Docker basics for containerized testing.

● Basic understanding of Performance Testing tools (JMeter/k6).

interested candidates share cv on hr@resolink.in

Job Type: Full-time

Pay: ₹500,000.00 - ₹2,000,000.00 per year

Benefits:

  • Flexible schedule
  • Health insurance

Education:

  • Bachelor's (Preferred)

Experience:

  • AI Tester: 3 years (Required)
  • AWS: 1 year (Required)
  • JavaScript: 1 year (Required)
  • Python: 1 year (Required)
  • APIs: 1 year (Required)
  • CI/CD: 1 year (Required)

Work Location: In person

Mock Interview

Practice Video Interview with JobPe AI

Start JavaScript Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Javascript Skills

Practice Javascript coding challenges to boost your skills

Start Practicing Javascript Now

RecommendedJobs for You