AI Evaluation Analyst

Ema Unlimited

1 - 3 years

3 - 5 Lacs

bengaluru

Posted:16 hours ago| Platform:

Apply

Skills Required

product quality usage artificial intelligence psychology automation tools linguistics genetics qa testing research testing

Work Mode

Work from Office

Job Type

Full Time

Job Description

About Ema:

Ema is at the forefront of artificial intelligence research and application, dedicated to creating cutting-edge AI solutions that empower users globally. Join our dynamic team to help shape the future of AI technology.

Responsibilities:

Create Enterprise AI Model Evaluation Test Sets:
Develop and maintain comprehensive test sets tailored for various enterprise use cases.
Evaluate AI Models:
Assess different versions, personas, and prompts of Ema on multiple quality parameters. Ensure new features and updates meet established standards before launch.
Generate AI Evaluation Reports:
Compile detailed evaluation reports that provide insights for improving persona setups and Emas AI models.
Test UX Flows:
Evaluate the efficacy and usability of auxiliary user experience flows to ensure seamless end-to-end GenAI usage for Ema-s users.
Automate Testing Flows:
Develop and implement scripts and browser automation tools to streamline testing processes. Enhance testing velocity and early issue detection to improve overall product quality.

Requirements:

Educational Background:
Bachelor-s degree required. Degrees in engineering, linguistics, or psychology preferred.
Communication Skills:
Strong verbal and written English communication skills are essential.
Professional Experience:
1-3 years of prior professional experience. Experience in content creation, QA testing, prompt engineering, or editing is preferred.

Benefits:

Stay at the cutting edge of GenAI research, guided and coached by top researchers in the field.
Learn best practices for solving user problems with GenAI products.
Collaborate across cross-functional teams to effectively achieve customer impact.

More Jobs at Ema Unlimited

Partner Success Architect

Bengaluru

5.0 - 10.0 yrs

INR 7 - 12 Lacs

GenAI Field Architect, Customer Value Engineering

Bengaluru

8.0 - 13.0 yrs

INR 10 - 15 Lacs

Staff Machine Learning Engineer

Bengaluru

8.0 - 13.0 yrs

INR 4 - 8 Lacs

Web Developer

Bengaluru, Karnataka, India

3.0 - 3.0 yrs

Salary: Not disclosed

Product Manager - India

Bengaluru, Karnataka, India

6.0 - 6.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Artificial Intelligence Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.