13 Ragas Jobs

Overview Senior Engineer Data Scientist - AI & Machine Learning Responsibilities include: End-to-End Model Development: Lead the entire lifecycle of machine learning projects, from data acquisition and feature engineering to model training, validation, deployment, and monitoring in a cloud environment. Generative AI Innovation: Architect and implement advanced Generative AI solutions. This includes developing and fine-tuning Large Language Models (LLMs), building robust Retrieval-Augmented Generation (RAG) and Multi-Modal RAG pipelines to ground models in factual data. AI System Evaluation: Design and implement comprehensive evaluation frameworks to measure the performance, fairness, and saf...

About the Role: We are seeking a highly skilled and principled Responsible AI Evaluator to assess, audit, and ensure the ethical development and deployment of AI models across the enterprise. This role spans traditional ML models, Large Language Models (LLMs), and Generative AI systems, with a strong focus on fairness, transparency, privacy, security, and accountability across multi-cloud environments (AWS, Azure, GCP, etc.). The ideal candidate combines deep technical expertise with a firm grasp of ethical frameworks, regulatory requirements, and responsible AI principles. Key Responsibilities: Model Evaluation & Auditing Evaluate AI/ML, LLM, and GenAI models for bias, fairness, explainabil...

About The Role We are seeking a highly skilled and principled Responsible AI Evaluator to assess, audit, and ensure the ethical development and deployment of AI models across the enterprise. This role spans traditional ML models, Large Language Models (LLMs), and Generative AI systems, with a strong focus on fairness, transparency, privacy, security, and accountability across multi-cloud environments (AWS, Azure, GCP, etc.). The ideal candidate combines deep technical expertise with a firm grasp of ethical frameworks, regulatory requirements, and responsible AI principles. Key Responsibilities Model Evaluation & Auditing Evaluate AI/ML, LLM, and GenAI models for bias, fairness, explainabilit...

As a Quality Engineer for AI Platform Testing, your role involves contributing to the testing processes of AI-based applications and platforms. You will be responsible for creating and maintaining comprehensive test cases, developing automated test frameworks, and performing various types of testing to ensure software quality. Your collaboration with development and product teams is crucial to achieve testing coverage at all stages of development. Additionally, your expertise in tools like RAGA'S, DeepEval, Lang chain, Postman, VS Code, Cucumber, and Node.js will be valuable for enhancing test automation pipelines. Key Responsibilities: - Create and maintain comprehensive test cases for web ...

As a Software Quality Assurance (SQA) Engineer at Boston Scientific, you will have the opportunity to work at the forefront of innovation in AI/ML products, transforming healthcare and delivering cutting-edge solutions. Your role will involve ensuring the reliability and usability of AI-driven features, guaranteeing safe, accurate, and coherent outcomes from machine learning models and LLM pipelines. **Key Responsibilities:** - Develop and execute comprehensive test plans for AI/ML features like chatbots, recommendation engines, RAG search, and copilots. - Design and maintain automation frameworks (Selenium, Cypress, Playwright, PyTest) for UI, API, and model-level testing. - Implement evalu...

What This Role Requires In this role, You will be a key contributor to MResults mission of empowering our clients with data-driven insights and innovative digital solutions. Each day brings exciting challenges and growth opportunities. Key Skills to Succeed in This Role: • Bachelor's degree in computer science, engineering, or a related field; advanced degree preferred. • 3+ years of experience in the IT domain, with a focus on Quality Assurance. • Experience with Test Planning, Test Case Design, and Defect Reporting Driving Innovation, Empowering Insights • Experience with NLP & Conversation Testing • Experience with LLM-Specific Testing (OpenAI/GPT/RAG) • Experience with Automation Skills ...

What This Role Requires In this role, You will be a key contributor to MResults mission of empowering our clients with data-driven insights and innovative digital solutions. Each day brings exciting challenges and growth opportunities. Key Skills to Succeed in This Role: • Bachelor's degree in computer science, engineering, or a related field; advanced degree preferred. • 5+ years of experience in the IT domain, with a focus on Quality Assurance. • Experience in leading a team and the project • Experience with Test Planning, Test Case Design, and Defect Reporting Driving Innovation, Empowering Insights • Experience with NLP & Conversation Testing • Experience with LLM-Specific Testing (OpenA...

You will be responsible for building curated enterprise-grade solutions for GenAI application deployment at a production scale for clients. This role demands a solid understanding and hands-on skills in GenAI application deployment, encompassing development and engineering skills. You will need to possess expertise in data ingestion, selecting the appropriate LLMs, implementing simple and advanced RAG, guardrails, prompt engineering for optimization, traceability, security, LLM evaluation, observability, and deployment at scale on cloud or on-premise. It is essential for candidates to demonstrate knowledge of agentic AI frameworks due to the rapid evolution of this space. Strong background i...

You will be responsible for building curated enterprise-grade solutions for GenAI application deployment at a production scale for clients. Your role will involve a solid understanding and hands-on skills for GenAI application deployment, which includes development and engineering tasks. This will include data ingestion, selecting suitable LLMs, implementing simple and advanced RAG, setting up guardrails, prompt engineering for optimization, ensuring traceability and security, evaluating LLMs, enabling observability, and deploying at scale on the cloud or on-premise. It is crucial that candidates also showcase knowledge on agentic AI frameworks, with a preference for those having a strong ba...

Responsibilities: * Collaborate with dev team on API testing using GIT and CI/CD pipeline. * Develop automated tests with Python, PyTest, and frameworks.

Tech stack required: Programming languages: Python Public Cloud: AzureFrameworks: Vector Databases such as Milvus, Qdrant/ ChromaDB, or usage of CosmosDB or MongoDB as Vector stores. Knowledge of AI Orchestration, AI evaluation and Observability Tools. Knowledge of Guardrails strategy for LLM. Knowledge on Arize or any other ML/LLM observability tool. Experience: Experience in building functional platforms using ML, CV, LLM platforms. Experience in evaluating and monitoring AI platforms in production Nice to have requirements to the candidate Excellent communication skills, both written and verbal. Strong problem-solving and critical-thinking abilities. Effective leadership and mentoring ski...

Role & responsibilities We are seeking a highly skilled QA Automation Engineer with 3-5 years of experience in software development, SDET, or QA automation, with a strong focus on backend systems, APIs, or complex data pipelines. This role demands deep expertise in Python programming and a strong understanding of automation tools, CI/CD processes, and API testingparticularly within evolving AI-driven environments. Design, implement, and maintain robust automation frameworks using Python (Pytest or similar). Conduct thorough testing of backend systems , data pipelines, and RESTful APIs . Build test cases and scripts to support automated validation of AI-integrated services. Use tools like Pos...

Key Skills: Bachelor's degree in computer science, engineering, or a related field; advanced degree preferred. 3+ years of experience in the IT domain, with a focus on Quality Assurance. Experience with Test Planning, Test Case Design, and Defect Reporting. Experience with NLP & Conversation Testing. Experience with LLM-Specific Testing (OpenAI/GPT/RAG). Experience with Automation Skills (Good to Have/Additional Skills). Experience with RAGAS or LangSmith for response quality scoring. Experience with Performance testing using JMeter. Experience with automation scripting (Python preferred for GenAI validation, Java for Selenium UI). Skills in observability tools, log tracing.