2.0 - 6.0 years

0 Lacs

telangana

On-site

As a detail-oriented Generative AI Tester with 3+ years / 6+ years of experience, your primary responsibility will be to validate the quality, reliability, and ethical outputs of AI systems powered by large language models (LLMs). In this role, you will focus on testing prompt responses, evaluating edge cases, and ensuring that AI outputs align with business and compliance standards. Your key responsibilities will include designing and executing test cases for Gen AI features and conversational workflows, validating the outputs of LLMs for accuracy, relevance, coherence, and safety, conducting prompt testing, fine-tuning evaluation, and edge-case scenario validation. You will also collaborate with AI engineers, product managers, and QA teams to improve test coverage and feedback loops, document defects, issues, and improvement areas using tools like JIRA or similar, and evaluate AI systems against ethical and fairness benchmarks. To be successful in this role, you should have at least 2+ years of experience in QA/testing, with exposure to AI/ML or NLP systems. It is essential to be familiar with LLMs such as GPT, Claude, or open-source alternatives, possess strong analytical and critical thinking skills for non-deterministic system testing, have experience with test management tools and basic scripting (Python preferred), and a good understanding of prompt engineering and model evaluation principles. Preferred qualifications include experience in testing conversational AI, chatbots, or virtual assistants, an understanding of responsible AI practices including bias and hallucination detection, and exposure to RAG (Retrieval-Augmented Generation) pipelines and vector databases.,

Posted 1 month ago

Apply

SENIOR DATA SCIENTIST (DEEP LEARNING/NLP) Augusta Infotech

5.0 - 9.0 years

0 Lacs

maharashtra

On-site

As a Senior Data Scientist with expertise in Deep Learning and NLP, you will be responsible for researching, designing, and developing core Artificial Intelligence (AI) and Machine Learning (ML) algorithms. Your essential skills will include working experience with various AI frameworks, such as CRFs, BERT/Transformers, and text summarization models. You should have past experience in Entity Detection and Disambiguation, Intent Detection, and deploying machine learning models in a production environment using tools like TensorFlow Serving. Your role will involve collaborating with functional domain experts, implementation teams, and AI backend teams to ensure efficient product development, production release, and development cycles. It is crucial to stay updated with the latest AI developments, including training libraries/frameworks, Reinforcement Learning, and Deep Learning, by reading and researching state-of-the-art papers in NLU problems. You will work with large datasets of support tickets and unstructured data sources, building Deep Learning models in TensorFlow for GPUs and CPUs. Additionally, collaborating with Backend Engineers to deploy your models to production will be part of your responsibilities. Your background should include a Bachelor's degree in B.E/B.Tech, with a strong industry focus on IT/Computers-Software. You must possess a good understanding of Transfer Learning concepts, Question-Answering Framework, and have experience in building production-ready NLP systems. Familiarity with Distributed systems like Docker, Kubernetes, and Azure, as well as working knowledge of Linux OS, will be beneficial for this role. If you have the passion and skills to work on cutting-edge AI technologies, this Senior Data Scientist position offers a challenging opportunity to contribute to the development of innovative NLP systems in a dynamic environment.,

Posted 1 month ago

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.