Product Manager (Generative AI & LLM Experimentation)

Job Description

## About We are a well-funded Generative AI startup committed to crafting exceptional, human-centered conversational experiences for consumers worldwide. Our mission is to make AI interactions more accessible, impactful, and engaging by combining advanced Generative AI with intuitive, human-centered design. Our team is led by industry veterans with deep expertise in AI, personalization, and NLP, with experience at top global tech firms. ## Key Responsibilities - Research & Insights: Review research papers, case studies, and industry benchmarks to extract actionable insights for improving AI performance and stay updated with latest advancements. - Experimentation & Strategy: Define, execute, and iterate on experiments across various AI models to improve accuracy, engagement, and response quality. - Model Performance Analysis: Conduct A/B tests, compare model performance, and analyze key metrics to refine the AI pipeline. - User Feedback & Insights: Develop and analyze feedback loops to measure user satisfaction and model effectiveness. - Cross-functional Collaboration: Work closely with engineers, data scientists, and product teams to drive AI advancements and feature improvements. - Data-Driven Decision Making: Leverage analytics to identify trends, assess model success, and drive strategic improvements. - Rapid Prototyping & Iteration: Test new AI capabilities and ideas swiftly to optimize performance and scalability. ## Ideal Profile - 1-3 years of experience in AI-focused product roles, preferably from Tier 1 colleges such as IIT, NIT, BITS, etc. - Strong understanding of LLMs, fine-tuning, prompt engineering, and AI evaluation techniques. - Experience in designing experiments for model performance testing and iteration. - Ability to interpret AI/ML metrics and translate them into actionable insights. - Excellent problem-solving and analytical skills. - Hands-on experience with LLM APIs (OpenAI, Hugging Face, etc.), A/B testing, and user analytics tools. - Ability to work in a fast-paced, ambiguous environment while driving clarity and execution. ## Nice to Have - Experience working on AI-powered conversations. - Background in astrology or related field. Job Type: Full-time Pay: ₹3,000,000.00 - ₹4,500,000.00 per year Work Location: In person Speak with the employer +91 9008078505