About Us:
Skit.ai is pioneering the new frontier of customer engagement. As a leading Conversational AI company, we are fundamentally transforming the collections industry with our suite of Generative AI-powered voice and message assistants. Our flagship Collection Orchestration Platform the first of its kind harmonizes communications across all channels, while our proprietary Large Collection Model (LCM) serves as the strategic brain, optimizing every interaction for unparalleled efficiency and customer experience.
Our trophy shelf, which includes the BIG AI Excellence Award 2024 and a Stevie Gold Winner for Most Innovative Company, reflects our commitment to innovation. But our true north is the tangible impact we deliver. We are a global team of pioneers headquartered in New York City, and we are looking for a visionary product leader to take ownership of our core intelligence engine from our Bangalore innovation hub.
Job Title:
Product Analyst - AI Engineering
Location:
Bangalore, India (100% WFO)
Shift Hours:
1:00 PM - 10:00 PM IST
Key Responsibilities:
1. Center of Excellence (CoE) Leadership:
Establish and maintain Skit.AIs AI Engineering CoE with documented best practices, prompt libraries, and quality frameworks
Develop standardised prompt templates, ASR and TTS best practices, patterns for common use cases (debt collection, appointment setting, payment processing, etc.)
Work on Voice Bot evaluation frameworks and testing protocols to measure effectiveness
Build and maintain a knowledge repository of high-performing prompts across different LLM models and use cases
2. Cross-Client Analysis & Pattern Recognition:
Analyse Voice Bot performance data across all active client deployments to identify trends, common failure patterns, and optimization opportunities
Conduct root cause analysis on bot performance issues and trace them back to prompt design decisions
Generate monthly insights reports highlighting prompt-related improvements and their business impact
Identify opportunities for prompt reusability and standardization across similar client use cases
3. Continuous Improvement & Innovation:
Monitor latest developments in LLM capabilities, prompt engineering techniques, ASR, TTS and conversational AI research
Experiment with emerging prompting strategies (chain-of-thought, few-shot learning, retrieval-augmented generation, etc.)
Pilot new prompt architectures and evaluate their effectiveness for collections/customer service scenarios
Develop A/B testing frameworks for prompt variations and measure impact on KPIs (containment rate, NPS, compliance, etc.)
4. Technical Implementation:
Design and optimize system prompts, user prompts, and guardrails for voice AI applications
Collaborate with engineering teams to implement prompt versioning, testing, and deployment workflows
Work with data teams to build feedback loops between prompt changes and performance metrics
Ensure Voice Bots maintain compliance with FDCPA, CFPB, TCPA, and other regulatory requirements
5. Stakeholder Collaboration:
Partner with Delivery/PM teams to understand client-specific requirements and constraints
Train and mentor AI Engineers on best practices and emerging techniques
Present Voice Bot performance insights to leadership and clients during QBRs
Support pre-sales and solutioning teams with prompt strategy for new opportunities
Required Work Experience & Skills:
Essential:
3-6 years in product analysis, AI/ML product roles, or conversational AI development
Hands-on experience with LLM prompting
Strong analytical skills with proficiency in Python, or similar data analysis tools
Experience designing and analyzing A/B tests or controlled experiments
Deep understanding of NLP, conversational AI, and voice bot architectures
Proven ability to identify patterns in large datasets and translate insights into actionable recommendations
Preferred:
Prior experience in voice AI, chatbot development, or conversational design
Strong educational background from
Tier-1 institutions
Knowledge of collections industry, financial services, or regulated customer communication
Experience with prompt engineering frameworks and evaluation tools
Publication or thought leadership in prompt engineering or conversational AI space
Technical Skills:
Advanced prompt engineering across multiple LLM providers
Data analysis and visualization (SQL, Python, Tableau/Looker)
Understanding of RAG (Retrieval-Augmented Generation) architectures
API integration and web-hook workflows for voice systems
Git/version control for prompt management
Soft Skills:
Exceptional written communication for crafting precise, effective prompts
Systems thinking to understand how prompt changes impact overall bot performance
Curiosity and continuous learning mindset in a rapidly evolving field
Ability to balance innovation with production stability
Strong documentation and knowledge-sharing practices
Other Qualifications:
Must be comfortable working US business hours
Self-starter who can establish Problem-Solve from the ground up
Comfortable working in a fast-paced, ambiguous environment
