34 Evaluation Frameworks Jobs

Cvent is a leading meetings, events, and hospitality technology provider with more than 4,800 employees and 22,000 customers worldwide, including 53% of the Fortune 500. Founded in 1999, Cvent delivers a comprehensive event marketing and management platform for marketers and event professionals and offers software solutions to hotels, special event venues and destinations to help them grow their group/MICE and corporate travel business. Our technology brings millions of people together at events around the world. In short, we're transforming the meetings and events industry through innovative technology that powers human connection. The DNA of Cvent is our people, and our culture has an emph...

Cvent is a leading meetings, events, and hospitality technology provider with more than 4,800 employees and 22,000 customers worldwide, including 53% of the Fortune 500. Founded in 1999, Cvent delivers a comprehensive event marketing and management platform for marketers and event professionals and offers software solutions to hotels, special event venues and destinations to help them grow their group/MICE and corporate travel business. Our technology brings millions of people together at events around the world. In short, we're transforming the meetings and events industry through innovative technology that powers human connection. The DNA of Cvent is our people, and our culture has an emph...

About Highspot Highspot is a software product development company and a recognized global leader in the sales enablement category, leveraging cutting-edge AI and GenAI technologies at the core of its robust Software-as-a-Service (SaaS) platform. Highspot is revolutionizing how millions of individuals work worldwide. Through its AI-powered platform, Highspot drives enterprise transformation to empower sales teams through intelligent content management, training, contextual guidance, customer engagement, meeting intelligence, and actionable analytics. The Highspot platform delivers advanced features tailored to business needs, in a modern design that sales and marketing executives appreciate a...

As an AI Engineer, you will be responsible for designing, building, and operating agentic AI systems end-to-end, from concept to production. Your main focus will be on multi-agent orchestration, Retrieval-Augmented Generation (RAG), evaluation frameworks, and AI guardrails to ensure the development of safe, reliable, and high-performing systems. Key Responsibilities: - Design, build, and operate agentic AI systems from concept to production. - Work on multi-agent orchestration and Retrieval-Augmented Generation (RAG) to enhance system performance. - Develop evaluation frameworks and AI guardrails to ensure the safety and reliability of systems. Qualifications Required: - Strong background in...

As a potential candidate for the position at the top IT product company, you will be responsible for leading the strategic evolution of India's most sophisticated BFSI AI platform ecosystem. This will involve directing a 40-person engineering and data science team to deliver agentic platform capabilities through cutting-edge agentic tech stack. Your role will encompass agent creation and orchestration, AI-native vertical-focused workflows and journeys, along with scalable AI/ML infrastructure. **Key Responsibilities**: - Define and lead AI platform technology strategy, driving innovation across agentic, low-code, and document science platforms, advanced LLM search, and next-gen financial pro...

Role Overview: You are sought after by Xpergia, a client of Uplers, as an AI/ML Engineer with expertise in conventional machine learning and interest in generative AI. Your primary responsibility will be to develop Sports Companion GPT - Aiko for sports applications, focusing on Cricket and Football. You will collaborate with global teams to create an AI model that provides actionable insights and innovative solutions, contributing to the development of a generative AI evaluation framework. Key Responsibilities: - Design and develop AI models combining conventional ML techniques with generative AI models for Cricket and Football applications. - Fine-tune pre-trained generative AI models usin...

Overview Cvent is a leading meetings, events, and hospitality technology provider with more than 4,800 employees and 22,000 customers worldwide, including 53% of the Fortune 500. Founded in 1999, Cvent delivers a comprehensive event marketing and management platform for marketers and event professionals and offers software solutions to hotels, special event venues and destinations to help them grow their group/MICE and corporate travel business. Our technology brings millions of people together at events around the world. In short, we're transforming the meetings and events industry through innovative technology that powers human connection. The DNA of Cvent is our people, and our culture ha...

As a Compensation & Benefits professional, you will be required to develop, coordinate, and implement effective strategies, procedures, and programs related to compensation and benefits during consulting assignments for ANSR's clients. You will also provide inputs, guidance, and support in setting up and scaling new Global Capability Centers (GCCs). Key Responsibilities: - Work with the People, Organization, and Culture team to deliver high-quality, effective Compensation and Benefits solutions tailored for ANSR's clients with a focus on the following areas: - Aligning with statutory compliance and staying aware of market practices and developments - Conducting Compensation and Benefits mark...

Role Overview: You will be leading the roadmap for Generative AI (GenAI) solutions across product and platform teams. Your responsibilities will include architecting and optimizing RAG pipelines, establishing evaluation frameworks, leading research and applied innovation, mentoring senior scientists/engineers, and partnering with Product, Engineering, and Business stakeholders to deliver AI systems with measurable business impact. Key Responsibilities: - Lead the roadmap for Generative AI (GenAI) solutions - Architect and optimize RAG pipelines - Establish evaluation frameworks to measure LLM outputs - Lead research and applied innovation around foundation model fine-tuning - Mentor senior s...

As a senior-level, applied AI engineer in our team, you will be responsible for building, deploying, and refining consumer-facing AI applications. Your main focus will be on developing conversational AI agents and other generative systems to enhance user interactions with AI features. This role offers you the opportunity to transition from prototyping to building reliable, production-grade solutions. **Key Responsibilities:** - Lead the development and enhancement of the agentic chatbot, including the integration of different chatbot architectures. - Create intuitive and efficient applications that leverage AI interactions to add value and improve user experiences. - Evaluate the AI chatbot ...

New Opportunity for Data Scientist || Immediate to 30days Joiners Job Description Data Scientist (NLP/ML Research) Position: Data Scientist Location: [Hybrid Noida Office] Experience: 2+ years Team: AI/ML Advanced Research and Product Innovation Reports To: Director Data Science About the Role We're seeking a seasoned Data Scientist to lead NLP/ML research efforts and architect end-to-end solutions. You will be instrumental in driving innovation, mentoring junior team members, and working closely with stakeholders to align AI capabilities with strategic goals. Key Responsibilities Lead the development and deployment of production-grade NLP and ML models. Work with large language models (LLMs...

About the Role: Cvent is seeking a highly skilled and experienced Software Architect to spearhead the integration of artificial intelligence (AI) solutions across our product suite. This is an exciting opportunity to lead the charge in bringing cutting-edge AI technologies to the event industry, enhancing our platforms with capabilities that drive innovation and efficiency. With over 15 years of experience in diverse technologies, you will play a crucial role in designing and implementing AI-driven systems that align with Cvent's architectural vision and strategic goals. What You Will Be Doing: Lead the design, development, and delivery of AI solutions across our enterprise SaaS platforms, l...

Company Description It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500. Our intelligent cloud-based platform seamlessly connects people, systems, and processes to empower organizations to find smarter, faster, and better ways to work. But this is just the beginning of our journey. Join us as we pursue our purpose to make the world work better for everyone. Job Description As a Staff Machine Learning Engineer, you will be responsible for leadi...

Cvent is a leading meetings, events, and hospitality technology provider with more than 4,800 employees and 22,000 customers worldwide, including 53% of the Fortune 500. Founded in 1999, Cvent delivers a comprehensive event marketing and management platform for marketers and event professionals and offers software solutions to hotels, special event venues and destinations to help them grow their group/MICE and corporate travel business. Our technology brings millions of people together at events around the world. In short, we're transforming the meetings and events industry through innovative technology that powers human connection. The DNA of Cvent is our people, and our culture has an emph...

Qualification & Eligibility: Bachelor's or higher degree in a quantitative discipline (computer science, statistics, engineering, applied mathematics) Working Experience: Minimum 8+ years of experience Startup experience preferred, Edtech work experience bonus Roles & responsibilities: Lead the roadmap for Generative AI (GenAI) solutions across product and platform teams. Architect and optimise RAG pipelines (retrieval, embeddings, hybrid search, re-ranking, caching, latency-cost tradeoffs). Establish robust evaluation frameworks (automatic + human-in-the-loop) to measure LLM outputs on factuality, reasoning, hallucinations, coverage, and safety. Lead research and applied innovation around f...

Join Tether and Shape the Future of Digital Finance At Tether, we're not just building products, we're pioneering a global financial revolution. Our cutting-edge solutions empower businessesfrom exchanges and wallets to payment processors and ATMsto seamlessly integrate reserve-backed tokens across blockchains. By harnessing the power of blockchain technology, Tether enables you to store, send, and receive digital tokens instantly, securely, and globally, all at a fraction of the cost. Transparency is the bedrock of everything we do, ensuring trust in every transaction. Innovate with Tether Tether Finance: Our innovative product suite features the world's most trusted stablecoin, USDT , reli...

About Cvent: Cvent is a leading meetings, events, and hospitality technology provider with more than 4,800 employees and 22,000 customers worldwide, including 53% of the Fortune 500. Founded in 1999, Cvent delivers a comprehensive event marketing and management platform for marketers and event professionals and offers software solutions to hotels, special event venues and destinations to help them grow their group/MICE and corporate travel business. Our technology brings millions of people together at events around the world. In short, we're transforming the meetings and events industry through innovative technology that powers human connection. The DNA of Cvent is our people, and our cultur...

We are seeking a talented individual to join our Psychometric Consulting team at Mercer. This role will be based in Gurgaon. This is a hybrid role that has a requirement of working at least three days a week in the office. Consultant Psychometric Assessment The candidate will be responsible for supporting the sales team for the business meets for psychometric assessments discussions. The candidate will be handling psychometric assessment deliveries including Assessment Development centers Independently. Support the sales team in engaging with key clients and stakeholders at a senior level, including CXOs, for discussions related to psychometric assessments and talent development solutions. A...

The Role We're looking for a senior AI engineer who can build production-grade agentic AI systems. You'll be working at the intersection of cutting-edge AI research and scalable engineering, creating autonomous agents that can reason, plan, and execute complex tasks reliably at scale. What We Need Agentic AI & LLM Engineering You should have hands-on experience with: Multi-agent systems : Building agents that coordinate, communicate, and work together on complex workflows Agent orchestration : Designing systems where AI agents can plan multi-step tasks, use tools, and make autonomous decisions LLMOps Experience : End-to-End LLM Lifecycle Management - hands-on experience managing the complete...

Job Summary We are seeking an experienced and highly skilled Project Manager to lead and oversee a large-scale survey project. The role requires a professional with a strong technical background, proven leadership abilities, and extensive experience in managing government or international projects. The Project Manager will be responsible for project planning, execution, monitoring, evaluation, and ensuring timely delivery within budget. Key Responsibilities Lead, coordinate, and manage all aspects of large-scale survey projects. Develop and implement project work plans, schedules, and resource allocations. Ensure adherence to timelines, deliverables, and budgetary requirements. Serve as the ...

Microsoft Ads powers one of the world's largest digital advertising ecosystems, delivering billions of recommendations every day to users worldwide. We are seeking a Principal Architect to advance the next generation of distributed systems that power ad retrieval, ranking, moderation, and generation at web scale. You will also build evaluation frameworks, enable agentic platforms leveraging LLMs and SLMs to reason, adapt, and take multi-step actions, unlocking measurable impact for our advertisers and users. Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and ...

Working at Atlassian Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity. Interviews and onboarding are conducted virtually, as a part of being a distributed-first company. About the team The Cloud Access & Intelligence (CAI) org at Atlassian focuses on AI-first solutions that simplify admin experiences, automate workflows, and enhance customer support through intelligent agents. We're pushing the boundaries of LLM-based features, prompt engineering, and AI-driven automation ...

Are you ready to revolutionize how millions discover wellness while accelerating your career at breakneck speed At Rapid Global Growth (RGG), we're powering Puffya Top 5 US mattress brand with 100% YoY sales growth and a reputation for innovation recognized by Forbes, Entrepreneur.com, and TechCompanyNews. Now, we're seeking an elite IT Procurement Specialist to spearhead our technology evaluation strategy, driving critical platform decisions that power our next generation of innovation. Why This Role Will Transform Your Career Own a High-Scale Impact Lead evaluations directly influencing multi-million-dollar technology investments and strategic direction Collaborate with the Top 1% Work dir...

As a Training Leader at Wipro in Bengaluru, specializing in Content Moderation within the Trust & Safety domain, your role is crucial in ensuring the successful achievement of all training goals and objectives at an account level. Your responsibilities include: - Developing and implementing learning strategies. - Collaborating with business leaders and subject matter experts to design relevant content. - Maintaining positive relationships with internal and external stakeholders. Your expertise in adult learning theories, ROI measurement, and evaluation frameworks will be essential for assessing and reporting on learning service performance. You will provide data-driven recommendations for im...

Working at Atlassian Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity. Interviews and onboarding are conducted virtually, as a part of being a distributed-first company. About the team The Cloud Access & Intelligence (CAI) org at Atlassian focuses on AI-first solutions that simplify admin experiences, automate workflows, and enhance customer support through intelligent agents. We're pushing the boundaries of LLM-based features, prompt engineering, and AI-driven automation ...