2 Ml Metrics Jobs

The Salesforce AI Platform powers AI investments in the Einstein product portfolio across Service, Sales, and other Salesforce clouds, including the recent Einstein GPT capabilities. With the recent industry-wide focus on Generative AI, we are collaborating with multiple external vendors, open-source projects, and internal Salesforce Research teams to host various Language Model Models (LLMs). Our aim is to continuously evaluate and measure quality, build a robust experimentation platform, and enable seamless rollout of these LLMs/prompts. We also strive to enhance LLM/prompt capabilities based on customer data and feedback. We are currently looking for an exceptional Product Manager to lead the future of Sales AI for Salescloud, specifically focusing on building AI capabilities that assist sellers. The ideal candidate for this high-profile role is an experienced product manager who is dedicated to ensuring the success of customers and their teams. This position is perfect for an individual who is ready to elevate their career to the next level. **Your Impact:** - Define and own the product vision, strategy, and roadmap for Sales AI, with a focus on aspects such as Experimentation and Improvements, Prompt tuning, Model fine-tuning, Retrieval Augmented Generation (RAG), Keyword & Vector Search, and No-code model builder experiences. - Drive the end-to-end product lifecycle from concept to adoption, including defining requirements with prioritized features, corresponding justification, and success metrics. - Collaborate with multiple engineering teams to scope, prioritize, and drive feature specifications. - Engage with customers, stakeholders, and partners to provide roadmap updates, gather product feedback, and identify challenges and opportunities. - Stay abreast of industry trends and competition in Generative AI. - Work closely with product marketing on positioning, messaging, and go-to-market strategies. - Serve as a domain and product expert for Salesforce at customer interactions, industry events, corporate events, community sites, and social media. **Required Skills:** - 8+ years of Product Management or similar experience with highly technical products/platforms. - Extensive experience in the AI/ML space, including a strong technical background and the ability to collaborate with engineers and data scientists. - Excellent written and oral communication skills, with experience presenting to executive leadership, participating in the sales cycle, and addressing sensitive issues. - Experience in delivering products or services in an agile/lean environment, including backlog management (user stories, epics, and bugs). - Proficiency in gathering and transforming product requirements into a practical product roadmap. - Experience in fostering collaborations within the company, as well as with external partners and customers. - A degree or equivalent relevant experience is required. Evaluation will be based on core competencies for the role. **Desired Skills:** - Experience in defining and building AI platforms and capabilities that enable different personas to perform tasks as part of the end-to-end ML lifecycle. - Good understanding of Generative AI and the LLM landscape. - Experience in working with ML metrics, evaluations, and benchmarking. - Experience collaborating with Data Science and ML Engineering teams.,

The Salesforce AI Platform powers AI investments in the Einstein product portfolio across various Salesforce clouds, including Service, Sales, and the recent Einstein GPT capabilities. The team collaborates with external vendors, open-source platforms, and the internal Salesforce Research team to host various LLMs (Large Language Models). They continuously evaluate and measure quality, build an experimentation platform, and enable seamless rollout of LLMs based on customer data and feedback. We are looking for an exceptional Product Manager to lead the development of Sales AI for Salescloud, focusing on building AI capabilities to assist sellers. The ideal candidate is an experienced product manager dedicated to ensuring customer and team success. This role offers a high-profile opportunity for someone looking to advance their career. **Responsibilities:** - Define and drive the product vision, strategy, and roadmap for Sales AI, covering areas such as Experimentation and Improvements, Prompt tuning, Model fine-tuning, Retrieval Augmented Generation (RAG), Keyword & Vector Search, and No-code model builder experiences. - Manage the entire product lifecycle from concept to adoption, including defining requirements, prioritizing features, justifying decisions, and establishing success metrics. - Collaborate with engineering teams to outline, prioritize, and implement feature specifications. - Engage with customers, stakeholders, and partners to provide roadmap updates, gather feedback, and identify challenges and opportunities. - Stay informed about industry trends and competition in Generative AI. - Work with product marketing on positioning, messaging, and go-to-market strategies. - Serve as a domain and product expert for Salesforce in customer interactions, industry events, and community platforms. **Required Skills:** - 8+ years of Product Management experience with technical products/platforms. - Strong background in AI/ML with the ability to communicate effectively with engineers and data scientists. - Excellent written and verbal communication skills, including presenting to executives, participating in the sales process, and managing critical issues. - Experience working in agile/lean environments and managing backlogs. - Proficiency in gathering and translating product requirements into a practical roadmap. - Proven ability to collaborate internally and externally to deliver products or services. - Bachelor's degree or equivalent experience required. **Desired Skills:** - Experience in defining and developing AI platforms to support different user personas throughout the ML lifecycle. - Familiarity with Generative AI and LLM landscape. - Background in ML metrics, evaluations, and benchmarking. - Experience working closely with Data Science and ML Engineering teams.,