Financial LLM Subject Matter Expert

Background The Kensho team is always on the search for Subject Matter Experts to collaborate on financial product evaluation, or research-oriented projects involving large language models or their systematic parts. This need will continue to grow as we develop cutting-edge agentic and multi agentic solutions for S&P Global and external groups. Some tasks may require extreme familiarity with unstructured information retrieval from both U.S. Earnings Call Transcripts and U.S.-filed 10Ks, structured datasets that S&P sells, and a combination of the two. Unlike more traditional subject matter expert projects, the SME should bring insights into workflows and knowledge, while also having a strong grasp of what end users both want and expect. The best suited SMEs will most likely have experience in one of the Target Industries or Target Personas listed below: Target Industries: Investment Banks Asset Management firms Private Equity firms Hedge Funds Personas: Investment Banking Associate/Analyst Research Analyst (generalist or industry-specific Equity Analyst Portfolio Analyst Market Intelligence or Strategy Analyst Investment Strategists Due Diligence Analysts Investment Analyst/Researcher Market Economists/Strategist Capital Markets Economist Potential Deliverables: - Workflow write-ups: Illuminating where and when it’s appropriate to apply LLMs and how they may benefit from them. - - Evaluation Set creation: Typically, writing role/persona-based questions they would need to answer. These questions would be used to benchmark current LLM/agent performance, identify gaps in development, and inform AI scientists on system/solution architecture. Expert Human feedback: Once a solution is ready to be tested, getting expert annotations, comments, and grades is invaluable. This catches last minute bugs, aligns the system to expert expectations, and determines whether it’s polished enough to be put in front of S&P employees or external users.