LLM Engineer III

About the role

Crunchyroll is growing and changing, presenting unique challenges and opportunities to support millions of anime fans around the world. The AI/ML team provides seamless help to our internal stakeholders, ensuring an exceptional experience for all Crunchyroll fans.

• Architect and implement end-to-end LLM-based applications, including chatbots, assistants, search agents, and knowledge discovery tools.
• Design and deploy scalable RAG and GraphRAG pipelines using vector databases (eg, Opensearch, Pinecone, Mongo) and document chunking strategies.
• Fine-tune and optimize foundation models (eg, Bedrock, Claude, Nova) for domain-specific use cases.
• Own prompt design and evaluation - build prompt libraries and frameworks that enable rapid experimentation and reuse.
• Develop APIs and microservices to serve LLM-based applications with real-time latency and uptime guarantees.
• Collaborate with data, platform, and backend teams to integrate LLM capabilities into broader Crunchyroll product experiences.
• Monitor and evaluate LLM systems in production for hallucination, latency, cost, and feedback loops.
• Stay up to date with the latest in LLM research, tooling (LangChain, LlamaIndex), and ecosystem advancements.

About You

We get excited about candidates, like you, because...

• Bachelors or Masters degree in Computer Science, Machine Learning, AI, or a related field.
• 5+ years of experience building production ML/AI systems, with 2+ years specifically focused on LLM applications.
• Hands-on experience with production-ready RAG systems using tools like LangChain, LlamaIndex, or custom pipelines.
• Hands-on experience with GraphRAG, LLMs, Graph and Vector Databases.
• Deep understanding of prompt engineering, prompt templating, and prompt evaluation strategies.
• Experience working with major foundation models (OpenAI, Anthropic, Nova, Bedrock etc).
• Familiarity with building semantic search systems and working with vector DBs at scale.
• Strong backend/API development experience using TypeScript and knowledge of deploying services to cloud environments.
• Python skills and experience working with AWS cloud platform and MLOps tools (eg, AWS Bedrock, SageMaker, Databricks, Lambda, ECS/Fargate).

Why you will love working at Crunchyroll

In addition to getting to work with fun, passionate and inspired colleagues, you will also enjoy the following benefits and perks:

• Best-in class medical, dental, and vision private insurance healthcare coverage
• Access to counseling & mental health sessions 24/7 through our Employee Assistance Program (EAP)
• Free premium access to Crunchyroll
• Professional Development
• Companys Paid Parental Leave
• up to 26 weeks for birthing parents
• up to 12 weeks for non-birthing parents
• Hybrid Work Schedule
• Paid Time Off
• Flex Time Off
• 5 Yasumi Days
• Half-Day Fridays June - August
• Winter Break