LLM Engineer III

About Crunchyroll

Founded by fans, Crunchyroll delivers the art and culture of anime to a passionate community. We super-serve over 100 million anime and manga fans across 200 countries and territories, and help them connect with the stories and characters they crave. Whether that experience is online or in-person, streaming video, theatrical, games, merchandise, events and more, it's powered by the anime content we all love.

Join our team, and help us shape the future of anime

About the Team

The R&D team is dedicated to developing, testing, and validating robust and scalable machine learning models that drive business objectives. Our focus includes enhancing operational processes through AI/ML solutions, such as trend analysis, anomaly detection, and the deployment of large language models (LLMs) for tasks like querying system health. Another major focus area is preserving, and improving customer experience and retention. We closely work with our stakeholders to ensure AI/ML objectives are clearly defined.

About the role

Crunchyroll is growing and changing, presenting unique challenges and opportunities to support millions of anime fans around the world. The AI/ML team provides seamless help to our internal stakeholders, ensuring an exceptional experience for all Crunchyroll fans.

• Architect and implement end-to-end LLM-based applications, including chatbots, assistants, search agents, and knowledge discovery tools.
• Design and deploy scalable RAG and GraphRAG pipelines using vector databases (e.g., Opensearch, Pinecone, Mongo) and document chunking strategies.
• Fine-tune and optimize foundation models (e.g., Bedrock, Claude, Nova) for domain-specific use cases.
• Own prompt design and evaluation - build prompt libraries and frameworks that enable rapid experimentation and reuse.
• Develop APIs and microservices to serve LLM-based applications with real-time latency and uptime guarantees.
• Collaborate with data, platform, and backend teams to integrate LLM capabilities into broader Crunchyroll product experiences.
• Monitor and evaluate LLM systems in production for hallucination, latency, cost, and feedback loops.
• Stay up to date with the latest in LLM research, tooling (LangChain, LlamaIndex), and ecosystem advancements.

About You

We get excited about candidates, like you, because...

• Bachelor's or Master's degree in Computer Science, Machine Learning, AI, or a related field.
• 5 years of experience building production ML/AI systems, with 2 years specifically focused on LLM applications.
• Hands-on experience with production-ready RAG systems using tools like LangChain, LlamaIndex, or custom pipelines.
• Hands-on experience with GraphRAG, LLMs, Graph and Vector Databases.
• Deep understanding of prompt engineering, prompt templating, and prompt evaluation strategies.
• Experience working with major foundation models (OpenAI, Anthropic, Nova, Bedrock etc.).
• Familiarity with building semantic search systems and working with vector DBs at scale.
• Strong backend/API development experience using TypeScript and knowledge of deploying services to cloud environments.
• Python skills and experience working with AWS cloud platform and MLOps tools (e.g., AWS Bedrock, SageMaker, Databricks, Lambda, ECS/Fargate).

Why you will love working at Crunchyroll

In addition to getting to work with fun, passionate and inspired colleagues, you will also enjoy the following benefits and perks:

• Best-in class medical, dental, and vision private insurance healthcare coverage
• Access to counseling & mental health sessions 24/7 through our Employee Assistance Program (EAP)
• Free premium access to Crunchyroll
• Professional Development
• Company's Paid Parental Leave
  • up to 26 weeks for birthing parents
  • up to 12 weeks for non-birthing parents
• Hybrid Work Schedule
• Paid Time Off
  • Flex Time Off
  • 5 Yasumi Days
  • Half-Day Fridays June - August
  • Winter Break

About our Values

We want to be everything for someone rather than something for everyone and we do this by living and modeling our values in all that we do. We value

• Courage. We believe that when we overcome fear, we enable our best selves.

• Curiosity. We are curious, which is the gateway to empathy, inclusion, and understanding.

• Kaizen. We have a growth mindset committed to constant forward progress.

• Service. We serve our community with humility, enabling joy and belonging for others.

Our commitment to diversity and inclusion

Our mission of helping people belong reflects our commitment to diversity & inclusion. It's just the way we do business.

We are an equal opportunity employer and value diversity at Crunchyroll. Pursuant to applicable law, we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Crunchyroll, LLC is an independently operated joint venture between US-based Sony Pictures Entertainment, and Japan's Aniplex, a subsidiary of Sony Music Entertainment (Japan) Inc., both subsidiaries of Tokyo-based Sony Group Corporation.

Questions about Crunchyroll's hiring process? Please check out our Hiring FAQs:

Please refer to our Candidate Privacy Policy for more information about how we process your personal information, and your data protection rights:

Please beware of recent scams to online job seekers. Those applying to our job openings will only be contacted directly from email account.

---