Senior LLM Operations Manager

1 month ago


Bengaluru, Karnataka, India Resource Tree Global Services Full time

Job Summary

We are seeking a highly experienced Senior LLM Operations Manager to join our team at Resource Tree Global Services. The successful candidate will be responsible for defining and disseminating best practices for LLM operations, evaluating and comparing different tools, and collaborating with architects, engineers, and data scientists to design and implement infrastructure requirements for efficient LLM use-cases in production.

Key Responsibilities

- Develop and maintain CI/CD pipelines for prompt deployment and updates
- Perform metrics collection, performance measurement, and feedback analysis of LLM use-cases in production systems
- Monitor and report the cost for LLM use-cases in production systems
- Identify and resolve bottlenecks in production LLM use-cases, including prompt optimization/tuning

Requirements

- 5-10 years of experience in AI/ML, with at least 1 year in GenAI and LLM operations
- Proven experience in productionizing GenAI projects by applying best LLMOps practices
- Excellent knowledge of prompt writing and prompt management
- Good Python coding skills

What We Offer

- Opportunity to work with a dynamic team on cutting-edge LLM projects
- Collaborative and fast-paced work environment
- Professional development and growth opportunities



  • Bengaluru, Karnataka, India ResourceTee Global Service Full time

    Job DescriptionRole Summary: We are seeking a highly skilled Senior LLM Operations Specialist to join our team at ResourceTee Global Service. The successful candidate will be responsible for defining and implementing best practices for LLM operations, collaborating with cross-functional teams, and ensuring smooth LLM operations.Key Responsibilities:Define...


  • Bengaluru, Karnataka, India Resourcetree Full time

    Job SummaryResourcetree is seeking a highly skilled Senior LLM Operations Specialist to join our team. As a key member of our GenAI operations team, you will be responsible for defining and disseminating best practices for LLM operations, evaluating and comparing different tools, and collaborating with architects and engineers to design and implement...


  • Bengaluru, Karnataka, India Amazon Development Centre (India) Private Limited - A66 Full time

    About the RoleWe are seeking a Senior Operations Manager to join our team at Amazon Development Centre (India) Private Limited - A66. As a Senior Operations Manager, you will play a pivotal role in shaping the future of the shopping experience for customers worldwide.Our mission is to empower Amazon's LLMs through Reinforcement Learning from Human Feedback...


  • Bengaluru, Karnataka, India Amazon Development Centre (India) Private Limited - A66 Full time

    About the RoleWe are seeking a Senior Operations Manager to join our OPTIMA team at Amazon Development Centre (India) Private Limited - A66. As a key member of our operations team, you will play a pivotal role in shaping the future of the shopping experience for customers worldwide.Our mission is to empower Amazon's LLMs through Reinforcement Learning from...


  • Bengaluru, Karnataka, India Amazon Development Centre (India) Private Limited - A66 Full time

    About the RoleWe are seeking a Senior Operations Manager to join our OPTIMA team at Amazon Development Centre (India) Private Limited. As a key member of our operations team, you will play a pivotal role in shaping the future of the shopping experience for customers worldwide.Our mission is to empower Amazon's LLMs through Reinforcement Learning from Human...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Cloud LLM Operations SpecialistWe are seeking an experienced Cloud LLM Operations Specialist to join our team at NTT DATA Services. This is a critical role that involves building, automating, and maintaining our infrastructure on a leading cloud platform.Key Responsibilities:Utilize Infrastructure as Code (IaC) tools like Terraform to automate infrastructure...


  • Bengaluru, Karnataka, India THOUGHTSPOT INDIA PRIVATE LIMITED Full time

    ThoughtSpot Senior ML and LLM EngineerAt ThoughtSpot India Private Limited, we are seeking a talented Senior ML and LLM Engineer to join our team in Bengaluru. This role will play a key part in developing and implementing innovative machine learning and large language model solutions to enhance user experiences and improve search accuracy, relevance, and...


  • Bengaluru, Karnataka, India Amazon Development Centre (India) Private Limited - A66 Full time

    We are seeking a highly skilled Senior Operations Manager to join our Amazon Development Centre (India) Private Limited team. In this role, you will play a crucial part in shaping the future of customer shopping experiences worldwide.About OPTIMAOPTIMA is a team within Amazon that enables the delivery of a superior shopping experience to customers worldwide....


  • Bengaluru, Karnataka, India Amazon Development Centre (India) Private Limited - A66 Full time

    About the Role:The OPTIMA team at Amazon Development Centre (India) Private Limited - A66 is searching for a skilled Senior Operations Manager. This position plays a crucial role in shaping the future of the shopping experience for customers worldwide.We at OPTIMA empower Amazon to deliver a superior shopping experience to customers worldwide. Our mission is...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionCloud LLM Pipeline ArchitectAbout the RoleWe are seeking a skilled Cloud LLM Pipeline Architect to design, implement, and maintain our Large Language Model (LLM) infrastructure on a leading cloud platform. As a key member of our team, you will play a critical role in building, automating, and optimizing our LLM pipeline, ensuring seamless...


  • Bengaluru, Karnataka, India Rohini IT Consulting LLP Full time

    Unlock New Frontiers in Radiology and Healthcare with Us!At Rohini IT Consulting LLP, we're seeking a seasoned Data Scientist to spearhead groundbreaking advancements in Large Language Model (LLM) multimodal healthcare.**Key Responsibilities:**We're looking for an expert who can develop and implement innovative LLM models for analyzing radiology images, text...


  • Bengaluru, Karnataka, India Orison Solutions Full time

    Job Title: LLM Hardware Design DeveloperJob Summary:We are seeking an exceptional hardware design developer to play a pivotal role in using the hardware design platform to generate training data for enterprise LLMs. This unique position offers the chance to directly contribute to the sophistication of enterprise LLMs, ensuring they operate with unparalleled...

  • Senior Data Scientist

    3 weeks ago


    Bengaluru, Karnataka, India Leute Passen India Private Limited Full time

    Job Title: Senior Data ScientistWork Mode: RemoteExperience: Minimum 5 yearsJob Description:We are seeking a highly skilled Senior Data Scientist with expertise in Natural Language Processing (NLP) and Large Language Models (LLMs) to lead our team in developing and implementing advanced language models.The ideal candidate will have a strong background in...


  • Bengaluru, Karnataka, India FxConsulting Full time

    Senior Machine Learning Engineer RoleWe're seeking a highly skilled Senior Machine Learning Engineer to drive forward our in-house ML engine's capabilities. As a key member of our Data Science Team, you'll tackle complex LLM and machine learning challenges. Responsibilities include:- Applying deep learning LLM and ML models to power semantic search and...


  • Bengaluru, Karnataka, India ADCI - Karnataka Full time

    About the RoleWe are seeking an experienced Operations Manager to join our Alexa Shopping Operations team. As a key member of our team, you will be responsible for providing overall management for a large operations team, playing a critical role in improving the Alexa shopping experience for customers.Key ResponsibilitiesWork with stakeholders across the...


  • Bengaluru, Karnataka, India Rohini IT Consulting LLP Full time

    Job Overview:Rohini IT Consulting LLP is seeking a highly skilled Data Scientist to contribute to groundbreaking advancements in LLM multimodal healthcare. The ideal candidate will have a strong foundation in data science methodologies and a deep understanding of LLM applications, particularly in the context of radiology, visual images, and text.Key...


  • Bengaluru, Karnataka, India Talent Divas Consulting Full time

    Job Title: GenAI and LLM Engineer (PyTorch)Job Summary:We are seeking a highly skilled GenAI and LLM Engineer with expertise in PyTorch to join our AI research and development team. This role is ideal for someone passionate about advancing the capabilities of Generative AI, building and fine-tuning large language models (LLMs), and implementing solutions...

  • Senior AI Strategist

    4 weeks ago


    Bengaluru, Karnataka, India Kunato Full time

    About the Role:Kunato is seeking a highly skilled Senior AI Strategist to lead our AI team in developing and deploying cutting-edge LLM models. As a key member of our organization, you will be responsible for providing technical leadership, guiding the team, and overseeing day-to-day operations.Key Responsibilities:Develop and implement AI strategies to...


  • Bengaluru, Karnataka, India Orison Solutions Full time

    We are seeking a seasoned hardware design expert to join our team at Orison Solutions and play a pivotal role in enhancing the capabilities of our enterprise Large Language Models (LLMs). This unique opportunity offers the chance to directly contribute to the sophistication of our LLMs, ensuring they operate with unparalleled efficiency and intelligence.Job...

  • LLM Model Architect

    3 weeks ago


    Bengaluru, Karnataka, India Mazenet solution Full time

    Mazenet solution seeks a highly skilled LLM Model Architect to design and develop scalable software solutions using Python and cloud platforms (AWS, Azure, GCP).Responsibilities:Translate business to technical requirementsOwn technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocationData driven decision making...