LLM Operations Manager

2 weeks ago


Bangalore, India Resource Tree Global Services Full time

Job Title: LLM Operations Manager

About the Role:
At Resource Tree Global Services, we are seeking a highly skilled LLM Operations Manager to join our team. This is a leadership position that requires a strong understanding of AI/ML, GenAI, and LLM operations.

Responsibilities:
• Define and disseminate LLMOps best practices
• Evaluate and compare different LLMOps tools to incorporate the best practices
• Collaborate with architects, engineers, data-scientists, and SMEs to design, implement and oversee the infrastructure requirement for the efficient operation of LLM use-cases in production
• Develop and maintain CI/CD pipelines for prompts deployment and updates
• Perform Metrics collection, Performance measurement and feedback analysis of LLM use-cases in production systems
• Monitor and report the cost for LLM use-cases in production systems
• Identify and resolve any bottlenecks in production LLM use-cases, including Prompt optimization/tuning
• Ensure the security of LLM operations through comprehensive risk assessments and the implementation of robust security measures

Requirements:
• Overall, 5 to 10 years of experience in AI/ML, with at least 1 year in GenAI and LLM operations
• Proven experience in productionizing the GenAI projects by applying best LLMOps practices
• Proven experience in LLM monitoring and observability
• Practical experience working with LLM models and associated techniques, as well as the tools and frameworks used to implement them, like Langfuse (tool), Langchain (framework), RAG (technique)
• Excellent knowledge of prompt writing and prompt management
• Good python coding skills
• Excellent presentation and communication skills while interacting with both technical and non-technical stakeholders
• Motivation to learn new things to stay on top of the GenAI trends by keeping pace with industry advancements in LLM technologies and operational methodologies
• Resilience and the ability to thrive in a dynamic, fast-paced work environment



  • Bangalore, India ResourceTee Global Service Full time

    Job Title: Lead/Manager - LLM OperationsJob Summary: We are seeking a highly skilled Lead/Manager - LLM Operations to join our team at ResourceTee Global Service. As a key member of our organization, you will be responsible for defining and implementing best practices for LLM operations, collaborating with cross-functional teams, and ensuring the smooth...


  • Bangalore, India Resourcetree Full time

    Job Title: LLM Operations SpecialistJob Summary:Resourcetree is seeking an experienced LLM Operations Specialist to join our team. The ideal candidate will have a strong background in AI/ML, with a focus on GenAI and LLM operations. Key Responsibilities:- Define and disseminate LLMOps best practices for Aris Global products.- Evaluate and compare different...

  • Manager/Lead - LLM

    3 weeks ago


    Bangalore, Karnataka, India Resourcetree Full time

    Role : Manager / Lead - LLM OpsExperience : 5 - 10 years Location : BangaloreRole and Responsibilities :- Define and disseminate LLMOps best practices for Aris Global products.- Evaluate and compare different LLMOps tools to incorporate the best practices.- Collaborate with architects, engineers, data-scientists, and SMEs to design, implement and oversee the...


  • Bangalore, Karnataka, India Resource Tree Global Services Full time

    Role : Manager/Lead - LLM OpsExperience : 5 - 10 years Location : BangaloreRole and Responsibilities :- Define and disseminate LLMOps best practices- Evaluate and compare different LLMOps tools to incorporate the best practices.- Collaborate with architects, engineers, data-scientists, and SMEs to design, implement and oversee the infrastructure requirement...


  • bangalore, India gnani.ai Full time

    We are seeking a Senior Natural Language Processing (NLP) Engineer with a robust background in developing multilingual voice bots and chatbots. The ideal candidate will possess knowledge of pretraining and continual pretraining of large language models (LLMs) for multiple languages. Expertise in fine-tuning LLMs using Parameter Efficient Fine-Tuning (PEFT)...


  • Bangalore, India gnani.ai Full time

    We are seeking a Senior Natural Language Processing (NLP) Engineer with a robust background in developing multilingual voice bots and chatbots. The ideal candidate will possess knowledge of pretraining and continual pretraining of large language models (LLMs) for multiple languages. Expertise in fine-tuning LLMs using Parameter Efficient Fine-Tuning (PEFT)...

  • LLM Engineer

    2 weeks ago


    bangalore, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.Translate business to technical requirementsOwn technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocationData driven decision making skills with focus on achieving product goalsDesign, develop and deploy LLM based...

  • LLM Engineer

    2 days ago


    bangalore, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.- Translate business to technical requirements- Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation- Data driven decision making skills with focus on achieving product goals- Design, develop and deploy LLM...

  • LLM Engineer

    11 hours ago


    bangalore, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems. - Translate business to technical requirements - Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation - Data driven decision making skills with focus on achieving product goals - Design, develop and deploy...

  • LLM Engineer

    2 weeks ago


    Bangalore, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems. Translate business to technical requirements Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation Data driven decision making skills with focus on achieving product goals Design, develop and deploy LLM...

  • Llm engineer

    2 weeks ago


    Bangalore, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems. Translate business to technical requirements Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation Data driven decision making skills with focus on achieving product goals Design, develop and deploy LLM...


  • bangalore, India gnani.ai Full time

    We are seeking a Senior Natural Language Processing (NLP) Engineer with a robust background in developing multilingual voice bots and chatbots. The ideal candidate will possess knowledge of pretraining and continual pretraining of large language models (LLMs) for multiple languages. Expertise in fine-tuning LLMs using Parameter Efficient Fine-Tuning (PEFT)...


  • bangalore, India Orison Solutions Full time

    Job Description Position: LLM Hardware Design Developer Experience: 3 to 5yrs Remote Job Description Were searching for an exceptional hardware design Developer to play a pivotal role in using the hardware design platform to generate the training data to enhance enterprise LLMs capabilities. This unique position offers the chance to directly contribute to...


  • bangalore, India Orison Solutions Full time

    Job Description Position: LLM Hardware Design Developer Experience: 3 to 5yrs Remote Job Description Were searching for an exceptional hardware design Developer to play a pivotal role in using the hardware design platform to generate the training data to enhance enterprise LLMs capabilities. This unique position offers the chance to directly...

  • LLM Engineer

    10 hours ago


    bangalore, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems. Translate business to technical requirements Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation Data driven decision making skills with focus on achieving product goals Design, develop and deploy LLM based...

  • LLM Engineer

    2 weeks ago


    bangalore, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.Translate business to technical requirementsOwn technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocationData driven decision making skills with focus on achieving product goalsDesign, develop and deploy LLM based...


  • Bangalore, India Resourcetree Full time

    Role and Responsibilities:We are seeking a highly skilled Senior AI/ML Operations Manager to join our team at Resourcetree. The successful candidate will be responsible for defining and disseminating best practices for Large Language Model (LLM) operations, evaluating and comparing different tools, and collaborating with architects, engineers, and data...

  • Llm engineer

    4 days ago


    Bangalore City, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems. Translate business to technical requirements Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation Data driven decision making skills with focus on achieving product goals Design, develop and deploy LLM based...


  • bangalore, India gnani.ai Full time

    Job Description for Junior NLP EngineerWe are seeking a Junior Natural Language Processing (NLP) Engineer with a foundational background in developing multilingual voice bots and chatbots. The ideal candidate will have a basic understanding of pretraining and continual pretraining of large language models (LLMs) for multiple languages. Familiarity with...

  • Data Scientist

    3 weeks ago


    Bangalore, Karnataka, India Rohini IT Consulting LLP Full time

    Role : Data ScientistLocation : Bangalore (Remote)Experience : 5+ yearsSkills Required : Radiology, visual images, text, classical model, LLM multi modelJob Description :We are seeking an experienced Data Scientist with a proven track record in Machine Learning, Deep Learning, and a demonstrated focus on Large Language Models (LLMs) to join our cutting-edge...