Manager/Lead - LLM

1 month ago


Bengaluru, India Resourcetree Full time

Role : Manager / Lead - LLM Ops

Experience : 5 - 10 years

Location : Bangalore

Role and Responsibilities :

- Define and disseminate LLMOps best practices for Aris Global products.

- Evaluate and compare different LLMOps tools to incorporate the best practices.

- Collaborate with architects, engineers, data-scientists, and SMEs to design, implement and oversee the infrastructure requirement for the efficient operation of LLM use-cases in production.

- Develop and maintain CI/CD pipelines for prompts deployment and updates.

- Perform Metrics collection, Performance measurement and feedback analysis of LLM use-cases in production systems.

- Monitor and report the cost for LLM use-cases in production systems.

- Identify and resolve any bottlenecks in production LLM use-cases, including Prompt optimization/tuning.

- Ensure the security of LLM operations through comprehensive risk assessments and the implementation of robust security measures.

Required Technical Skills :

- Overall, 5 to 10 years of experience in AI/ML, with at least 1 year in GenAI and LLM operations.

- Proven experience in productionizing the GenAI projects by applying best LLMOps practices.

- Proven experience in LLM monitoring and observability.

- Practical experience working with LLM models and associated techniques, as well as the tools and frameworks used to implement them, like Langfuse (tool), Langchain (framework), RAG (technique).

- Excellent knowledge of prompt writing and prompt management.

- Good python coding skills.

Required non-technical Skills :

- Excellent presentation and communication skills while interacting with both technical and non-technical stakeholders.

- Motivation to learn new things to stay on top of the GenAI trends by keeping pace with industry advancements in LLM technologies and operational methodologies.

- Resilience and the ability to thrive in a dynamic, fast-paced work environment.

(ref:hirist.tech)

  • Bengaluru, India Resource Tree Global Services Full time

    Role : Manager/Lead - LLM OpsExperience : 5 - 10 years Location : BangaloreRole and Responsibilities :- Define and disseminate LLMOps best practices- Evaluate and compare different LLMOps tools to incorporate the best practices.- Collaborate with architects, engineers, data-scientists, and SMEs to design, implement and oversee the infrastructure requirement...


  • Bengaluru, Karnataka, India Resourcetree Full time

    Job Title: AI/GenAI and LLM Operations Manager/LeadOverviewAt Resourcetree, we are seeking an experienced AI/GenAI and LLM Operations Manager/Lead to join our team. The successful candidate will have a strong background in AI/ML, with a focus on GenAI and LLM operations.ResponsibilitiesDevelop and disseminate LLMOps best practices for Aris Global...


  • Bengaluru, Karnataka, India Resource Tree Global Services Full time

    Job SummaryWe are seeking a highly experienced Senior LLM Operations Manager to join our team at Resource Tree Global Services. The successful candidate will be responsible for defining and disseminating best practices for LLM operations, evaluating and comparing different tools, and collaborating with architects, engineers, and data scientists to design and...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionCloud LLM Pipeline ArchitectAbout the RoleWe are seeking a skilled Cloud LLM Pipeline Architect to design, implement, and maintain our Large Language Model (LLM) infrastructure on a leading cloud platform. As a key member of our team, you will play a critical role in building, automating, and optimizing our LLM pipeline, ensuring seamless...

  • LLM Engineer

    2 months ago


    Bengaluru, India Mazenet solution Full time

    LLM EngineerWe are seeking a highly skilled LLM Engineer with a minimum of 5 years of experience in software development and 1-2 years in LLM solution development. The ideal candidate will have strong experience working with Python, LLM solution patterns and tools (RAG, Vector DB, Agentic workflows, LoRA, etc.) cloud platforms (AWS, Azure, GCP), and DevOps...

  • Automation Test Lead

    3 weeks ago


    Bengaluru, Karnataka, India Winning Edge Full time

    Job Title: Automation Test Lead - AI and LLM ExpertJob Summary:We are seeking an experienced Automation Test Lead to join our team at Winning Edge. As an Automation Test Lead, you will be responsible for designing, developing, and maintaining automated test frameworks and scripts for applications utilizing Large Language Models (LLMs).Key...


  • Bengaluru, Karnataka, India ResourceTee Global Service Full time

    Job DescriptionRole Summary: We are seeking a highly skilled Senior LLM Operations Specialist to join our team at ResourceTee Global Service. The successful candidate will be responsible for defining and implementing best practices for LLM operations, collaborating with cross-functional teams, and ensuring smooth LLM operations.Key Responsibilities:Define...


  • Bengaluru, India gnani.ai Full time

    We are seeking a Senior Natural Language Processing (NLP) Engineer with a robust background in developing multilingual voice bots and chatbots. The ideal candidate will possess knowledge of pretraining and continual pretraining of large language models (LLMs) for multiple languages. Expertise in fine-tuning LLMs using Parameter Efficient Fine-Tuning (PEFT)...


  • Bengaluru, Karnataka, India Rohini IT Consulting LLP Full time

    Rohini IT Consulting LLPWe are seeking an exceptional Data Scientist in LLM Multimodal Healthcare to contribute to groundbreaking advancements in our organization. The ideal candidate will have a strong foundation in data science methodologies and a deep understanding of LLM applications, particularly in the context of radiology, visual images, and...


  • Bengaluru, Karnataka, India Mazenet solution Full time

    Mazenet solution seeks a skilled LLM Solutions Architect to design and develop scalable software solutions.Key Responsibilities:Develop architecture design and lead the development of distributed software systems.Translate business requirements to technical specificationsOwn technical execution, ensuring code quality, adherence to deadlines, and efficient...

  • LLM Engineer

    4 weeks ago


    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.Translate business to technical requirementsOwn technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocationData driven decision making skills with focus on achieving product goalsDesign, develop and deploy LLM based...

  • LLM Engineer

    3 weeks ago


    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.- Translate business to technical requirements- Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation- Data driven decision making skills with focus on achieving product goals- Design, develop and deploy LLM...


  • Bengaluru, Karnataka, India Resourcetree Full time

    About ResourcetreeResourcetree is a dynamic and innovative organization that provides cutting-edge solutions in AI/ML, with a focus on Large Language Model (LLM) operations. Our team is passionate about harnessing the power of GenAI to drive business growth and improve operational efficiency.


  • Bengaluru, Karnataka, India ITC Infotech Full time

    Job SummaryWe are seeking a highly skilled LLM Software Architect to join our team at ITC Infotech. As a key member of our engineering team, you will be responsible for designing and developing scalable and distributed software systems.Key ResponsibilitiesTranslate business requirements into technical specificationsOwn the technical execution of projects,...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Cloud LLM Ops EngineerJob Summary:We are seeking a passionate and experienced Cloud LLM Ops Engineer to join our growing team. You will play a critical role in building, automating, and maintaining our infrastructure on a leading cloud platform (Microsoft Azure, AWS, or GCP).Responsibilities:Utilize Infrastructure as Code (IaC) tools like Terraform to...


  • Bengaluru, Karnataka, India ResourceTee Global Service Full time

    Job Title: LLM Operations SpecialistJob Summary: We are seeking a highly skilled LLM Operations Specialist to join our team at ResourceTee Global Service. As a LLM Operations Specialist, you will be responsible for defining and implementing best practices for our LLMOps operations. You will work closely with our cross-functional teams to ensure smooth LLM...

  • LLM Engineer

    1 month ago


    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.Translate business to technical requirementsOwn technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocationData driven decision making skills with focus on achieving product goalsDesign, develop and deploy LLM based...

  • LLM Engineer

    1 month ago


    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.Translate business to technical requirementsOwn technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocationData driven decision making skills with focus on achieving product goalsDesign, develop and deploy LLM based...

  • LLM Engineer

    1 month ago


    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems. Translate business to technical requirements Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation Data driven decision making skills with focus on achieving product goals Design, develop and deploy LLM based...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Cloud LLM Infrastructure SpecialistWe are seeking a highly skilled Cloud LLM Infrastructure Specialist to join our team at NTT DATA Services. As a key member of our team, you will play a critical role in designing, building, and maintaining our cloud-based infrastructure for Large Language Models (LLMs) and GenAI solutions.Key Responsibilities:Design and...