Senior LLM Engineer

2 days ago

Bengaluru, Karnataka, India Ringcentral Full time

We are seeking an experienced AI Engineer with a strong background in Natural Language Understanding (NLU) who is passionate about pushing the boundaries of Conversational AI. In this role, you will design, develop, and deploy scalable AI solutions leveraging LLMs, Retrieval-Augmented Generation (RAG), and prompt engineering techniques to power intelligent products and services.

As part of our ML/AI team, youll own the full lifecycle of model development — from data preparation and fine-tuning to inference optimization and deployment in production environments.

Responsibilities:

  • Design, fine-tune, and deploy LLM-based applications for Conversational AI use cases
  • Build scalable retrieval-augmented generation (RAG) pipelines that combine LLMs with structured/unstructured data sources
  • Develop prompt engineering strategies, templates, and evaluation frameworks for LLM-driven workflows
  • Collaborate with cross-functional teams to identify and implement AI-driven solutions to business problems
  • Optimize models for low-latency inference using quantization, distillation, and other model optimization techniques (e.g., ONNX, TensorRT)
  • Build robust data processing, labeling, and augmentation pipelines to improve model performance
  • Implement monitoring and evaluation systems for deployed LLMs, ensuring reliability, fairness, and safety
  • Stay current with emerging trends in LLMs, retrieval systems, and generative AI frameworks

Requirements:

  • 5-8 years of hands-on experience in NLU
  • Strong proficiency in Python and PyTorch and related frameworks (like Hugging Face Transformers, Sentence Transformers etc.)
  • Proven experience developing and deploying NLP or LLM pipelines in production environments at scale
  • Solid understanding of transformer architectures and attention mechanisms
  • Proficiency in using LLM provider APIs such as OpenAI, Gemini etc.including prompt design, fine-tuning, and evaluation
  • Experience with model optimization techniques such as quantization, pruning, ONNX, TensorRT, or model distillation
  • Bachelor's or Master's degree in Computer Science, Artificial Intelligence, or a related field

Nice to Have:

  • Hands-on experience with RAG and vector databases (e.g., FAISS, Qdrant, pgVector etc. )
  • Prior work on LLM fine-tuning, alignment, or evaluation
  • Experience with LLM orchestration frameworks such as LlamaIndex or similar tools
  • Familiarity with multi-provider LLM orchestration, integrating APIs from OpenAI, Gemini etc. and others for fallbacks, routing, or ensemble strategies
  • Knowledge of MLOps for LLMs, including model serving and monitoring
  • Understanding of embedding models, context management, and token optimization for scalable LLM applications

  • LLM Engineer

    2 days ago

    Bengaluru, Karnataka, India Teleradiology Solutions Full time ₹ 5,00,000 - ₹ 10,00,000 per year

    About The RoleWe are looking for a passionate LLM Engineer Intern to join our teamThis is an exciting opportunity to work on state-of-the-art Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and Generative AI applicationsYou will gain hands-on experience in fine-tuning, deploying, and optimizing LLMs to enhance real-world applications- Key...

  • Senior LLM Engineer

    1 week ago

    Bengaluru, Karnataka, India Vega Intellisoft Full time ₹ 8,00,000 - ₹ 18,00,000 per year

    Designation: Senior LLM EngineerLocation: BangaloreBudget: 8LPA-18LPANotice Period: ImmediateRoles and ResponsibilitiesMust Have Skill Overall 7+ years with at least 2+ years of experience working with transformer-based models and NLP tasks, with a focus on text generation, summarization, question answering, classification, and similar tasks. Expertise in...

  • LLM Engineer

    6 days ago

    Bengaluru, Karnataka, India Zorba Consulting Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    This is a contract remote role for a LLM Engineer with 4+ years of experience. The LLM Engineer will be responsible for developing, deploying, and optimizing large language models (LLMs). The day-to-day tasks include designing NLP solutions, fine-tuning models, collaborating with cross-functional teams, and ensuring model performance and scalability. The...

  • Senior LLM Engineer

    7 days ago

    Bengaluru, Karnataka, India Nomiso Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position Overview :We are seeking an experienced NLP & LLM Specialist to join our team. The ideal candidate will have deep expertise in working with transformer-based models, including GPT, BERT, T5, RoBERTa, and similar models. This role requires experience in fine-tuning these pre-trained models on domain-specific tasks, as well as crafting and...

  • LLM & Prompt Engineer

    4 days ago

    Bengaluru, Karnataka, India Purecode Software Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    ResponsibilitiesDevelop and optimize prompts for AI systems to assist developers in generating high-quality code, improving documentation, and automating tasks. Designing, Developing and Refining prompts to enhance the quality and relevance of generated response. Monitor and analyze prompts performance to identify areas of improvements. Understand user...

  • Intern GenAI/LLM

    1 week ago

    Bengaluru, Karnataka, India de506a80-ae10-4ec2-8b8d-af460ab36056 Full time ₹ 60,000 - ₹ 1,80,000 per year

    We're looking for a motivated GenAI / LLM Intern to support our work in building real-world AI applications using modern Large Language Models. If you're passionate about Generative AI, enjoy experimenting with models, and want hands-on experience with practical AI systems, this role is for you.What You'll Work OnLLM Fine-Tuning & TestingWork with...

  • Senior Python Engineer

    1 week ago

    Bengaluru, Karnataka, India Shuru Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title:Senior Software Development Engineer (SDE 3) – Python (AI Chatbot)Experience:6+ YearsLocation:Onsite – Koramangala, BangaloreEmployment Type:Full-timeAbout the Role:We are seeking a highly skilled Senior Python Engineer with deep expertise in building AI-driven chatbot systems and end-to-end LLM-powered applications. In this role, you will...

  • LLM Lead

    2 weeks ago

    Bengaluru, Karnataka, India Zorba Consulting Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    Role : Spearhead the design, development, and deployment of cutting-edge AI solutions. You will lead a team of AI engineers, collaborate with cross-functional stakeholders, and drive innovation in machine learning, deep learning, and large language model applications. This role demands a strong foundation in AI technologies, hands-on experience in...

  • LLM Lead

    7 days ago

    Bengaluru, Karnataka, India Zorba Consulting Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the job : Role : Spearhead the design, development, and deployment of cutting-edge AI solutions. You will lead a team of AI engineers, collaborate with cross-functional stakeholders, and drive innovation in machine learning, deep learning, and large language model applications. This role demands a strong foundation in AI technologies, hands-on...

  • Senior Engineer

    2 weeks ago

    Bengaluru, Karnataka, India RTX Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Date Posted: Country:IndiaLocation:North Gate Business Park Sy.No 2/1, and Sy.No 2/2, KIAL Road, Venkatala Village, Chowdeshwari Layout, Yelahanka, Bangalore, Karnataka Position Role Type:UnspecifiedSenior Engineer - Data Science & AnalyticsPratt & Whitney is working to once again transform the future of flight—designing, building and servicing engines...