Senior LLM Engineer

5 days ago

Bengaluru, Karnataka, India Ringcentral Full time

We are seeking an experienced AI Engineer with a strong background in Natural Language Understanding (NLU) who is passionate about pushing the boundaries of Conversational AI. In this role, you will design, develop, and deploy scalable AI solutions leveraging LLMs, Retrieval-Augmented Generation (RAG), and prompt engineering techniques to power intelligent products and services.

As part of our ML/AI team, youll own the full lifecycle of model development — from data preparation and fine-tuning to inference optimization and deployment in production environments.

Responsibilities:

  • Design, fine-tune, and deploy LLM-based applications for Conversational AI use cases
  • Build scalable retrieval-augmented generation (RAG) pipelines that combine LLMs with structured/unstructured data sources
  • Develop prompt engineering strategies, templates, and evaluation frameworks for LLM-driven workflows
  • Collaborate with cross-functional teams to identify and implement AI-driven solutions to business problems
  • Optimize models for low-latency inference using quantization, distillation, and other model optimization techniques (e.g., ONNX, TensorRT)
  • Build robust data processing, labeling, and augmentation pipelines to improve model performance
  • Implement monitoring and evaluation systems for deployed LLMs, ensuring reliability, fairness, and safety
  • Stay current with emerging trends in LLMs, retrieval systems, and generative AI frameworks

Requirements:

  • 5-8 years of hands-on experience in NLU
  • Strong proficiency in Python and PyTorch and related frameworks (like Hugging Face Transformers, Sentence Transformers etc.)
  • Proven experience developing and deploying NLP or LLM pipelines in production environments at scale
  • Solid understanding of transformer architectures and attention mechanisms
  • Proficiency in using LLM provider APIs such as OpenAI, Gemini etc.including prompt design, fine-tuning, and evaluation
  • Experience with model optimization techniques such as quantization, pruning, ONNX, TensorRT, or model distillation
  • Bachelor's or Master's degree in Computer Science, Artificial Intelligence, or a related field

Nice to Have:

  • Hands-on experience with RAG and vector databases (e.g., FAISS, Qdrant, pgVector etc. )
  • Prior work on LLM fine-tuning, alignment, or evaluation
  • Experience with LLM orchestration frameworks such as LlamaIndex or similar tools
  • Familiarity with multi-provider LLM orchestration, integrating APIs from OpenAI, Gemini etc. and others for fallbacks, routing, or ensemble strategies
  • Knowledge of MLOps for LLMs, including model serving and monitoring
  • Understanding of embedding models, context management, and token optimization for scalable LLM applications

  • LLM Engineer

    5 days ago

    Bengaluru, Karnataka, India Teleradiology Solutions Full time

    About The RoleWe are looking for a passionate LLM Engineer Intern to join our teamThis is an exciting opportunity to work on state-of-the-art Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and Generative AI applicationsYou will gain hands-on experience in fine-tuning, deploying, and optimizing LLMs to enhance real-world applications- Key...

  • Senior ML Engineer – LLMs

    1 week ago

    Bengaluru, Karnataka, India, Karnataka Hodos360.ai Full time

    Job Title: Senior ML Engineer – LLMsCompany: Hodos 360Location: Bangalore (Work From Office – WFO)Shift: 5:00 PM to 2:00 AM ISTExperience: 3–8 yearsAbout Hodos 360Hodos 360 builds AI-driven products and solutions for global businesses, with a strong focus on Large Language Models (LLMs) and automation. We work closely with clients to understand their...

  • Senior LLM Engineer

    6 days ago

    Bengaluru, Karnataka, India, Karnataka Astra Tech Full time

    Role Summary:We are looking for a Senior LLM Engineer with deep expertise in Large Language Model development, orchestration, and application engineering. The ideal candidate has 3–5 years of hands-on experience building and deploying AI systems using LangChain, LangGraph, and related frameworks. You will be responsible for designing, implementing, and...

  • LLM Engineer

    22 hours ago

    Bengaluru, Karnataka, India micro1 Full time

    Job Title: LLM EngineerExperience: 3 to 9 YearsLocation: Pune, Gurugram, Bengaluru, Hyderabad (Hybrid)Job Type: Contract (Full Time)We are seeking a skilledLLM Engineerto join our customer's team and help build advanced AI-driven solutions. In this role, you will work with modern LLM frameworks, vector databases, and MLOps tools to design, develop, and...

  • LLM Engineer

    3 days ago

    Bengaluru, Karnataka, India Lean IT Inc Full time

    Title: LLM EngineerExperience: 4+ yrsJoining: Immediate JoinerLocation: Noida , Gurgaon, Bangalore ,PuneHire Mode: ContactMust Have SkillsProgramming: Python (Advanced), FastAPICloud Platforms: AWS / Azure (hands-on experience)Gen AI: LangChain, LlamaIndex (or equivalents), Agentic AI frameworks like LangGraph or CrewAI, Vector DB (like Pinecone or...

  • LLM Systems

    2 weeks ago

    Bengaluru, Karnataka, India Weekday Full time ₹ 8,00,000 - ₹ 20,00,000

    This role is for one of our clientsIndustry: Human Resources ServicesSeniority level: Mid-Senior levelMin Experience: 6 yearsLocation: Bengaluru, Karnataka, NCR, DelhiJobType: full-time ₹8,00,000 - ₹20,00,000 a year We are seeking a highly skilled LLM Systems & MLOps Architect to drive end-to-end architecture, optimization, and deployment of large-scale...

  • LLM & Prompt Engineer

    7 days ago

    Bengaluru, Karnataka, India Purecode Software Full time

    ResponsibilitiesDevelop and optimize prompts for AI systems to assist developers in generating high-quality code, improving documentation, and automating tasks. Designing, Developing and Refining prompts to enhance the quality and relevance of generated response. Monitor and analyze prompts performance to identify areas of improvements. Understand user...

  • Senior Agentic AI Engineer

    7 days ago

    Bengaluru, Karnataka, India, Karnataka Winpra Full time

    Winpra is revolutionizing the real estate industry through advanced AI-powered analytics. We're building cutting-edge solutions that combine Large Language Models (LLMs) with real estate expertise to deliver unprecedented insights and automation capabilities.Position OverviewWe're seeking an Agentic AI Engineer to join our innovative team and help shape the...

  • AI Engineer LLM

    2 weeks ago

    Bengaluru, Karnataka, India Mopid Full time ₹ 17,00,000 - ₹ 52,00,000 per year

    ai engineer positionwe are seeking a highly skilled and experienced ai engineer to join our innovative team in bengaluru. this role is perfect for someone with a passion for artificial intelligence and machine learning, looking to apply their skills in llm, rag, gpt, and llama within a dynamic work environment. with an experience range of 2-5 years, the...

  • Senior Python Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Shuru Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title:Senior Software Development Engineer (SDE 3) – Python (AI Chatbot)Experience:6+ YearsLocation:Onsite – Koramangala, BangaloreEmployment Type:Full-timeAbout the Role:We are seeking a highly skilled Senior Python Engineer with deep expertise in building AI-driven chatbot systems and end-to-end LLM-powered applications. In this role, you will...