Senior LLM Engineer

2 days ago

Bengaluru Karnataka India, Karnataka RingCentral Full time

Job Description:

We are seeking an experienced AI Engineer with a strong background in Natural Language Understanding (NLU) who is passionate about pushing the boundaries of Conversational AI. In this role, you will design, develop, and deploy scalable AI solutions leveraging LLMs, Retrieval-Augmented Generation (RAG), and prompt engineering techniques to power intelligent products and services.

As part of our ML/AI team, you’ll own the full lifecycle of model development — from data preparation and fine-tuning to inference optimization and deployment in production environments.


Responsibilities:

  • Design, fine-tune, and deploy LLM-based applications for Conversational AI use cases
  • Build scalable retrieval-augmented generation (RAG) pipelines that combine LLMs with structured/unstructured data sources
  • Develop prompt engineering strategies, templates, and evaluation frameworks for LLM-driven workflows
  • Collaborate with cross-functional teams to identify and implement AI-driven solutions to business problems
  • Optimize models for low-latency inference using quantization, distillation, and other model optimization techniques (e.g., ONNX, TensorRT)
  • Build robust data processing, labeling, and augmentation pipelines to improve model performance
  • Implement monitoring and evaluation systems for deployed LLMs, ensuring reliability, fairness, and safety
  • Stay current with emerging trends in LLMs, retrieval systems, and generative AI frameworks


Requirements:

  • 5-8 years of hands-on experience in NLU
  • Strong proficiency in Python and PyTorch and related frameworks (like Hugging Face Transformers, Sentence Transformers etc.)
  • Proven experience developing and deploying NLP or LLM pipelines in production environments at scale
  • Solid understanding of transformer architectures and attention mechanisms
  • Proficiency in using LLM provider APIs such as OpenAI, Gemini etc.including prompt design, fine-tuning, and evaluation
  • Experience with model optimization techniques such as quantization, pruning, ONNX, TensorRT, or model distillation
  • Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, or a related field


Nice to Have:

  • Hands-on experience with RAG and vector databases (e.g., FAISS, Qdrant, pgVector etc. )
  • Prior work on LLM fine-tuning, alignment, or evaluation
  • Experience with LLM orchestration frameworks such as LlamaIndex or similar tools
  • Familiarity with multi-provider LLM orchestration, integrating APIs from OpenAI, Gemini etc. and others for fallbacks, routing, or ensemble strategies
  • Knowledge of MLOps for LLMs, including model serving and monitoring
  • Understanding of embedding models, context management, and token optimization for scalable LLM applications

  • Senior LLM Engineer

    7 days ago

    Bengaluru, Karnataka, India Prodigy Placement LLP Full time ₹ 1,20,000 - ₹ 12,00,000 per year

    Position: Senior LLM EngineerExperience: Overall 7+YrsRelevant : 4+YrsLocation: Hyderabad(Onsite)Budget: 1.40LPM+GSTSalary Range : 10-12 LPAGood to Have:Experience with LLM observability tools and monitoring pipelines.Exposure to cloud platforms (AWS, GCP, Azure) for scalable model deployment.Knowledge of MLOps practices for model lifecycle management.Job...

  • Senior LLM Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Vega Intellisoft Full time ₹ 8,00,000 - ₹ 18,00,000 per year

    Designation: Senior LLM EngineerLocation: BangaloreBudget: 8LPA-18LPANotice Period: ImmediateRoles and ResponsibilitiesMust Have Skill Overall 7+ years with at least 2+ years of experience working with transformer-based models and NLP tasks, with a focus on text generation, summarization, question answering, classification, and similar tasks. Expertise in...

  • LLM Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Zorba Consulting Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    This is a contract remote role for a LLM Engineer with 4+ years of experience. The LLM Engineer will be responsible for developing, deploying, and optimizing large language models (LLMs). The day-to-day tasks include designing NLP solutions, fine-tuning models, collaborating with cross-functional teams, and ensuring model performance and scalability. The...

  • Senior LLM Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Nomiso Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position Overview :We are seeking an experienced NLP & LLM Specialist to join our team. The ideal candidate will have deep expertise in working with transformer-based models, including GPT, BERT, T5, RoBERTa, and similar models. This role requires experience in fine-tuning these pre-trained models on domain-specific tasks, as well as crafting and...

  • Senior AI Engineer – LLM

    2 days ago

    Bengaluru, Karnataka, India Zscaler Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About ZscalerServing thousands of enterprise customers around the world including 45% of Fortune 500 companies, Zscaler (NASDAQ: ZS) was founded in 2007 with a mission to make the cloud a safe place to do business and a more enjoyable experience for enterprise users. As the operator of the world's largest security cloud, Zscaler accelerates digital...

  • LLM AI Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Gainwell Technologies LLC Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    SummaryGainwell is seeking LLM Ops Engineers and ML Ops Engineers to join our growing AI/ML team. This role is responsible for developing, deploying, and maintaining scalable infrastructure and pipelines for Machine Learning (ML) models and Large Language Models (LLMs). You will play a critical role in ensuring smooth model lifecycle management, performance...

  • Senior Front End Engineer

    1 week ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    TCS hiring!!Role: Senior Front End Engineer (ReactJs) with AI promptLocation: BangaloreExperience: 8-10Must have:front-end development (ReactJs) and integration with UX design.Extensive experience in large-scale software/platform projects.Proven track record in leveraging AI/LLM tools for coding or workflow optimization.Expertise in prompt engineering and...

  • Senior AI Engineer

    2 days ago

    Bengaluru, Karnataka, India, Karnataka Acronotics Limited Full time

    About the CompanyAcronotics is a global consulting, services and a product company specialising in Hyper Automation (IPA & Low Code Process Automation), Data Science & Artificial Intelligence (AI). We design, develop and implement cognitive automation solutions by applying a combination of RPA & AI technologies such as ML, NLP, NLG for clients across...

  • Software Engineer/Senior Software Engineer

    15 hours ago

    Bengaluru, Karnataka, India, Karnataka Diligent Full time

    Position Overview:We are seeking a talented and driven Senior Software Engineer in AI to join our growing team at Diligent. Reporting to Applied Science Manager, this exciting role involves bridging the gap between Applied Scientists and Product teams - developing, deploying, and scaling ML and LLM-based systems as part of Diligent’s AI platform services...

  • Senior Software Engineer Technical Lead

    6 days ago

    Bengaluru, Karnataka, India, Karnataka MarketsandMarkets™ Full time

    Why Join UsAt Markets&Markets product team, we are building AI agents that will be the copilot of every enterprise function like sales, marketing, founder's office/strategy teams etc. Join a mission-driven product company building intelligent, real-world solutions for driving growth and revenue for Fortune 2000 companies. If you are a builder with high...