Senior LLM Engineer

5 days ago

Bengaluru Karnataka India, Karnataka Astra Tech Full time

Role Summary:


We are looking for a Senior LLM Engineer with deep expertise in Large Language Model development, orchestration, and application engineering. The ideal candidate has 3–5 years of hands-on experience building and deploying AI systems using LangChain, LangGraph, and related frameworks. You will be responsible for designing, implementing, and optimizing complex, multi-agent LLM applications that drive real business value.


Key Responsibilities:


  • Design, build, and optimize LLM-based systems leveraging LangChain, LangGraph, and vector databases.
  • Develop and maintain modular prompt pipelines, agents, and tools that enable dynamic reasoning and contextual understanding.
  • Integrate LLMs with APIs, databases, and internal tools for seamless automation and data interaction.
  • Fine-tune, evaluate, and deploy foundation models (e.g., OpenAI, Anthropic, Mistral, Llama) for domain-specific applications.
  • Implement retrieval-augmented generation (RAG) and knowledge graph reasoning pipelines.
  • Collaborate with cross-functional teams — product managers, data engineers, and researchers — to bring LLM-driven products to life.
  • Contribute to LLM system architecture design, ensuring scalability, maintainability, and performance.
  • Stay current with emerging AI frameworks, model APIs, and orchestration patterns.


Key requirements:


  • Master’s degree or PHD Degree in Computer Science, Artificial Intelligence, or a related field.
  • 3–5 years of experience developing with LangChain and LangGraph in production environments.
  • Strong proficiency in Python/Java Scripts and LLM APIs (OpenAI, Anthropic, Hugging Face, etc.).
  • Experience with RAG pipelines, embeddings, and vector databases.
  • Solid understanding of prompt engineering, LLM evaluation, and tool/agent design.
  • Experience with Docker, Git, and modern cloud environments (e.g. Azure or AWS etc.).
  • Experience with multi-agent systems, function calling, and graph-based orchestration.
  • Familiarity with LangSmith or LLMOps tools for observability and performance tracking.
  • Knowledge of data pipelines, ETL systems, or microservice architectures.
  • Prior work in AI product development, chatbot orchestration, or automation systems.

  • Senior ML Engineer – LLMs

    1 week ago

    Bengaluru, Karnataka, India, Karnataka Hodos360.ai Full time

    Job Title: Senior ML Engineer – LLMsCompany: Hodos 360Location: Bangalore (Work From Office – WFO)Shift: 5:00 PM to 2:00 AM ISTExperience: 3–8 yearsAbout Hodos 360Hodos 360 builds AI-driven products and solutions for global businesses, with a strong focus on Large Language Models (LLMs) and automation. We work closely with clients to understand their...

  • Senior Agentic AI Engineer

    7 days ago

    Bengaluru, Karnataka, India, Karnataka Winpra Full time

    Winpra is revolutionizing the real estate industry through advanced AI-powered analytics. We're building cutting-edge solutions that combine Large Language Models (LLMs) with real estate expertise to deliver unprecedented insights and automation capabilities.Position OverviewWe're seeking an Agentic AI Engineer to join our innovative team and help shape the...

  • LLM Engineer

    4 days ago

    Bengaluru, Karnataka, India Teleradiology Solutions Full time

    About The RoleWe are looking for a passionate LLM Engineer Intern to join our teamThis is an exciting opportunity to work on state-of-the-art Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and Generative AI applicationsYou will gain hands-on experience in fine-tuning, deploying, and optimizing LLMs to enhance real-world applications- Key...

  • Senior LLM Engineer

    4 days ago

    Bengaluru, Karnataka, India Ringcentral Full time

    We are seeking an experienced AI Engineer with a strong background in Natural Language Understanding (NLU) who is passionate about pushing the boundaries of Conversational AI. In this role, you will design, develop, and deploy scalable AI solutions leveraging LLMs, Retrieval-Augmented Generation (RAG), and prompt engineering techniques to power intelligent...

  • LLM Engineer

    15 hours ago

    Bengaluru, Karnataka, India micro1 Full time

    Job Title: LLM EngineerExperience: 3 to 9 YearsLocation: Pune, Gurugram, Bengaluru, Hyderabad (Hybrid)Job Type: Contract (Full Time)We are seeking a skilledLLM Engineerto join our customer's team and help build advanced AI-driven solutions. In this role, you will work with modern LLM frameworks, vector databases, and MLOps tools to design, develop, and...

  • LLM Engineer

    3 days ago

    Bengaluru, Karnataka, India Lean IT Inc Full time

    Title: LLM EngineerExperience: 4+ yrsJoining: Immediate JoinerLocation: Noida , Gurgaon, Bangalore ,PuneHire Mode: ContactMust Have SkillsProgramming: Python (Advanced), FastAPICloud Platforms: AWS / Azure (hands-on experience)Gen AI: LangChain, LlamaIndex (or equivalents), Agentic AI frameworks like LangGraph or CrewAI, Vector DB (like Pinecone or...

  • Senior Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Deep Cognition Full time

    Job descriptionWe are seeking a skilled Senior Software Engineer - AI to design and develop automation software that leverages Large Language Model (LLM) APIs such as OpenAI, Anthropic, or similar frameworks. The ideal candidate will have a strong background in Python, API integration, and workflow automation, with a passion for building intelligent,...

  • Senior ML Engineer – LLM Pre-Training, Distributed Training

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka gnani.ai Full time

    IndiaAI is building India’s next-gen foundational LLMs. We’re looking for a hands-on Senior ML Engineer experienced in large-scale pre-training, distributed GPU systems, and data creation pipelines. You will work with Megatron-LM, NVIDIA NeMo, DeepSpeed, PyTorch Distributed, and SLURM to train 7B–70B+ models on multi-node GPU clusters. What You’ll...

  • Senior Artifical Engineer

    1 week ago

    Bengaluru, Karnataka, India, Karnataka Infosys Full time

    We are seeking a highly skilled Senior AI Engineer with strong expertise in Python, Generative AI, and Agentic AI. The ideal candidate will have hands-on experience working with LLM, RAG, and advanced AI model. The role required strong problem solving skills, strong analytic skills and effective communication to collaborate across team and deliver cutting...

  • Senior Security Engineer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Razorpay Full time

    Title: Senior Product Security Security EngineerThe Role:Razorpay is looking for a Senior Application Security Engineer with solid experience in AppSec fundamentals—secure code review, vulnerability discovery, API security, and practical pentesting skills. The ideal candidate should also be able to perform basic threat modeling for new features and...