Senior LLM Engineer

2 days ago


Pune, Maharashtra, India Infocusp Innovations Full time ₹ 12,50,000 - ₹ 17,50,000 per year

About the role

The Senior LLM Engineer will lead the design, development, and deployment of complex agentic AI solutions within production environments, working with multi-agent frameworks and orchestrating large language models. The position is for scalable applied AI, with a focus on delivering robust and fair agentic systems that deliver organizational value, autonomy, and operational efficiency.​

Key Responsibilities

  • Architect, design, and deploy scalable agentic AI systems that coordinate LLMs, multi-agent collaboration, and external tool integrations through advanced tool calling.​
  • Develop, maintain, and optimize AI-driven pipelines utilizing frameworks such as LangGraph, ADK and LangChain, enhancing data inference and orchestration.​
  • Integrate agentic AI solutions into enterprise workflows, automating complex business functions (e.g., customer service, supply chain, decision support).​
  • Proactively address system evaluation, debug AI agent workflows, and ensure compliance with emerging regulatory and ethical guidelines.​
  • Promote security, transparency, fairness, and reliability across all deployed agentic systems.​
  • Mentor junior engineers, contribute to cross-functional teams, and champion the adoption of state-of-the-art LLM technologies and practices.​

Required Qualifications

  • 4+ years of overall experience working on industry projects
  • At least 1 year of experience with LangGraph (must have)
  • Experience with LangChain, and other agentic orchestration frameworks.​
  • Deep proficiency in designing and deploying multi-agent frameworks and sophisticated tool-calling or API orchestration pipelines.​
  • Design and implement continuous monitoring systems for autonomous AI agents, ensuring performance, reliability, adherence to ethical guardrails, and optimal cost/latency in production.
  • Develop and execute scalable LLM evaluation methodologies (including code-based, LLM-as-a-Judge) to rigorously assess model quality, safety, and goal alignment
  • Proficiency in Python
  • Familiarity with retrieval-augmented generation (RAG) and modern vector databases (Pinecone, Weaviate).​
  • Experience with cloud platforms (AWS, GCP, Azure), MLOps practices, and production-grade deployment.​
  • Strong understanding of data privacy, model security, and compliance with current AI regulations and frameworks.​

Preferred Skills

  • Experience with Hugging Face, Neo4j, or knowledge graphs.​
  • Background in autonomous decision-making systems, anomaly detection, and dynamic process optimization.​
  • Track record of publishing, presenting, or open-sourcing agentic AI innovations.​
  • Strong problem-solving aptitude, collaborative mindset, and excellent communication skills.​

Location:

Ahmedabad/ Pune


  • LLM Engineer

    2 weeks ago


    Pune, Maharashtra, India Zorba Consulting Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role Description :This is a contract remote role for a LLM Engineer with 4+ years of experience. The LLM Engineer will be responsible for developing, deploying, and optimizing large language models (LLMs). The day-to-day tasks include designing NLP solutions, fine-tuning models, collaborating with cross-functional teams, and ensuring model performance and...

  • LLM Ops Engineer

    8 hours ago


    Pune, Maharashtra, India Pattern Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Monitor, evaluate, and optimize AI/LLM workflows in production environments. Ensure reliable, efficient, and high-quality AI system performance by building out an LLM Ops platform that is self-serve for the engineering and data science departments. Key Responsibilities:-Collaborate with data scientists and software engineers to integrate an LLM Ops platform...


  • Pune, Maharashtra, India Rapid7 Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Senior CloudOps EngineerJob Description:We are seeking an experienced and highly specialized Senior CloudOps Engineer to manage, automate, and secure our production cloud infrastructure and Machine Learning (ML)/Large Language Model (LLM) operational pipelines. This role is strictly focused on the operations and infrastructure that supports our data science...

  • Senior AI Engineer

    2 weeks ago


    Pune, Maharashtra, India The Goodstack Company Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    An SF based startup is looking to hire a Senior AI Engineer.The role is fully remote.Here's What The Day-to-day Responsibilities Will Look Like -Design and implement conversational AI agents using LLMsBuild RAG pipelines to process e-commerce dataOptimize prompt engineering for accuracy and cost efficiencyCreate data ingestion pipelines for various formats...


  • Pune, Maharashtra, India Rapid7 Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Senior CloudOps Engineer Job Description:We are seeking an experienced and highly specialized Senior CloudOps Engineer to manage, automate, and secure our production cloud infrastructure and Machine Learning (ML)/Large Language Model (LLM) operational pipelines. This role is strictly focused on the operations and infrastructure that supports our data...


  • Pune, Maharashtra, India Pattern Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role Overview :-Monitor, evaluate, and optimize AI/LLM workflows in production environments. Ensure reliable, efficient, and high-quality AI system performance by building out an LLM Ops platform that is self-serve for the engineering and data science departments.Key Responsibilities:-Collaborate with data scientists and software engineers to integrate an...


  • Pune, Maharashtra, India SSterling Workforce Enterprises Private Limited Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    Location: PuneExperience: 3+ yearsPreferred: IIT candidates onlyPosition: Software Engineer / Senior Software Engineer :We're looking for a passionate and experienced Software Engineers/Senior Software Engineer to join our Pune team and spearhead the development of a production-grade LLM-based agentic platform. In this role, you'll be instrumental in...


  • Pune, Maharashtra, India Tekskills Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Senior Gen AI EngineerExperience: 4–6 yearsLocation: Gurgaon / PuneRole OverviewWe are seeking a Senior Gen AI Engineer with proven experience in building and deploying Generative AI and scaled ML systems. The role involves end-to-end ownership of AI solutions — from model selection, fine-tuning, and pipeline design to deployment on cloud ML...

  • Senior AI Engineer

    3 days ago


    Pune, Maharashtra, India Internet Soft Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Senior AI / Machine Learning Engineer (LLMs, MLOps, Generative AI, Cloud Deployment)Location:PuneExperience:7+ Years (AI, Machine Learning, Deep Learning & MLOps)About the RoleWe are seeking aSenior AI & Machine Learning Engineerwith proven experience in building and deploying advanced AI systems at scale. The ideal candidate will have deep expertise inLarge...


  • Pune, Maharashtra, India VOICERAcx Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Location:Pune, India (Hybrid: 4 days onsite + 1 day remote)Department:AI Research & DevelopmentExperience Level:Senior / Research-FocusedWe appreciate diverse experiences, but this role is not suitable for candidates whose primary experience is limited to orchestration or prompt engineering of pre-trained LLMs. We are looking for individuals with deep...