Senior LLM Engineer
2 days ago
About the role
The Senior LLM Engineer will lead the design, development, and deployment of complex agentic AI solutions within production environments, working with multi-agent frameworks and orchestrating large language models. The position is for scalable applied AI, with a focus on delivering robust and fair agentic systems that deliver organizational value, autonomy, and operational efficiency.
Key Responsibilities
- Architect, design, and deploy scalable agentic AI systems that coordinate LLMs, multi-agent collaboration, and external tool integrations through advanced tool calling.
- Develop, maintain, and optimize AI-driven pipelines utilizing frameworks such as LangGraph, ADK and LangChain, enhancing data inference and orchestration.
- Integrate agentic AI solutions into enterprise workflows, automating complex business functions (e.g., customer service, supply chain, decision support).
- Proactively address system evaluation, debug AI agent workflows, and ensure compliance with emerging regulatory and ethical guidelines.
- Promote security, transparency, fairness, and reliability across all deployed agentic systems.
- Mentor junior engineers, contribute to cross-functional teams, and champion the adoption of state-of-the-art LLM technologies and practices.
Required Qualifications
- 4+ years of overall experience working on industry projects
- At least 1 year of experience with LangGraph (must have)
- Experience with LangChain, and other agentic orchestration frameworks.
- Deep proficiency in designing and deploying multi-agent frameworks and sophisticated tool-calling or API orchestration pipelines.
- Design and implement continuous monitoring systems for autonomous AI agents, ensuring performance, reliability, adherence to ethical guardrails, and optimal cost/latency in production.
- Develop and execute scalable LLM evaluation methodologies (including code-based, LLM-as-a-Judge) to rigorously assess model quality, safety, and goal alignment
- Proficiency in Python
- Familiarity with retrieval-augmented generation (RAG) and modern vector databases (Pinecone, Weaviate).
- Experience with cloud platforms (AWS, GCP, Azure), MLOps practices, and production-grade deployment.
- Strong understanding of data privacy, model security, and compliance with current AI regulations and frameworks.
Preferred Skills
- Experience with Hugging Face, Neo4j, or knowledge graphs.
- Background in autonomous decision-making systems, anomaly detection, and dynamic process optimization.
- Track record of publishing, presenting, or open-sourcing agentic AI innovations.
- Strong problem-solving aptitude, collaborative mindset, and excellent communication skills.
Location:
Ahmedabad/ Pune
-
LLM Engineer
2 weeks ago
Pune, Maharashtra, India Zorba Consulting Full time ₹ 20,00,000 - ₹ 25,00,000 per yearRole Description :This is a contract remote role for a LLM Engineer with 4+ years of experience. The LLM Engineer will be responsible for developing, deploying, and optimizing large language models (LLMs). The day-to-day tasks include designing NLP solutions, fine-tuning models, collaborating with cross-functional teams, and ensuring model performance and...
-
LLM Ops Engineer
8 hours ago
Pune, Maharashtra, India Pattern Full time ₹ 12,00,000 - ₹ 24,00,000 per yearMonitor, evaluate, and optimize AI/LLM workflows in production environments. Ensure reliable, efficient, and high-quality AI system performance by building out an LLM Ops platform that is self-serve for the engineering and data science departments. Key Responsibilities:-Collaborate with data scientists and software engineers to integrate an LLM Ops platform...
-
Senior CloudOps Engineer
2 days ago
Pune, Maharashtra, India Rapid7 Full time ₹ 20,00,000 - ₹ 25,00,000 per yearSenior CloudOps EngineerJob Description:We are seeking an experienced and highly specialized Senior CloudOps Engineer to manage, automate, and secure our production cloud infrastructure and Machine Learning (ML)/Large Language Model (LLM) operational pipelines. This role is strictly focused on the operations and infrastructure that supports our data science...
-
Senior AI Engineer
2 weeks ago
Pune, Maharashtra, India The Goodstack Company Full time ₹ 20,00,000 - ₹ 25,00,000 per yearAn SF based startup is looking to hire a Senior AI Engineer.The role is fully remote.Here's What The Day-to-day Responsibilities Will Look Like -Design and implement conversational AI agents using LLMsBuild RAG pipelines to process e-commerce dataOptimize prompt engineering for accuracy and cost efficiencyCreate data ingestion pipelines for various formats...
-
Senior CloudOps Engineer
5 days ago
Pune, Maharashtra, India Rapid7 Full time ₹ 12,00,000 - ₹ 24,00,000 per yearSenior CloudOps Engineer Job Description:We are seeking an experienced and highly specialized Senior CloudOps Engineer to manage, automate, and secure our production cloud infrastructure and Machine Learning (ML)/Large Language Model (LLM) operational pipelines. This role is strictly focused on the operations and infrastructure that supports our data...
-
Pune, Maharashtra, India Pattern Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole Overview :-Monitor, evaluate, and optimize AI/LLM workflows in production environments. Ensure reliable, efficient, and high-quality AI system performance by building out an LLM Ops platform that is self-serve for the engineering and data science departments.Key Responsibilities:-Collaborate with data scientists and software engineers to integrate an...
-
Senior Software Engineer
2 weeks ago
Pune, Maharashtra, India SSterling Workforce Enterprises Private Limited Full time ₹ 12,00,000 - ₹ 18,00,000 per yearLocation: PuneExperience: 3+ yearsPreferred: IIT candidates onlyPosition: Software Engineer / Senior Software Engineer :We're looking for a passionate and experienced Software Engineers/Senior Software Engineer to join our Pune team and spearhead the development of a production-grade LLM-based agentic platform. In this role, you'll be instrumental in...
-
Senior Gen AI Engineer
1 week ago
Pune, Maharashtra, India Tekskills Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per yearRole: Senior Gen AI EngineerExperience: 4–6 yearsLocation: Gurgaon / PuneRole OverviewWe are seeking a Senior Gen AI Engineer with proven experience in building and deploying Generative AI and scaled ML systems. The role involves end-to-end ownership of AI solutions — from model selection, fine-tuning, and pipeline design to deployment on cloud ML...
-
Senior AI Engineer
3 days ago
Pune, Maharashtra, India Internet Soft Full time ₹ 20,00,000 - ₹ 25,00,000 per yearSenior AI / Machine Learning Engineer (LLMs, MLOps, Generative AI, Cloud Deployment)Location:PuneExperience:7+ Years (AI, Machine Learning, Deep Learning & MLOps)About the RoleWe are seeking aSenior AI & Machine Learning Engineerwith proven experience in building and deploying advanced AI systems at scale. The ideal candidate will have deep expertise inLarge...
-
AI Research Senior Engineer
7 days ago
Pune, Maharashtra, India VOICERAcx Full time ₹ 12,00,000 - ₹ 36,00,000 per yearLocation:Pune, India (Hybrid: 4 days onsite + 1 day remote)Department:AI Research & DevelopmentExperience Level:Senior / Research-FocusedWe appreciate diverse experiences, but this role is not suitable for candidates whose primary experience is limited to orchestration or prompt engineering of pre-trained LLMs. We are looking for individuals with deep...