Senior LLM Engineer
4 days ago
About the role
The Senior LLM Engineer will lead the design, development, and deployment of complex agentic AI solutions within production environments, working with multi-agent frameworks and orchestrating large language models. The position is for scalable applied AI, with a focus on delivering robust and fair agentic systems that deliver organizational value, autonomy, and operational efficiency.
Key Responsibilities
- Architect, design, and deploy scalable agentic AI systems that coordinate LLMs, multi-agent collaboration, and external tool integrations through advanced tool calling.
- Develop, maintain, and optimize AI-driven pipelines utilizing frameworks such as LangGraph, ADK and LangChain, enhancing data inference and orchestration.
- Integrate agentic AI solutions into enterprise workflows, automating complex business functions (e.g., customer service, supply chain, decision support).
- Proactively address system evaluation, debug AI agent workflows, and ensure compliance with emerging regulatory and ethical guidelines.
- Promote security, transparency, fairness, and reliability across all deployed agentic systems.
- Mentor junior engineers, contribute to cross-functional teams, and champion the adoption of state-of-the-art LLM technologies and practices.
Required Qualifications
- 4+ years of overall experience working on industry projects
- At least 1 year of experience with LangGraph (must have)
- Experience with LangChain, and other agentic orchestration frameworks.
- Deep proficiency in designing and deploying multi-agent frameworks and sophisticated tool-calling or API orchestration pipelines.
- Design and implement continuous monitoring systems for autonomous AI agents, ensuring performance, reliability, adherence to ethical guardrails, and optimal cost/latency in production.
- Develop and execute scalable LLM evaluation methodologies (including code-based, LLM-as-a-Judge) to rigorously assess model quality, safety, and goal alignment
- Proficiency in Python
- Familiarity with retrieval-augmented generation (RAG) and modern vector databases (Pinecone, Weaviate).
- Experience with cloud platforms (AWS, GCP, Azure), MLOps practices, and production-grade deployment.
- Strong understanding of data privacy, model security, and compliance with current AI regulations and frameworks.
Preferred Skills
- Experience with Hugging Face, Neo4j, or knowledge graphs.
- Background in autonomous decision-making systems, anomaly detection, and dynamic process optimization.
- Track record of publishing, presenting, or open-sourcing agentic AI innovations.
- Strong problem-solving aptitude, collaborative mindset, and excellent communication skills.
Location:
Ahmedabad/ Pune
-
LLM Engineer
1 day ago
Pune, Maharashtra, India, Maharashtra Bajaj Broking Full timeWhy this role mattersWe’re building production-grade GenAI systems at the core of trading, risk, and enterprise decision-making. This is not a demo lab or a prompt-only role—you’ll design and ship real LLM platforms used by traders, compliance teams, and leadership every day.If you enjoy solving hard problems at the intersection of LLMs, distributed...
-
LLM Ops Engineer
2 days ago
Pune, Maharashtra, India Pattern Full timeMonitor, evaluate, and optimize AI/LLM workflows in production environments. Ensure reliable, efficient, and high-quality AI system performance by building out an LLM Ops platform that is self-serve for the engineering and data science departments. Key Responsibilities:-Collaborate with data scientists and software engineers to integrate an LLM Ops platform...
-
LLM Ops Engineer
2 weeks ago
Pune, Maharashtra, India Pattern® Full time ₹ 7,50,000 - ₹ 22,50,000 per yearMonitor, evaluate, and optimize AI/LLM workflows in production environments. Ensure reliable, efficient, and high-quality AI system performance by building out an LLM Ops platform that is self-serve for the engineering and data science departments.Key Responsibilities:-Collaborate with data scientists and software engineers to integrate an LLM Ops platform...
-
Senior QA Engineer
2 weeks ago
Pune, Maharashtra, India dentsu Full time ₹ 14,00,000 - ₹ 28,00,000 per yearJob Description:Job Title: Senior Quality EngineerExperience: 5- 7 yearsRequirements: Bachelor's/Master's degree in Computer Science or related field. 5-6 years of experience in Quality Engineering (QE) domain. Good understanding of Generative AI tools and platforms - especially LLMs. Foundation Knowledge of Gen-AI concepts, technologies, tools and...
-
Senior Software Engineer
6 days ago
Pune, Maharashtra, India SpeedTech Full timeSenior Software Developer – GenAI Products | Pune (Work From Office) is a 12 years old, fast-growing GenAI Product & Services company building enterprise-grade AI platforms for global markets including India, USA, Canada & UAE. We're preparing for our IPO in the next 5 Years.Our flagship product RAIYA, a GenAI Voice AI platform, is helping enterprises...
-
Senior GenAI Engineer
4 days ago
Pune, Maharashtra, India Bajaj Allianz General Insurance Company Limited Full timeData Scientist/GenAI EngineerTeam: AWS Data EngineeringLocation: BGIL,PuneJob Description :We are actively seeking a highly skilled and accomplished Senior Data Scientist with a minimum of 3 years of experience. The ideal candidate should have deep understanding in designing and developing applications based on Large Language Models (LLMs). A deep...
-
Senior AI Engineer
4 days ago
Pune, Maharashtra, India Internet Soft Full timeSenior AI / Machine Learning Engineer (LLMs, MLOps, Generative AI, Cloud Deployment)Location:PuneExperience:7+ Years (AI, Machine Learning, Deep Learning & MLOps)About the RoleWe are seeking aSenior AI & Machine Learning Engineerwith proven experience in building and deploying advanced AI systems at scale. The ideal candidate will have deep expertise inLarge...
-
AI Research Senior Engineer
1 week ago
Pune, Maharashtra, India VOICERAcx Full timeLocation:Pune, India (Hybrid: 4 days onsite + 1 day remote)Department:AI Research & DevelopmentExperience Level:Senior / Research-FocusedWe appreciate diverse experiences, but this role is not suitable for candidates whose primary experience is limited to orchestration or prompt engineering of pre-trained LLMs. We are looking for individuals with deep...
-
Senior Software Engineer
2 days ago
Pune, Maharashtra, India MarketEngine Full timeWe're looking for a passionate and experienced Software / Senior Engineers to join our Pune team and spearhead the development of production-grade LLM-based agentic platform. In this role, you'll be instrumental in designing scalable infrastructure for our LLM systems and developing robust frameworks for prompt management. As a key team member, you'll have...
-
AI/ML Platform Engineer
1 week ago
Pune, Maharashtra, India Johnson Controls Full timeJob Title: Senior Data Scientist – Data & AnalyticsJohnson Controls International (JCI) is seeking a Senior Data Scientist to join our innovative and impact-driven Data Science and Analytics team. This role is ideal for a seasoned expert with a deep understanding of machine learning, AI, and cloud data platforms, and a strong grasp of the latest...