AI OPS Engineer

6 days ago

Pune, Maharashtra, India Exdonuts Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Title: AI Ops Engineer

Experience: 4+yrs exp

About the Role

We are seeking a hands-on and proactive AI Ops Engineer to operationalize and

support the deployment of large language model (LLM) workflows, including agentic AI

applications, across Marvell's enterprise ecosystem.

This role requires strong prompt engineering capabilities, the ability to triage AI pipeline

issues, and a deep understanding of how LLM-based agents interact with tools,

memory, and APIs. You will be expected to diagnose and remediate real-time problems,

from prompt quality issues to model behavior anomalies.

Key Responsibilities

· Design, fine-tune, and manage prompts for various LLM use cases tailored to Marvell's

enterprise operations.

· Operate, monitor, and troubleshoot agentic AI applications, including identifying whether

issues stem from:

· Prompt quality or structure

· Model configuration or performance

· Tool usage, API failures, or memory/recall issues

· Build diagnostics and playbooks to triage LLM-driven failures, including handling fallback

strategies, retries, or re-routing to human workflows.

· Collaborate with architects, ML engineers, and DevOps to optimize agent orchestration

across platforms like LangGraph, CrewAI, AutoGen, or similar.

· Support integration of agentic systems with enterprise apps like Jira, ServiceNow, Glean, or

Confluence using REST APIs, webhooks, and adapters.

· Implement observability and logging best practices for model outputs, latency, and agent

performance metrics.

· Contribute to building self-healing mechanisms and alerting strategies for production-grade

AI workflows.

Required Qualifications

· 3–6 years of experience in software engineering, DevOps, or ML Ops with exposure to

AI/LLM workflows.

· Strong foundation in prompt engineering and experience with LLMs like GPT, Claude,

LLaMA, etc.

· Practical understanding of AIOps platforms or operational AI use cases (incident triage,

log summarization, root cause analysis, etc.).

· Exposure to agentic AI architectures, such as LangGraph, AutoGen, CrewAI, etc.

· Familiarity with scripting (Python), RESTful APIs, and basic system debugging.

· Strong analytical skills and the ability to trace issues across multi-step pipelines and

asynchronous agents.

Good-To-Have

· Glean

· DevRev

· Codium

· Cursor

· Atlassian AI

· Databricks Mosaic AI

  • Thanks,

  • AI Engineer

    1 hour ago

    Pune, Maharashtra, India Vsynergize AI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We're Hiring: AI Engineer (2+ Years Exp)Location:Hinjewadi Phase 1, Pune (Work from Office)Type:Full-timeVysenrgize AIis aproduct-based, AI-first companyfocused on building real-world solutions using cutting-edge technologies likeLLMs,NLP, andvoice AI. Join us and be part of a fast-moving team solving complex problems with practical, scalable AI...

  • AI Engineer – Agentic AI

    6 days ago

    Pune, Maharashtra, India Zensar Technologies Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job DescriptionJob Title:AI Engineer – Agentic AILocation:AnywhereUrgency:Immediate Joiners PreferredAbout The RoleSeeking a highly skilled AI Engineer to support its strategic initiatives around modernizing the data platform and enabling business outcomes through Cortex AI applications. The ideal candidate will have deep expertise in Agentic AI frameworks...

  • LLM Ops EngineerOpenAI OR Anthropic OR Bedrock) AND

    1 week ago

    Pune, Maharashtra, India Pattern Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role Overview :-Monitor, evaluate, and optimize AI/LLM workflows in production environments. Ensure reliable, efficient, and high-quality AI system performance by building out an LLM Ops platform that is self-serve for the engineering and data science departments.Key Responsibilities:-Collaborate with data scientists and software engineers to integrate an...

  • Sr. AI Engineer

    4 days ago

    Pune, Maharashtra, India Vsynergize AI Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are looking for a talented and driven Sr. AI Engineer with a strong foundation in Python, Natural Language Processing, and experience working with Large Language Models (LLMs). This is an exciting opportunity to be at the forefront of AI development, working on real-world problems involving cutting-edge technologies such as prompt engineering, cloud-based...

  • AI Architect/ VP Engineering

    7 days ago

    Pune, Maharashtra, India Opura AI Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionOpura AI is a Generative AI–driven startup building an AI Shopping Assistant that seamlessly integrates advanced technology with real-world e-commerce solutions. Our platform enhances the shopping experience by helping users discover products quickly through natural, conversational interactions. Opura AI enables businesses to increase...

  • HPC/AI Application Engineer

    2 weeks ago

    Pune, Maharashtra, India Hpc,,Ai Full time ₹ 1,20,000 - ₹ 2,00,000 per year

    Hi, We have an immediate requirement for HPC/AI Application Engineer. PFB Job Details: Work Location - Pune/Mumbai/Bangalore Work Experience - 5+years(relevant) JD: Senior HPC/AI Applications Engineer Experienced HPC/AI Applications Engineer with 5+ years in High-performance computing and AI application deployment. Expert at architecting, optimizing,...

  • Forward Deployed AI Engineer

    6 days ago

    Pune, Maharashtra, India Weekday AI Full time ₹ 8,00,000 - ₹ 15,00,000

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 8-15 LPA)Min Experience: 2 yearsLocation: Gujarat, Mumbai, PuneJobType: full-timeWe're building the future of agentic commerce — a low/no-code framework that helps enterprises create multimodal AI agents with observability, governance, and real-world customer context built in. As a...

  • Forward Deployed AI Engineer

    1 week ago

    Pune, Maharashtra, India Weekday AI Full time ₹ 10,00,000 - ₹ 18,00,000 per year

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 8-15 LPA)Min Experience: 2 yearsLocation: Gujarat, Mumbai, PuneJobType: full-time We're building the future of agentic commerce — a low/no-code framework that helps enterprises create multimodal AI agents with observability, governance, and real-world customer context built in. As a...

  • AI Engineer

    1 week ago

    Pune, Maharashtra, India Atomic Loops Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Senior AI engineerStart date: ASAPLocation: Pune, IndiaExperience: 2+ years as a AI Engineer**Compensation: Competitive, based on experienceAbout the Company:We are an AI-native market intelligence platform helping leading organizations monitor and analyze strategic information across the web in real time.Our clients — from global corporations to...

  • Data & AI Practice Head

    2 days ago

    Pune, Maharashtra, India Pratiti Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Pratiti is looking for a leader for our Data & AI Practice to drive innovation and deliver advanced data engineering, analytics and AI/ML solutions for our global clients. Role needs a blend of hands-on expertise, solution consulting and team leadership to build Data & AI capabilities as key part of digital solutions.Key Responsibilities:·      Work...