AI OPS Engineer

6 days ago

Pune, Maharashtra, India Exdonuts Full time

Job Title: AI Ops Engineer

Experience: 4+yrs exp

About the Role

We are seeking a hands-on and proactive AI Ops Engineer to operationalize and

support the deployment of large language model (LLM) workflows, including agentic AI

applications, across Marvell's enterprise ecosystem.

This role requires strong prompt engineering capabilities, the ability to triage AI pipeline

issues, and a deep understanding of how LLM-based agents interact with tools,

memory, and APIs. You will be expected to diagnose and remediate real-time problems,

from prompt quality issues to model behavior anomalies.

Key Responsibilities

· Design, fine-tune, and manage prompts for various LLM use cases tailored to Marvell's

enterprise operations.

· Operate, monitor, and troubleshoot agentic AI applications, including identifying whether

issues stem from:

· Prompt quality or structure

· Model configuration or performance

· Tool usage, API failures, or memory/recall issues

· Build diagnostics and playbooks to triage LLM-driven failures, including handling fallback

strategies, retries, or re-routing to human workflows.

· Collaborate with architects, ML engineers, and DevOps to optimize agent orchestration

across platforms like LangGraph, CrewAI, AutoGen, or similar.

· Support integration of agentic systems with enterprise apps like Jira, ServiceNow, Glean, or

Confluence using REST APIs, webhooks, and adapters.

· Implement observability and logging best practices for model outputs, latency, and agent

performance metrics.

· Contribute to building self-healing mechanisms and alerting strategies for production-grade

AI workflows.

Required Qualifications

· 3–6 years of experience in software engineering, DevOps, or ML Ops with exposure to

AI/LLM workflows.

· Strong foundation in prompt engineering and experience with LLMs like GPT, Claude,

LLaMA, etc.

· Practical understanding of AIOps platforms or operational AI use cases (incident triage,

log summarization, root cause analysis, etc.).

· Exposure to agentic AI architectures, such as LangGraph, AutoGen, CrewAI, etc.

· Familiarity with scripting (Python), RESTful APIs, and basic system debugging.

· Strong analytical skills and the ability to trace issues across multi-step pipelines and

asynchronous agents.

Good-To-Have

· Glean

· DevRev

· Codium

· Cursor

· Atlassian AI

· Databricks Mosaic AI

  • Thanks,

  • LLM Ops Engineer

    1 week ago

    Pune, Maharashtra, India Pattern® Full time ₹ 7,50,000 - ₹ 22,50,000 per year

    Monitor, evaluate, and optimize AI/LLM workflows in production environments. Ensure reliable, efficient, and high-quality AI system performance by building out an LLM Ops platform that is self-serve for the engineering and data science departments.Key Responsibilities:-Collaborate with data scientists and software engineers to integrate an LLM Ops platform...

  • AI Engineer – Agentic AI

    6 days ago

    Pune, Maharashtra, India Zensar Technologies Full time

    Job DescriptionJob Title:AI Engineer – Agentic AILocation:AnywhereUrgency:Immediate Joiners PreferredAbout The RoleSeeking a highly skilled AI Engineer to support its strategic initiatives around modernizing the data platform and enabling business outcomes through Cortex AI applications. The ideal candidate will have deep expertise in Agentic AI frameworks...

  • Sr. AI Engineer

    4 days ago

    Pune, Maharashtra, India Vsynergize AI Full time

    We are looking for a talented and driven Sr. AI Engineer with a strong foundation in Python, Natural Language Processing, and experience working with Large Language Models (LLMs). This is an exciting opportunity to be at the forefront of AI development, working on real-world problems involving cutting-edge technologies such as prompt engineering, cloud-based...

  • AI Architect/ VP Engineering

    1 week ago

    Pune, Maharashtra, India Opura AI Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionOpura AI is a Generative AI–driven startup building an AI Shopping Assistant that seamlessly integrates advanced technology with real-world e-commerce solutions. Our platform enhances the shopping experience by helping users discover products quickly through natural, conversational interactions. Opura AI enables businesses to increase...

  • DEA - Snowflake Data Engineering - Agentic AI (Sub Contrator)

    4 days ago

    Pune, Maharashtra, India Zensar Full time

    Job Title: AI Engineer – Agentic AILocation: AnywhereUrgency: Immediate Joiners PreferredAbout the Role:Seeking a highly skilled AI Engineer to support its strategic initiatives around modernizing the data platform and enabling business outcomes through Cortex AI applications. The ideal candidate will have deep expertise in Agentic AI frameworks and...

  • Sr. AI Engineer

    2 weeks ago

    Pune, Maharashtra, India Optimum Data Analytics Full time ₹ 20,00,000 - ₹ 24,00,000 per year

    Job Title: AIML & Generative AI EngineerExperience: 6+ yearsWork Mode: Initial remote for some time, and later a hybrid role for Pune (First preference Pune)Budget: 20-22LPAJob Summary:We are seeking a highly skilled and motivated AI/ML & Generative AI Engineer to join our growing team. This role requires deep expertise in artificial intelligence and...

  • Software Engineer-Gen AI

    2 weeks ago

    Pune, Maharashtra, India, Maharashtra KPI Partners Full time

    KPI Partners is seeking a talented and motivated Software Engineer specializing in Generative AI to join our dynamic team.Key Responsibilities:Design, develop, and deploy AI models and applications using Python and related technologies.Work with large language models to enhance functionality and improve user experience.Collaborate with cross-functional teams...

  • AI Engineer

    1 week ago

    Pune, Maharashtra, India BMC Software Full time ₹ 21,17,800 - ₹ 33,21,200 per year

    Description and Requirements"At BMC trust is not just a word - it's a way of life"Description And RequirementsCareerArc CodeCA-JFHybridBMC empowers nearly 80% of the Forbes Global 100 to accelerate business value, faster than humanly possible. Our industry-leading portfolio unlocks human and machine potential to drive business growth, innovation, and...

  • AI Ml Engineer Freshers

    4 days ago

    Pune, Maharashtra, India Agiliad Full time

    Required Skills:Strong understanding of Machine Learning, Deep Learning, and Generative AI concepts.Good knowledge of Python, TensorFlow, PyTorch, Keras, and Scikit-learn.Understanding of Statistics, Linear Algebra, and Probability.Familiarity with AI Ops tools, Docker, Git, and Azure is a plus.Excellent problem-solving and analytical skills.Eligibility...

  • Senior AI Engineer

    4 days ago

    Pune, Maharashtra, India Jeeva Full time

    Required: Efficient, hands-on coder with proficiency in Python, and very comfortable with popular ML stack and eager to learn and wor in new tech including prompt engineering with openAI/ LLM./ LangchainWill be responsible for quick turnaround AI modeling work with ability to architect POC, validate, test and shipVery eager to learn new tech and / or...