LLM Ops EngineerOpenAI OR Anthropic OR Bedrock) AND

2 days ago

Pune, Maharashtra, India Pattern Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Role Overview :-

Monitor, evaluate, and optimize AI/LLM workflows in production environments. Ensure reliable, efficient, and high-quality AI system performance by building out an LLM Ops platform that is self-serve for the engineering and data science departments.

Key Responsibilities:-

  • Collaborate with data scientists and software engineers to integrate an LLM Ops platform (Opik by CometML) for existing AI workflows
  • Identify valuable performance metrics (accuracy, quality, etc) for AI workflows and create on-going sampling evaluation processes using the LLM Ops platform that alert when metrics drop below thresholds
  • Cross-team collaboration to create datasets and benchmarks for new AI workflows
  • Run experiments on datasets and optimize performance via model changes and prompt adjustments
  • Debug and troubleshoot AI workflow issues
  • Optimize inference costs and latency while maintaining accuracy and quality Develop automations for LLM Ops platform integration to empower data scientists and software engineers to self-serve integration with the AI workflows they build

Requirements:-

  • Strong Python programming skills
  • Experience with generative AI models and tools (OpenAI, Anthropic, Bedrock, etc)
  • Knowledge of fundamental statistical concepts and tools in data science such as: heuristic and non-heuristic measurements in NLP (BLEU, WER, sentiment analysis, LLM-as-judge, etc), standard deviation, sampling rate, and a high level understanding of how modern AI models work (knowledge cutoffs, context windows, temperature, etc)
  • Familiarity with AWS
  • Understanding of prompt engineering concepts
  • People skills: you will be expected to frequently collaborate with other teams to help to perfect their AI workflows

Experience Level 3-5 years of experience in LLM/AI Ops, MLOps, Data Science, or MLE

  • LLM Ops Engineer

    1 week ago

    Pune, Maharashtra, India Pattern Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Monitor, evaluate, and optimize AI/LLM workflows in production environments. Ensure reliable, efficient, and high-quality AI system performance by building out an LLM Ops platform that is self-serve for the engineering and data science departments. Key Responsibilities:-Collaborate with data scientists and software engineers to integrate an LLM Ops platform...

  • CSS-1:3RDi_AI/MLEngineer

    1 week ago

    Pune, Maharashtra, India The Digital Group Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Years of Experience:5-10 YearsSkills Stack:Generative AI, Azure or AWSShift Timings:05:30 am - 05:30 am ()Role and Responsibility Details:Job Description:About the RoleWe are seeking a highly skilled and motivated Generative AI Engineer with hands-on experience in building and deploying multimodal AI solutions (text, audio, and video) on Azure or AWS AI...

  • CSS-1:3RDi_AI/MLEngineer

    7 days ago

    Pune, Maharashtra, India THE DIGITAL GROUP Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description CSS-1:3RDi_AI/MLEngineer Years of Experience: 5-10 Years Skills Stack: Generative AI, Azure or AWS Shift Timings: 05:30 am - 05:30 am ()Role and Responsibility Details: : About the Role We are seeking a highly skilled and motivated Generative AI Engineer with hands-on experience in building and deploying multimodal AI solutions (text,...

  • AI Engineer

    4 days ago

    Pune, Maharashtra, India Incerro Full time ₹ 6,00,000 - ₹ 9,00,000 per year

    Location: PuneJob Type: Full-timeExperience Required: 0-4 yearsSalary Range: 7-9 LPAWe are looking for an AI Engineer with strong technical expertise in developing intelligent, data-driven and generative AI systems.The ideal candidate will thrive in a fast-paced startup environment, collaborating with cross-functional teams to design, build, and...

  • AI Ops Engineer

    2 weeks ago

    Pune, Maharashtra, India Iitjobs Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Required Qualifications3 to 6 years of experience in software engineering, DevOps, or ML Ops with exposure to AI/LLM workflows.Strong foundation in prompt engineering and experience with LLMs like GPT, Claude,LLaMA, etc.Practical understanding of AIOps platforms or operational AI use cases (incident triage,log summarization, root cause analysis,...

  • 4423264-Manager

    1 week ago

    Pune, Maharashtra, India EXL Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    DescriptionJob Title: Generative AI Engineer Role Overview: We are looking for a highly skilled Generative AI Engineer with deep experience in building and deploying AI agent-based systems, Retrieval-Augmented Generation (RAG) frameworks, and working with large language models (LLMs). The ideal candidate will bring hands-on experience with AWS Bedrock and...

  • GenAI Engineer

    5 days ago

    Pune, Maharashtra, India Reveille Technologies,Inc Full time ₹ 1,50,00,000 - ₹ 3,00,00,000 per year

    We're Hiring – GenAI Engineer (C2H) Location: Remote (U.S. hours overlap) Experience: 5+ years Notice Period: Immediate Joiners OnlyAbout the Role:Seeking an experienced GenAI Engineer to design and deliver customer-facing AI solutions using Amazon Bedrock and agentic frameworks. You'll build production-ready GenAI applications, LLM workflows, and...

  • Gen AI Engineer

    2 weeks ago

    Pune, Maharashtra, India SID Global Solutions Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Description: Generative AI EngineerLocation:PuneExperience: 1-4 yearsRole OverviewWe are looking for aGenerative AI Engineerwho will design, build, deploy, and maintain large language model (LLM)-based solutions. This engineer will work closely with architecture, data science, product, and operations teams to integrate GenAI capabilities into our...

  • Lead Generative AI Engineer-Player Coach

    1 week ago

    Pune, Maharashtra, India AcquireX Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job Title:-Lead Generative AI Engineer / Player-CoachPurpose: Own our Generative AI technical vision. You will rapidly prototype and lead a dedicated team of two engineers to launch our company's first intelligent search and content automation systems.Role SummaryWe're looking for a hands-on Gen AI pioneer who can architect, code, and mentor. This is a...

  • SRE - AI_ML Support Engineer

    2 weeks ago

    Pune, Maharashtra, India CRUTZ LEELA ENTERPRISES Full time ₹ 5,00,000 - ₹ 17,19,712 per year

    SRE - AI_ML Support Engineer – JDWe are hiring a "SRE [Site Reliability Engineer] AI ML Support" engineer for our "Enterprise-grade high-performance supercomputing" platform. We are helping enterprises and service providers build their AIinference platforms for end users, powered by our state-of-the-art RDU (Reconfigurable Dataflow Unit)hardware...