LLM Ops EngineerOpenAI OR Anthropic OR Bedrock) AND

2 days ago

Pune, Maharashtra, India Pattern Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Role Overview :-

Monitor, evaluate, and optimize AI/LLM workflows in production environments. Ensure reliable, efficient, and high-quality AI system performance by building out an LLM Ops platform that is self-serve for the engineering and data science departments.

Key Responsibilities:-

  • Collaborate with data scientists and software engineers to integrate an LLM Ops platform (Opik by CometML) for existing AI workflows
  • Identify valuable performance metrics (accuracy, quality, etc) for AI workflows and create on-going sampling evaluation processes using the LLM Ops platform that alert when metrics drop below thresholds
  • Cross-team collaboration to create datasets and benchmarks for new AI workflows
  • Run experiments on datasets and optimize performance via model changes and prompt adjustments
  • Debug and troubleshoot AI workflow issues
  • Optimize inference costs and latency while maintaining accuracy and quality Develop automations for LLM Ops platform integration to empower data scientists and software engineers to self-serve integration with the AI workflows they build

Requirements:-

  • Strong Python programming skills
  • Experience with generative AI models and tools (OpenAI, Anthropic, Bedrock, etc)
  • Knowledge of fundamental statistical concepts and tools in data science such as: heuristic and non-heuristic measurements in NLP (BLEU, WER, sentiment analysis, LLM-as-judge, etc), standard deviation, sampling rate, and a high level understanding of how modern AI models work (knowledge cutoffs, context windows, temperature, etc)
  • Familiarity with AWS
  • Understanding of prompt engineering concepts
  • People skills: you will be expected to frequently collaborate with other teams to help to perfect their AI workflows

Experience Level 3-5 years of experience in LLM/AI Ops, MLOps, Data Science, or MLE

  • AWS, AWS Bedrock/ DN

    4 days ago

    Pune, Maharashtra, India Voicecord Full time ₹ 30,000 - ₹ 36,00,000 per year

    Job Description: AWS, AWS Bedrock/ DNLocation: Pune Phase 2 / Hyderabad SEZ / Chandigarh SEZ.Key ResponsibilitiesArchitect and deliver AI/ML solutions leveraging AWS Bedrock, SageMaker, Lambda, API Gateway, and EKS.Design and implement RAG-based architectures, LLM integration, and vector database solutions for scalable AI workloads.Lead cloud deployments...

  • Senior AI Engineer

    6 days ago

    Pune, Maharashtra, India STAND 8 Technology Consulting Full time US$ 1,25,000 - US$ 1,75,000 per year

    STAND 8 provides end-to-end IT solutions to enterprise partners across the United States and with offices in Los Angeles, New York, New Jersey, Atlanta, and more including internationally in Mexico and India.We are seeking aSenior AI Engineer / Data Engineerto join our engineering team and help build the future of AI-powered business solutions. In this role,...

  • AI Ops Engineer

    6 days ago

    Pune, Maharashtra, India Jade Global Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    AI Ops Engineer2Job TitleAI Ops EngineerExperience35 yearsAbout the RoleWe are seeking a hands-on and proactive AI Ops Engineer to operationalize andsupport the deployment of large language model (LLM) workflows, including agentic AIapplications, across Marvells enterprise ecosystem.This role requires strong prompt engineering capabilities, the ability to...

  • AI Ops Engineer

    2 weeks ago

    Pune, Maharashtra, India Iitjobs Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Required Qualifications3 to 6 years of experience in software engineering, DevOps, or ML Ops with exposure to AI/LLM workflows.Strong foundation in prompt engineering and experience with LLMs like GPT, Claude,LLaMA, etc.Practical understanding of AIOps platforms or operational AI use cases (incident triage,log summarization, root cause analysis,...

  • Technical Architect

    3 weeks ago

    Pune, Maharashtra, India Tamcherry Technologies Full time

    Role Title: AI Platform Engineer ( Only immediate joiner need to apply)CTC- UP to 35LPALocation: Bangalore (In Person in office when required)Part of the GenAI COE TeamKey Responsibilities- Platform Development and Evangelism:- Build scalable AI platforms that are customer-facing.- Evangelize the platform with customers and internal stakeholders.- Ensure...

  • Data Analyst

    4 weeks ago

    Pune, Maharashtra, India People Prime World Wide Full time

    About Client : Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France.Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations.The company is...

  • Lead Data Analyst AI

    7 days ago

    Pune, Maharashtra, India Inwinteck Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Responsibilities:Lead data analysis & AI/ML projects using Amazon Bedrock. Apply LLMs, prompt engineering & AWS AI tools for insights.Req: 5+ yrs exp, SQL, Python/R. Preferred: GenAI frameworks, ETL, big data, MLOps.

  • Software Engineer Senior-Python Major

    6 days ago

    Pune, Maharashtra, India Siemens Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are seeking AI Backend Engineers to play a pivotal role in building our Agentic Workflow Service and Retrieval-Augmented Generation (RAG) Service. In this hybrid role, you'll leverage your expertise in both backend development and machine learning to create robust, scalable AI-powered systems using AWS Kubernetes, Amazon Bedrock models, AWS Strands...

  • Gen AI(React +Node)

    6 days ago

    Pune, Maharashtra, India Apex One Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Position:Gen AI Engineer (React + Node)Experience:6–8 YearsLocation:Pune – HybridResponsibilitiesDesign & deliver AI-first features (contract summarization, semantic search, guided workflows).Integrate LLMs (OpenAI, Anthropic, Mistral) using LangChain, LlamaIndex, or custom orchestration.Build RAG pipelines & embedding-based search with vector DBs...

  • Gen AI Engineer

    6 days ago

    Pune, Maharashtra, India Apex One Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Position: Gen AI Engineer (React + Node)Experience: 6-8 YearsLocation: Pune HybridResponsibilities: Design & deliver AI-first features (contract summarization, semantic search, guided workflows). Integrate LLMs (OpenAI, Anthropic, Mistral) using LangChain, LlamaIndex, or custom orchestration. Build RAG pipelines & embedding-based search with vector DBs...