LLM Ops Engineer

1 day ago


Pune, Maharashtra, India Pattern Full time ₹ 20,00,000 - ₹ 25,00,000 per year
Monitor, evaluate, and optimize AI/LLM workflows in production environments. Ensure reliable, efficient, and high-quality AI system performance by building out an LLM Ops platform that is self-serve for the engineering and data science departments. Key Responsibilities:-
  • Collaborate with data scientists and software engineers to integrate an LLM Ops platform (Opik by CometML) for existing AI workflows
  • Identify valuable performance metrics (accuracy, quality, etc) for AI workflows and create on-going sampling evaluation processes using the LLM Ops platform that alert when metrics drop below thresholds
  • Cross-team collaboration to create datasets and benchmarks for new AI workflows
  • Run experiments on datasets and optimize performance via model changes and prompt adjustments
  • Debug and troubleshoot AI workflow issues
  • Optimize inference costs and latency while maintaining accuracy and quality Develop automations for LLM Ops platform integration to empower data scientists and software engineers to self-serve integration with the AI workflows they build
Requirements:-
  • Strong Python programming skills
  • Experience with generative AI models and tools (OpenAI, Anthropic, Bedrock, etc)
  • Knowledge of fundamental statistical concepts and tools in data science such as: heuristic and non-heuristic measurements in NLP (BLEU, WER, sentiment analysis, LLM-as-judge, etc), standard deviation, sampling rate, and a high level understanding of how modern AI models work (knowledge cutoffs, context windows, temperature, etc)
  • Familiarity with AWS
  • Understanding of prompt engineering concepts
  • People skills: you will be expected to frequently collaborate with other teams to help to perfect their AI workflows
  • Experience Level 4-7 years of experience in LLM/AI Ops, MLOps, Data Science, or MLE
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
  • AI Ops Engineer

    3 days ago


    Pune, Maharashtra, India Iitjobs Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Required Qualifications3 to 6 years of experience in software engineering, DevOps, or ML Ops with exposure to AI/LLM workflows.Strong foundation in prompt engineering and experience with LLMs like GPT, Claude,LLaMA, etc.Practical understanding of AIOps platforms or operational AI use cases (incident triage,log summarization, root cause analysis,...

  • LLM Engineer

    2 weeks ago


    Pune, Maharashtra, India Zorba Consulting Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role Description :This is a contract remote role for a LLM Engineer with 4+ years of experience. The LLM Engineer will be responsible for developing, deploying, and optimizing large language models (LLMs). The day-to-day tasks include designing NLP solutions, fine-tuning models, collaborating with cross-functional teams, and ensuring model performance and...

  • LLM Data Scientist

    1 day ago


    Pune, Maharashtra, India Gokloud Software Solutions Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Key ResponsibilitiesResponsible for building linguistic models, prompt engineering for large language models (LLM) and designing user interfaces that facilitate natural language input and output.Utilize proven hands-on experience with GPT architectures to design, train, and customize models for LLM, image-to-text, and/or text-to-image projects.Designing and...

  • Python LLM

    1 day ago


    Pune, Maharashtra, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Skills :Proficiency in Python (Programming Language) and Git, machine learning concepts, Open-source LLM libraries, Expertise in Conversational AI, including creating and customising CHATGPT models, Proficiency in NLP,Experience:7+ years, in front-end development using React and proven experience in back-end development using Python.Notice Period: 0-30...

  • AI ML Ops Engineers

    3 weeks ago


    Pune, Maharashtra, India, Maharashtra Amazure Technologies Pvt Ltd Full time

    Detailed JD (Roles and Responsibilities)Bachelor’s or Master’s degree in computer science, Data Science, or a related field.3+ years of experience in AI/ML engineering, preferably in IT operations or DevOps environments.Strong programming skills in PythonExperience with implementing GenAi and AI Python SDKsExperience with time-series...

  • ML OPs Engineer

    7 days ago


    Pune, Maharashtra, India Live Connections Full time ₹ 3,60,000 per year

    Hiring for ML Ops EngineerExperience: 6-9 YearsNotice Period: Immediate to 30 daysCTC: Up to ₹30 LPAKey ResponsibilitiesDeploy and Monitor ML Models: Ensure seamless deployment and monitoring of machine learning models in productionCI/CD Pipelines: Build and manage CI/CD pipelines for ML workflows to streamline processesModel Registries and Feature Stores:...

  • Gen AI Engineer

    3 days ago


    Pune, Maharashtra, India SID Global Solutions Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Description: Generative AI EngineerLocation:PuneExperience: 1-4 yearsRole OverviewWe are looking for aGenerative AI Engineerwho will design, build, deploy, and maintain large language model (LLM)-based solutions. This engineer will work closely with architecture, data science, product, and operations teams to integrate GenAI capabilities into our...


  • Pune, Maharashtra, India Talent21 Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Role: AI Development Solution EngineerExperience: 8-12 YearsLocation: Bangalore (Bellandur) , Mumbai ( Goregaon )Mode : HybridNotice Period : Currently Serving , 15 days to 30 days only .Primary responsibilitiesBuild POCs and example code through which developers can access Gen AI models via standard APIs.Develop tooling and self-service capabilities for...

  • Python Developer

    1 week ago


    Pune, Maharashtra, India Capgemini Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Description We are seeking a highly skilled Python Developer with expertise in Artificial Intelligence, Retrieval-Augmented Generation (RAG) integration, and Model Context Protocol (MCP). The candidate will be responsible for developing scalable applications, building intelligent search and conversational systems, and enabling seamless interaction...

  • Python Developer

    2 weeks ago


    Pune, Maharashtra, India Capgemini Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job DescriptionWe are seeking a highly skilled Python Developer with expertise in Artificial Intelligence, Retrieval-Augmented Generation (RAG) integration, and Model Context Protocol (MCP). The candidate will be responsible for developing scalable applications, building intelligent search and conversational systems, and enabling seamless interaction between...