LLM Ops Engineer
1 day ago
- Collaborate with data scientists and software engineers to integrate an LLM Ops platform (Opik by CometML) for existing AI workflows
- Identify valuable performance metrics (accuracy, quality, etc) for AI workflows and create on-going sampling evaluation processes using the LLM Ops platform that alert when metrics drop below thresholds
- Cross-team collaboration to create datasets and benchmarks for new AI workflows
- Run experiments on datasets and optimize performance via model changes and prompt adjustments
- Debug and troubleshoot AI workflow issues
- Optimize inference costs and latency while maintaining accuracy and quality Develop automations for LLM Ops platform integration to empower data scientists and software engineers to self-serve integration with the AI workflows they build
- Strong Python programming skills
- Experience with generative AI models and tools (OpenAI, Anthropic, Bedrock, etc)
- Knowledge of fundamental statistical concepts and tools in data science such as: heuristic and non-heuristic measurements in NLP (BLEU, WER, sentiment analysis, LLM-as-judge, etc), standard deviation, sampling rate, and a high level understanding of how modern AI models work (knowledge cutoffs, context windows, temperature, etc)
- Familiarity with AWS
- Understanding of prompt engineering concepts
- People skills: you will be expected to frequently collaborate with other teams to help to perfect their AI workflows
- Experience Level 4-7 years of experience in LLM/AI Ops, MLOps, Data Science, or MLE
-
AI Ops Engineer
3 days ago
Pune, Maharashtra, India Iitjobs Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRequired Qualifications3 to 6 years of experience in software engineering, DevOps, or ML Ops with exposure to AI/LLM workflows.Strong foundation in prompt engineering and experience with LLMs like GPT, Claude,LLaMA, etc.Practical understanding of AIOps platforms or operational AI use cases (incident triage,log summarization, root cause analysis,...
-
LLM Engineer
2 weeks ago
Pune, Maharashtra, India Zorba Consulting Full time ₹ 20,00,000 - ₹ 25,00,000 per yearRole Description :This is a contract remote role for a LLM Engineer with 4+ years of experience. The LLM Engineer will be responsible for developing, deploying, and optimizing large language models (LLMs). The day-to-day tasks include designing NLP solutions, fine-tuning models, collaborating with cross-functional teams, and ensuring model performance and...
-
LLM Data Scientist
1 day ago
Pune, Maharashtra, India Gokloud Software Solutions Full time ₹ 12,00,000 - ₹ 24,00,000 per yearKey ResponsibilitiesResponsible for building linguistic models, prompt engineering for large language models (LLM) and designing user interfaces that facilitate natural language input and output.Utilize proven hands-on experience with GPT architectures to design, train, and customize models for LLM, image-to-text, and/or text-to-image projects.Designing and...
-
Python LLM
1 day ago
Pune, Maharashtra, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 6,00,000 - ₹ 12,00,000 per yearSkills :Proficiency in Python (Programming Language) and Git, machine learning concepts, Open-source LLM libraries, Expertise in Conversational AI, including creating and customising CHATGPT models, Proficiency in NLP,Experience:7+ years, in front-end development using React and proven experience in back-end development using Python.Notice Period: 0-30...
-
AI ML Ops Engineers
3 weeks ago
Pune, Maharashtra, India, Maharashtra Amazure Technologies Pvt Ltd Full timeDetailed JD (Roles and Responsibilities)Bachelor’s or Master’s degree in computer science, Data Science, or a related field.3+ years of experience in AI/ML engineering, preferably in IT operations or DevOps environments.Strong programming skills in PythonExperience with implementing GenAi and AI Python SDKsExperience with time-series...
-
ML OPs Engineer
7 days ago
Pune, Maharashtra, India Live Connections Full time ₹ 3,60,000 per yearHiring for ML Ops EngineerExperience: 6-9 YearsNotice Period: Immediate to 30 daysCTC: Up to ₹30 LPAKey ResponsibilitiesDeploy and Monitor ML Models: Ensure seamless deployment and monitoring of machine learning models in productionCI/CD Pipelines: Build and manage CI/CD pipelines for ML workflows to streamline processesModel Registries and Feature Stores:...
-
Gen AI Engineer
3 days ago
Pune, Maharashtra, India SID Global Solutions Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob Description: Generative AI EngineerLocation:PuneExperience: 1-4 yearsRole OverviewWe are looking for aGenerative AI Engineerwho will design, build, deploy, and maintain large language model (LLM)-based solutions. This engineer will work closely with architecture, data science, product, and operations teams to integrate GenAI capabilities into our...
-
Pune, Maharashtra, India Talent21 Full time ₹ 6,00,000 - ₹ 18,00,000 per yearRole: AI Development Solution EngineerExperience: 8-12 YearsLocation: Bangalore (Bellandur) , Mumbai ( Goregaon )Mode : HybridNotice Period : Currently Serving , 15 days to 30 days only .Primary responsibilitiesBuild POCs and example code through which developers can access Gen AI models via standard APIs.Develop tooling and self-service capabilities for...
-
Python Developer
1 week ago
Pune, Maharashtra, India Capgemini Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob Description We are seeking a highly skilled Python Developer with expertise in Artificial Intelligence, Retrieval-Augmented Generation (RAG) integration, and Model Context Protocol (MCP). The candidate will be responsible for developing scalable applications, building intelligent search and conversational systems, and enabling seamless interaction...
-
Python Developer
2 weeks ago
Pune, Maharashtra, India Capgemini Full time ₹ 12,00,000 - ₹ 24,00,000 per yearJob DescriptionWe are seeking a highly skilled Python Developer with expertise in Artificial Intelligence, Retrieval-Augmented Generation (RAG) integration, and Model Context Protocol (MCP). The candidate will be responsible for developing scalable applications, building intelligent search and conversational systems, and enabling seamless interaction between...