LLM & ML Ops Engineer

4 days ago

Bengaluru, India Gainwell Technologies LLC Full time

Summary Gainwell is seeking LLM Ops Engineers and ML Ops Engineers to join our growing AI/ML team. This role is responsible for developing, deploying, and maintaining scalable infrastructure and pipelines for Machine Learning (ML) models and Large Language Models (LLMs). You will play a critical role in ensuring smooth model lifecycle management, performance monitoring, version control, and compliance while collaborating closely with Data Scientists, DevOps. Your role in our mission Core LLM Ops Responsibilities: Develop and manage scalable deployment strategies specifically tailored for LLMs (GPT, Llama, Claude, etc.). Optimize LLM inference performance, including model parallelization, quantization, pruning, and fine-tuning pipelines. Integrate prompt management, version control, and retrieval-augmented generation (RAG) pipelines. Manage vector databases, embedding stores, and document stores used in conjunction with LLMs. Monitor hallucination rates, token usage, and overall cost optimization for LLM APIs or on-prem deployments. Continuously monitor models for its performance and ensure alert system in place. Ensure compliance with ethical AI practices, privacy regulations, and responsible AI guidelines in LLM workflows. Core ML Ops Responsibilities: Design, build, and maintain robust CI/CD pipelines for ML model training, validation, deployment, and monitoring. Implement version control, model registry, and reproducibility strategies for ML models. Automate data ingestion, feature engineering, and model retraining workflows. Monitor model performance, drift, and ensure proper alerting systems are in place. Implement security, compliance, and governance protocols for model deployment. Collaborate with Data Scientists to streamline model development and experimentation. What we're looking for Bachelor's/Master’s degree in computer science, Engineering, or related fields. Strong experience with ML Ops tools (Kubeflow, MLflow, TFX, SageMaker, etc.). Experience with LLM-specific tools and frameworks (LangChain,Lang Graph,  LlamaIndex, Hugging Face, OpenAI APIs, Vector DBs like Pinecone, FAISS, Weavite, Chroma DB etc.). Solid experience in deploying models in cloud (AWS, Azure, GCP) and on-prem environments. Proficient in containerization (Docker, Kubernetes) and CI/CD practices. Familiarity with monitoring tools like Prometheus, Grafana, and ML observability platforms. Strong coding skills in Python, Bash, and familiarity with infrastructure-as-code tools (Terraform, Helm, etc.).Knowledge of healthcare AI applications and regulatory compliance (HIPAA, CMS) is a plus.  Strong skills in Giskard, Deepeval etc. What you should expect in this role Fully Remote Opportunity – Work from anywhere in the India Opportunity to Work on Cutting-Edge AI Solutions in a mission-driven healthcare technology environment.  #LI-DNI

  • Subject Matter Expert

    3 weeks ago

    Bengaluru, Mumbai, Pune, India Citiustech Healthcare Technology Private Limited Full time

    Job Description As a Subject Matter Expert - ML or LLM Ops, you will be a thought leader, guiding Organization MLOps and LLMOps strategy and overseeing the development of scalable infrastructure and processes. Be an Architect of Innovation: This is your opportunity to join a dynamic team and leverage your expertise as an MLOps & LLM Ops SME. You'll play a...

  • ML Ops Engineer

    1 week ago

    Bengaluru, Hyderabad, Noida, India Genpact Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the worlds biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We're harnessing the power of technology and humanity to create...

  • ML Ops Engineer

    5 days ago

    Bengaluru, Karnataka, India foundit Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Position:- ML Ops EngineerExperience:- 6+ yearsLocation:- BangaloreRequired Skills: ● Demonstrated ability in designing, building, refactoring and releasing software written in Python. ● Hands-on experience with ML frameworks such as PyTorch, TensorFlow, Triton. ● Ability to handle framework-related issues, version upgrades, and compatibility with data...

  • ML Ops Engineer

    1 week ago

    Bengaluru, Chennai, Hyderabad, India Sutherland Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a proactive and detail-oriented AI OPS Engineer to support the deployment, monitoring, and maintenance of AI/ML models in production. This role will focus on MLOps practices including model versioning, CI/CD, observability, and performance optimization in cloud and hybrid environments.Role & responsibilitiesBuild and manage CI/CD pipelines...

  • AI / ML Ops Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Automation Anywhere Full time ₹ 8,00,000 - ₹ 20,00,000 per year

    RoleWe are seeking a seasoned AI/ML Engineer to join our Cloud Operations (CloudOps) team. The ideal candidate should have strong expertise in designing, developing, and deploying AI/ML models and automation solutions that optimize cloud infrastructure management and operational efficiency. Primary Responsibilities- Design, develop, and deploy machine...

  • ML Ops Engineer

    1 week ago

    Bengaluru, India Saarthee Full time

    Job Summary: We are seeking a skilled ML Ops Engineer to support and enhance our machine learning operations infrastructure. In this role, you will be responsible for monitoring production services, troubleshooting issues, and collaborating with teams to improve automation and system reliability. You will play a critical role in ensuring seamless model...

  • AI/ML Ops Engineer

    5 days ago

    Bengaluru, Karnataka, India Automation Anywhere Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    About UsAutomation Anywhere is the leader in Agentic Process Automation (APA), transforming how work gets done with AI-powered automation. Its APA system, built on the industry's first Process Reasoning Engine (PRE) and specialized AI agents, combines process discovery, RPA, end-to-end orchestration, document processing, and analytics—all delivered with...

  • AI/ML Ops Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Automation Anywhere Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About UsAutomation Anywhere is the leader in Agentic Process Automation (APA), transforming how work gets done with AI-powered automation. Its APA system, built on the industry's first Process Reasoning Engine (PRE) and specialized AI agents, combines process discovery, RPA, end-to-end orchestration, document processing, and analytics—all delivered with...

  • Senior Lead ML Engineer

    2 days ago

    Bengaluru, India 4flow Full time

    Lead ML Engineer As a Lead ML Engineer, you will architect and lead the development of advanced machine learning systems and infrastructure. You will guide technical strategy, mentor engineers, and ensure the delivery of scalable, high-impact AI solutions across the organization. Tasks: Lead the design, development, and deployment of production-grade ML...

  • AI/ML Ops Engineer-Bangalore Location- Technologies

    1 week ago

    Bengaluru, Karnataka, India Aziro Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Role : AI/ML Ops EngineerSkill : GitHub, DevOps, AI Framework, Vector DB, LangFuse, LangChain, PyTorch, TensorFlow, FAST APIKey Responsibilities:Build and manage AI/ML infrastructure for model training, deployment, and monitoring.Develop CI/CD pipelines (using GitHub Actions or equivalent) for continuous integration, model versioning, and automated...