LLM & ML Ops Engineer

4 days ago


Chennai, India Gainwell Technologies Full time

Summary Gainwell is seeking LLM Ops Engineers and ML Ops Engineers to join our growing AI/ML team. This role is responsible for developing, deploying, and maintaining scalable infrastructure and pipelines for Machine Learning (ML) models and Large Language Models (LLMs). You will play a critical role in ensuring smooth model lifecycle management, performance monitoring, version control, and compliance while collaborating closely with Data Scientists, DevOps. Your role in our mission Core LLM Ops Responsibilities: Develop and manage scalable deployment strategies specifically tailored for LLMs (GPT, Llama, Claude, etc.). Optimize LLM inference performance, including model parallelization, quantization, pruning, and fine-tuning pipelines. Integrate prompt management, version control, and retrieval-augmented generation (RAG) pipelines. Manage vector databases, embedding stores, and document stores used in conjunction with LLMs. Monitor hallucination rates, token usage, and overall cost optimization for LLM APIs or on-prem deployments. Continuously monitor models for its performance and ensure alert system in place. Ensure compliance with ethical AI practices, privacy regulations, and responsible AI guidelines in LLM workflows. Core ML Ops Responsibilities: Design, build, and maintain robust CI/CD pipelines for ML model training, validation, deployment, and monitoring. Implement version control, model registry, and reproducibility strategies for ML models. Automate data ingestion, feature engineering, and model retraining workflows. Monitor model performance, drift, and ensure proper alerting systems are in place. Implement security, compliance, and governance protocols for model deployment. Collaborate with Data Scientists to streamline model development and experimentation. What we're looking for Bachelor's/Masters degree in computer science, Engineering, or related fields. Strong experience with ML Ops tools (Kubeflow, MLflow, TFX, SageMaker, etc.). Experience with LLM-specific tools and frameworks (LangChain,Lang Graph, LlamaIndex, Hugging Face, OpenAI APIs, Vector DBs like Pinecone, FAISS, Weavite, Chroma DB etc.). Solid experience in deploying models in cloud (AWS, Azure, GCP) and on-prem environments. Proficient in containerization (Docker, Kubernetes) and CI/CD practices. Familiarity with monitoring tools like Prometheus, Grafana, and ML observability platforms. Strong coding skills in Python, Bash, and familiarity with infrastructure-as-code tools (Terraform, Helm, etc.).Knowledge of healthcare AI applications and regulatory compliance (HIPAA, CMS) is a plus. Strong skills in Giskard, Deepeval etc. What you should expect in this role Fully Remote Opportunity Work from anywhere in the India Opportunity to Work on Cutting-Edge AI Solutions in a mission-driven healthcare technology environment.  #LI-DNI


  • ML Ops Engineer

    2 weeks ago


    Bengaluru, Chennai, Hyderabad, India Sutherland Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a proactive and detail-oriented AI OPS Engineer to support the deployment, monitoring, and maintenance of AI/ML models in production. This role will focus on MLOps practices including model versioning, CI/CD, observability, and performance optimization in cloud and hybrid environments.Role & responsibilitiesBuild and manage CI/CD pipelines...

  • AI/ML Engineer

    5 days ago


    Chennai, India ReSun Technologies Inc Full time

    We are hiring a Senior AI/ML Engineer who brings strong experience across Data Science, Data Engineering, and Generative AI/LLM development . This role will work on end-to-end AI solutions — from building datasets and pipelines, to developing LLM applications, to deploying models in production. Candidates may come from either a Data Scientist background, a...

  • AI/ML Engineer

    4 days ago


    Chennai, India ReSun Technologies Inc Full time

    We are hiring a Senior AI/ML Engineer who brings strong experience across Data Science, Data Engineering, and Generative AI/LLM development . This role will work on end-to-end AI solutions — from building datasets and pipelines, to developing LLM applications, to deploying models in production.Candidates may come from either a Data Scientist background, a...


  • Chennai, Tamil Nadu, India DHI Consultancy Full time ₹ 2,40,000 - ₹ 3,60,000 per year

    Company DescriptionDHI Consultancy specializes in providing recruitment solutions for clients across various industries. With expertise in creative & design services, and investment advisory services, DHI Consultancy leads end-to-end recruitment processes to meet the unique needs of each client. Our dedicated team ensures we deliver tailored solutions that...

  • Data Integration

    4 weeks ago


    Chennai, India Chargebee Full time

    About the Role We are seeking a highly motivated Software Engineer with a strong foundation in Java (Spring Boot) , data integration , and a growing expertise in Large Language Models (LLMs) . This role is ideal for engineers who enjoy working at the intersection of scalable data systems and AI-driven applications , building robust pipelines while also...

  • Data Integration

    4 weeks ago


    Chennai, India Chargebee Full time

    About the RoleWe are seeking a highly motivated Software Engineer with a strong foundation in Java (Spring Boot), data integration, and a growing expertise in Large Language Models (LLMs). This role is ideal for engineers who enjoy working at the intersection of scalable data systems and AI-driven applications, building robust pipelines while also exploring...

  • Data Integration

    4 weeks ago


    Chennai, India Chargebee Full time

    About the RoleWe are seeking a highly motivated Software Engineer with a strong foundation in Java (Spring Boot), data integration, and a growing expertise in Large Language Models (LLMs). This role is ideal for engineers who enjoy working at the intersection of scalable data systems and AI-driven applications, building robust pipelines while also exploring...

  • Data Integration

    4 weeks ago


    Chennai, India Chargebee Full time

    About the RoleWe are seeking a highly motivated Software Engineer with a strong foundation in Java (Spring Boot) , data integration , and a growing expertise in Large Language Models (LLMs) . This role is ideal for engineers who enjoy working at the intersection of scalable data systems and AI-driven applications , building robust pipelines while also...

  • Data Integration

    4 weeks ago


    Chennai, India Chargebee Full time

    About the RoleWe are seeking a highly motivated Software Engineer with a strong foundation in Java (Spring Boot), data integration, and a growing expertise in Large Language Models (LLMs). This role is ideal for engineers who enjoy working at the intersection of scalable data systems and AI-driven applications, building robust pipelines while also exploring...

  • Data Integration

    4 weeks ago


    Chennai, India Chargebee Full time

    About the Role We are seeking a highly motivated Software Engineer with a strong foundation in Java (Spring Boot) , data integration , and a growing expertise in Large Language Models (LLMs) . This role is ideal for engineers who enjoy working at the intersection of scalable data systems and AI-driven applications , building robust pipelines while also...