Senior Large Language Model Operations Engineer

2 days ago


Gulbarga, Karnataka, India beBeeLeadership Full time ₹ 20,00,000 - ₹ 30,00,000
Job Description:

We are seeking an experienced professional to drive the deployment, scaling, and monitoring of large language models (LLMs) in production. The ideal candidate will have strong hands-on expertise with MLOps frameworks, cloud-native architectures, and modern DevOps practices, combined with leadership skills to align cross-functional stakeholders and establish best practices for LLM operations.

This role focuses on building robust, scalable, and secure infrastructure for managing the end-to-end lifecycle of LLMs—from training and fine-tuning to inference and continuous improvement. Responsibilities include designing and implementing LLM Ops infrastructure for training, fine-tuning, and large-scale inference, establishing and enforcing best practices for model deployment, monitoring, retraining, and continuous improvement, and implementing security, compliance, and responsible AI guardrails to ensure safe and ethical LLM usage.

  • Designing and Implementing Infrastructure: Designing and implementing LLM Ops infrastructure for training, fine-tuning, and large-scale inference.
  • Establishing Best Practices: Establishing and enforcing best practices for model deployment, monitoring, retraining, and continuous improvement.
  • Implementing Security Measures: Implementing security, compliance, and responsible AI guardrails to ensure safe and ethical LLM usage.
Required Skills and Qualifications:
  • Strong expertise in LLM deployment, scaling, and monitoring
  • Proficiency in MLOps frameworks (Kubeflow, MLflow, Databricks deployment patterns)
  • Hands-on experience with cloud-native architectures (Azure preferred)
  • Strong background in CI/CD pipelines, containerization (Docker, Kubernetes), and microservices
  • Solid understanding of observability tools (Prometheus, Grafana, OpenTelemetry)
  • Deep knowledge of model evaluation, drift detection, prompt management, and AI safety guardrails
  • Programming expertise in Python and Bash scripting
  • Experience with vector databases and RAG pipelines
  • Strong leadership and stakeholder communication skills
  • Knowledge of LLM safety, bias mitigation, and regulatory compliance
Benefits:

We offer a competitive compensation package, performance-based incentives, and health benefits to support your well-being. We also believe in your continuous growth and offer company-sponsored certifications, training programs, and skill-building opportunities to help you succeed.

Our positive and inclusive culture includes team activities, wellness and mental health programs to ensure your comfort and productivity.



  • Gulbarga, Karnataka, India beBeeLanguage Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Large Language Model EngineerWe are seeking an experienced professional to lead the design, development and deployment of large-scale AI solutions. The ideal candidate will bridge the gap between business requirements and technical implementation with deep expertise in generative AI and modern MLOps practices.Key Responsibilities:Design and...


  • Gulbarga, Karnataka, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Senior Data Scientist Role Overview">We are seeking a highly skilled Senior Data Scientist to join our team. The ideal candidate will have 3+ years of experience in large language model (LLM) and natural language processing (NLP) model development.The successful candidate will be responsible for fine-tuning and optimizing LLM and NLP models for real-world...


  • Gulbarga, Karnataka, India beBeeLanguage Full time US$ 2,50,000 - US$ 3,00,000

    About the RoleThe Senior Large Language Model Program Lead oversees large-scale initiatives across multiple geographies.Key Responsibilities include end-to-end project delivery for data annotation, fine-tuning, reinforcement learning with human feedback, evaluation, and deployment of Large Language Models at scale.Program Lead Key Responsibilities:Drive...


  • Gulbarga, Karnataka, India beBeeDeveloper Full time US$ 1,50,000 - US$ 2,00,000

    Senior AI Model DeveloperThis role is focused on developing and optimizing large language models (LLMs) using various techniques, including prompt engineering, retrieval-augmented generation (RAG), and agent-based architectures.Key ResponsibilitiesLead the design, training, fine-tuning, and deployment of LLMs, leveraging techniques like prompt engineering,...

  • Expert Mathematician

    2 weeks ago


    Gulbarga, Karnataka, India beBeeMathematician Full time US$ 75,000 - US$ 1,25,000

    Mathematics Trainer PositionWe invite scholars to take on the role of LLM Trainer and utilize their expertise in mathematics to train and fine-tune large language models.Key Responsibilities:Utilize expertise in mathematics to train and fine-tune large language models, ensuring optimal performance and efficiency.Collaborate with cross-functional teams to...

  • Academic ML Expert

    2 weeks ago


    Gulbarga, Karnataka, India beBeeMachineLearning Full time ₹ 30,00,000 - ₹ 42,00,000

    Job DescriptionWe are excited to invite PhD in Machine Learning scholars to join our team as LLM Trainer to train the Large Language Model (LLMs) and thereby, can contribute to multiple projects based on your interest level.


  • Gulbarga, Karnataka, India beBeeMathematician Full time ₹ 12,00,000 - ₹ 15,00,000

    Job DescriptionWe are looking for an expert in mathematics to work on projects that involve fine-tuning large language models using strong analytical and English comprehension skills. The ideal candidate should have a solid foundation in mathematics and be able to break down complex mathematical concepts into simple, clear explanations.The projects will also...


  • Gulbarga, Karnataka, India beBeeLanguage Full time US$ 1,50,000 - US$ 2,50,000

    AI Engineering RoleWe are seeking an experienced AI Engineer with a proven track record in developing, configuring and fine-tuning Large Language Models (LLMs) and Small Language Models (SLMs).The ideal candidate will play a critical role in the development of GenAI-powered products and will collaborate closely with product and engineering teams to develop...


  • Gulbarga, Karnataka, India beBeeLargeLanguageModel Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: AI/ML ArchitectThe role of an AI/ML Architect is a critical one, involving the design and training of large language models (LLM) that can process and generate natural language.Key Responsibilities include designing neural network parameters and training on extensive datasets to ensure effective model performance.Collaboration with various teams...


  • Gulbarga, Karnataka, India beBeeMLOps Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Our organization is looking for a highly skilled professional to join our team as a Model Operations Specialist. This role involves the ownership of model productionization, ensuring that services are resilient and meet specific Service Level Objectives (SLOs).The ideal candidate will have experience operating machine learning systems in production,...