Cloud LLM Ops Engineer

3 months ago

Bengaluru, India NTT DATA Services Full time

Cloud LLM Ops Engineer

Job Summary:

We are seeking a passionate and experienced Cloud LLMops Engineer to join our growing team. You will play a critical role in building, automating, and maintaining our infrastructure on a leading cloud platform (Microsoft Azure, AWS, or GCP). In addition to core DevOps principles, you'll be an expert in containerization and orchestration using Kubernetes and AKS, enabling seamless deployments of our Large Language Models (LLMs) and GenAI solutions.

Responsibilities:

  • Utilize Infrastructure as Code (IaC) tools like Terraform to automate infrastructure provisioning and configuration for microservices deployments.
  • Implement and maintain Continuous Integration and Continuous Delivery (CI/CD) pipelines using tools like Azure DevOps to ensure smooth deployments of APIs and microservices.
  • Manage containerized applications using Docker and orchestrate deployments using Kubernetes and AKS.
  • Design, implement, and manage robust and scalable infrastructure on a leading cloud platform (Microsoft Azure, AWS, or GCP), utilizing their respective message routing services (e.g., Azure Service Bus, SQS, or Pub/Sub) for efficient communication within microservices architectures.
  • Design and implement source code management systems, branching strategy, versioning and release management.
  • Implement best practices for LLMops, ensuring efficient and reliable deployments of Large Language Models.
  • Collaborate with developers, data scientists, and researchers to understand application requirements for microservices and translate them into infrastructure solutions.
  • Monitor and maintain system health and performance of microservices and APIs, identifying and resolving potential issues proactively.
  • Implement security best practices using cloud platform services for authentication and authorization to ensure compliance with organizational security policies.
  • Automate routine tasks using scripting languages (Bash, Python, etc.) to improve efficiency and scalability across deployments.
  • Stay up-to-date on the latest advancements in cloud technologies, LLMops, GenAI solutions, and experience with configuring cloud-based load balancing and API management solutions, including familiarity with configuration options on leading cloud platforms (e.g., Azure Application Gateway, AWS API Gateway, GCP Apigee).
  • Participate in knowledge sharing and provide technical guidance to the team on DevOps best practices and emerging technologies.

Qualifications:

  • Proven experience as a DevOps Engineer with a strong understanding of cloud computing principles and microservices architectures.
  • Expertise in a leading cloud platform (Microsoft Azure, AWS, or GCP), including virtual machines, networking, storage, security services, and message routing.
  • In-depth knowledge of containerization technologies like Docker and container orchestration using Kubernetes and AKS (or equivalent platform).
  • Solid understanding of Infrastructure as Code (IaC) tools like Terraform.
  • Experience with CI/CD methodologies and tools for microservices deployments.
  • Familiarity with Large Language Models (LLMs) and GenAI solutions deployment best practices.
  • Excellent scripting skills (Bash, Python, etc.) for automation tasks.
  • Strong problem-solving and analytical skills.
  • Excellent communication and collaboration skills to work effectively with cross-functional teams.
  • Ability to work independently and manage multiple priorities effectively.
  • Passion for learning and staying current with new technologies.

Preferred Qualifications:

  • Experience working in a fast-paced, dynamic environment.
  • Certifications in cloud platform technologies (e.g., Azure Solutions Architect Expert, AWS Certified Solutions Architect - Associate).

Experience with Git version control system.

  • Cloud LLM Ops Engineer

    1 month ago

    Bengaluru, India NTT DATA Full time

    Job Description Cloud LLM Ops EngineerJob Summary:We are seeking a passionate and experienced Cloud LLMops Engineer to join our growing team. You will play a critical role in building, automating, and maintaining our infrastructure on a leading cloud platform (Microsoft Azure, AWS, or GCP). In addition to core DevOps principles, you'll be an expert in...

  • Principal llm application engineer

    4 days ago

    Bengaluru, India System Two Security Full time

    Job DescriptionSystem Two Security is looking to hire a Principal LLM Application Engineer where you will focus on leveraging and optimizing Large Language Models (LLMs) along with the implementation of advanced AI technologies. You will be working on cutting edge projects, and will utilize skills in Gen AI, LLM and ML Ops to bring a better experience to...

  • Principal LLM Application Engineer

    6 days ago

    Bengaluru, India System Two Security Full time

    Job DescriptionSystem Two Security is looking to hire a Principal LLM Application Engineer where you will focus on leveraging and optimizing Large Language Models (LLMs) along with the implementation of advanced AI technologies. You will be working on cutting edge projects, and will utilize skills in GenAI, LLM and ML Ops to bring a better experience to...

  • LLM Engineer

    3 months ago

    Bengaluru, India Mazenet solution Full time

    LLM EngineerWe are seeking a highly skilled LLM Engineer with a minimum of 5 years of experience in software development and 1-2 years in LLM solution development. The ideal candidate will have strong experience working with Python, LLM solution patterns and tools (RAG, Vector DB, Agentic workflows, LoRA, etc.) cloud platforms (AWS, Azure, GCP), and DevOps...

  • Principal LLM Application Engineer

    6 days ago

    Bengaluru, India System Two Security Full time

    Job DescriptionSystem Two Security is looking to hire a Principal LLM Application Engineer where you will focus on leveraging and optimizing Large Language Models (LLMs) along with the implementation of advanced AI technologies. You will be working on cutting edge projects, and will utilize skills in GenAI, LLM and ML Ops to bring a better experience to...

  • Principal LLM Application Engineer

    4 days ago

    Bengaluru, India System Two Security Full time

    Job DescriptionSystem Two Security is looking to hire a Principal LLM Application Engineer where you will focus on leveraging and optimizing Large Language Models (LLMs) along with the implementation of advanced AI technologies. You will be working on cutting edge projects, and will utilize skills in GenAI, LLM and ML Ops to bring a better experience to...

  • Principal LLM Application Engineer

    6 days ago

    Bengaluru, India System Two Security Full time

    Job Description System Two Security is looking to hire a Principal LLM Application Engineer where you will focus on leveraging and optimizing Large Language Models (LLMs) along with the implementation of advanced AI technologies. You will be working on cutting edge projects, and will utilize skills in GenAI, LLM and ML Ops to bring a better experience to...

  • LLM Engineer

    5 days ago

    Bengaluru, India SARVAJITH INFOTECH Full time

    Job Description Responsibilities :- RAG Pipeline Development : Design and develop Retrieval-Augmented Generation (RAG) pipelines for efficient and context-aware information retrieval.- Prompt Tuning and Strategy : Implement prompt engineering and fine-tuning techniques to enhance the quality and relevance of AI outputs.- API Development : Create, maintain,...

  • LLM Engineer

    1 month ago

    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.Translate business to technical requirementsOwn technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocationData driven decision making skills with focus on achieving product goalsDesign, develop and deploy LLM based...

  • Cloud Ops Admin Gcp

    6 months ago

    Bengaluru, India Applied Cloud Computing Full time

    Proven 5+ years experience leading and managing Cloud Infrastructure - VPC, Compute, Storage, Container Services, Kubernetes and other relevant services. - Strong Linux /CentOS/ Ubuntu/GKE system administration skills (patching, configuration, etc.) - Automation (Chef, Puppet) - Experience of full software development lifecycle experience using Agile /...

  • Cloud LLM Operations Specialist

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Cloud LLM Operations SpecialistWe are seeking an experienced Cloud LLM Operations Specialist to join our team at NTT DATA Services. This is a critical role that involves building, automating, and maintaining our infrastructure on a leading cloud platform.Key Responsibilities:Utilize Infrastructure as Code (IaC) tools like Terraform to automate infrastructure...

  • LLM Engineer

    1 month ago

    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.- Translate business to technical requirements- Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation- Data driven decision making skills with focus on achieving product goals- Design, develop and deploy LLM...

  • Manager/Lead - LLM

    2 months ago

    Bengaluru, India Resourcetree Full time

    Role : Manager / Lead - LLM OpsExperience : 5 - 10 years Location : BangaloreRole and Responsibilities :- Define and disseminate LLMOps best practices for Aris Global products.- Evaluate and compare different LLMOps tools to incorporate the best practices.- Collaborate with architects, engineers, data-scientists, and SMEs to design, implement and oversee the...

  • Cloud Ops with AI/ML Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Siemens Technology and Services Private Limited Full time

    Job OverviewWe are seeking a highly skilled Cloud Ops with AI/ML engineer to join our Digitalization Technology and Services team based in Bangalore. As a key member of our team, you will be responsible for designing and implementing cloud-based solutions that drive business growth and customer satisfaction.

  • LLM Engineer

    2 months ago

    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.Translate business to technical requirementsOwn technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocationData driven decision making skills with focus on achieving product goalsDesign, develop and deploy LLM based...

  • LLM Engineer

    2 months ago

    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.Translate business to technical requirementsOwn technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocationData driven decision making skills with focus on achieving product goalsDesign, develop and deploy LLM based...

  • LLM Engineer

    2 months ago

    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems. Translate business to technical requirements Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation Data driven decision making skills with focus on achieving product goals Design, develop and deploy LLM based...

  • System Two Security | Principal LLM Application Engineer | bangalore

    6 days ago

    Bengaluru, India System Two Security Full time

    Job DescriptionSystem Two Security is looking to hire a Principal LLM Application Engineer where you will focus on leveraging and optimizing Large Language Models (LLMs) along with the implementation of advanced AI technologies. You will be working on cutting edge projects, and will utilize skills in GenAI, LLM and ML Ops to bring a better experience to...

  • GenAI and LLM Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Talent Divas Consulting Full time

    Job Title: GenAI and LLM Engineer (PyTorch)Job Summary:We are seeking a highly skilled GenAI and LLM Engineer with expertise in PyTorch to join our AI research and development team. This role is ideal for someone passionate about advancing the capabilities of Generative AI, building and fine-tuning large language models (LLMs), and implementing solutions...

  • Manager/Lead - LLM Models

    2 months ago

    Bengaluru, India Resource Tree Global Services Full time

    Role : Manager/Lead - LLM OpsExperience : 5 - 10 years Location : BangaloreRole and Responsibilities :- Define and disseminate LLMOps best practices- Evaluate and compare different LLMOps tools to incorporate the best practices.- Collaborate with architects, engineers, data-scientists, and SMEs to design, implement and oversee the infrastructure requirement...