Cloud LLM Operations Engineer

2 weeks ago

Bengaluru, Karnataka, India NTT DATA Services Full time

Job Summary:

We are seeking a highly skilled Cloud LLM Operations Engineer to join our team at NTT DATA Services. As a key member of our team, you will play a critical role in building, automating, and maintaining our infrastructure on a leading cloud platform (Microsoft Azure, AWS, or GCP). In addition to core DevOps principles, you'll be an expert in containerization and orchestration using Kubernetes and AKS, enabling seamless deployments of our Large Language Models (LLMs) and GenAI solutions.

Responsibilities:

  • Utilize Infrastructure as Code (IaC) tools like Terraform to automate infrastructure provisioning and configuration for microservices deployments.
  • Implement and maintain Continuous Integration and Continuous Delivery (CI/CD) pipelines using tools like Azure DevOps to ensure smooth deployments of APIs and microservices.
  • Manage containerized applications using Docker and orchestrate deployments using Kubernetes and AKS.
  • Design, implement, and manage robust and scalable infrastructure on a leading cloud platform (Microsoft Azure, AWS, or GCP), utilizing their respective message routing services (e.g., Azure Service Bus, SQS, or Pub/Sub) for efficient communication within microservices architectures.
  • Design and implement source code management systems, branching strategy, versioning and release management.
  • Implement best practices for LLMops, ensuring efficient and reliable deployments of Large Language Models.
  • Collaborate with developers, data scientists, and researchers to understand application requirements for microservices and translate them into infrastructure solutions.
  • Monitor and maintain system health and performance of microservices and APIs, identifying and resolving potential issues proactively.
  • Implement security best practices using cloud platform services for authentication and authorization to ensure compliance with organizational security policies.
  • Automate routine tasks using scripting languages (Bash, Python, etc.) to improve efficiency and scalability across deployments.
  • Stay up-to-date on the latest advancements in cloud technologies, LLMops, GenAI solutions, and experience with configuring cloud-based load balancing and API management solutions, including familiarity with configuration options on leading cloud platforms (e.g., Azure Application Gateway, AWS API Gateway, GCP Apigee).
  • Participate in knowledge sharing and provide technical guidance to the team on DevOps best practices and emerging technologies.

Qualifications:

  • Proven experience as a DevOps Engineer with a strong understanding of cloud computing principles and microservices architectures.
  • Expertise in a leading cloud platform (Microsoft Azure, AWS, or GCP), including virtual machines, networking, storage, security services, and message routing.
  • In-depth knowledge of containerization technologies like Docker and container orchestration using Kubernetes and AKS (or equivalent platform).
  • Solid understanding of Infrastructure as Code (IaC) tools like Terraform.
  • Experience with CI/CD methodologies and tools for microservices deployments.
  • Familiarity with Large Language Models (LLMs) and GenAI solutions deployment best practices.
  • Excellent scripting skills (Bash, Python, etc.) for automation tasks.
  • Strong problem-solving and analytical skills.
  • Excellent communication and collaboration skills to work effectively with cross-functional teams.
  • Ability to work independently and manage multiple priorities effectively.
  • Passion for learning and staying current with new technologies.

Preferred Qualifications:

  • Experience working in a fast-paced, dynamic environment.
  • Certifications in cloud platform technologies (e.g., Azure Solutions Architect Expert, AWS Certified Solutions Architect - Associate).

Experience with Git version control system.

  • Cloud LLM Infrastructure Engineer

    8 hours ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Cloud LLM Ops EngineerJob Summary:We are seeking a passionate and experienced Cloud LLM Ops Engineer to join our growing team. You will play a critical role in building, automating, and maintaining our infrastructure on a leading cloud platform (Microsoft Azure, AWS, or GCP).Responsibilities:Utilize Infrastructure as Code (IaC) tools like Terraform to...

  • Cloud LLM Infrastructure Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Cloud LLM Ops Engineer Role Summary:We are seeking a highly skilled Cloud LLM Ops Engineer to join our team at NTT DATA Services. As a key member of our team, you will play a critical role in designing, implementing, and maintaining our cloud-based infrastructure for Large Language Models (LLMs) and GenAI solutions.Key Responsibilities:Design and implement...

  • Cloud Operations Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Ajmera Infotech Inc. Full time

    Job Title: Cloud Operations EngineerAjmera Infotech Inc. is seeking a highly skilled Cloud Operations Engineer to join our team in India. The ideal candidate will have extensive experience in Terraform, Azure Cloud support, and the automation of LLM model deployments.Key Responsibilities:Design and maintain tools for managing/improving the infrastructure and...

  • Cloud LLM Infrastructure Specialist

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Cloud LLM Infrastructure SpecialistWe are seeking a highly skilled Cloud LLM Infrastructure Specialist to join our team at NTT DATA Services. As a key member of our team, you will play a critical role in designing, building, and maintaining our cloud-based infrastructure for Large Language Models (LLMs) and GenAI solutions.Key Responsibilities:Design and...

  • Cloud Operations Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Ajmera Infotech Inc. Full time

    Cloud Operations EngineerAjmera Infotech Inc. is seeking a highly skilled Cloud Operations Engineer to join our team in India. The ideal candidate will have extensive experience in Terraform, Azure Cloud support, and the automation of LLM model deployments.Key Responsibilities:Design and maintain tools for managing/improving the infrastructure and program...

  • Cloud Operations Engineer Terraform Azure

    1 week ago

    Bengaluru, Karnataka, India Ajmera Infotech Inc. Full time

    About the RoleAjmera Infotech Inc. is seeking a highly skilled Cloud Operations Engineer specializing in Terraform and Azure to join our team in India. The ideal candidate will have extensive experience in Terraform, Azure Cloud support, and the automation of LLM model deployments.Key ResponsibilitiesDevelop and maintain Terraform configuration to provision...

  • Cloud Operations Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Ajmera Infotech Inc. Full time

    About Ajmera InfotechAjmera Infotech is a software research and development company specializing in high availability and mission-critical systems. We are the architects behind the technology powering some of the top 250 banks and wealth management organizations.Job Summary:We are seeking a highly skilled Cloud Operations Engineer specializing in Terraform...

  • Cloud LLM Infrastructure Specialist

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Cloud LLM Infrastructure SpecialistWe are seeking a highly skilled Cloud LLM Infrastructure Specialist to join our team at NTT DATA Services. As a key member of our team, you will play a critical role in designing, building, and maintaining our cloud-based infrastructure for Large Language Models (LLMs) and GenAI solutions.Key Responsibilities:Design and...

  • Senior LLM Operations Manager

    2 weeks ago

    Bengaluru, Karnataka, India Resource Tree Global Services Full time

    Job SummaryWe are seeking a highly experienced Senior LLM Operations Manager to join our team at Resource Tree Global Services. The successful candidate will be responsible for defining and disseminating best practices for LLM operations, evaluating and comparing different tools, and collaborating with architects, engineers, and data scientists to design and...

  • Senior LLM Operations Specialist

    2 weeks ago

    Bengaluru, Karnataka, India Resourcetree Full time

    Job SummaryResourcetree is seeking a highly skilled Senior LLM Operations Specialist to join our team. As a key member of our GenAI operations team, you will be responsible for defining and disseminating best practices for LLM operations, evaluating and comparing different tools, and collaborating with architects and engineers to design and implement...

  • Cloud Operations Engineer Terraform Terratest

    2 weeks ago

    Bengaluru, Karnataka, India Ajmera Infotech Inc. Full time

    About Ajmera Infotech Inc.Ajmera Infotech Inc. is a leading software research and development company specializing in high availability and mission-critical systems. We are the architects behind the technology powering some of the top 250 banks and wealth management organizations.Job Summary:Ajmera Infotech Inc. is seeking a highly skilled Cloud Operations...

  • Cloud Operations Engineer Terraform Azure Specialized

    6 hours ago

    Bengaluru, Karnataka, India Ajmera Infotech Inc. Full time

    About Ajmera Infotech Inc.Ajmera Infotech Inc. is a leading provider of software research and development services, specializing in high availability and mission-critical systems. Our team of experts is dedicated to delivering innovative solutions that meet the evolving needs of our clients.Job Title: Cloud Operations Engineer Terraform TerratestJob...

  • Senior LLM Operations Specialist

    2 weeks ago

    Bengaluru, Karnataka, India ResourceTee Global Service Full time

    Job DescriptionRole Summary: We are seeking a highly skilled Senior LLM Operations Specialist to join our team at ResourceTee Global Service. The successful candidate will be responsible for defining and implementing best practices for LLM operations, collaborating with cross-functional teams, and ensuring smooth LLM operations.Key Responsibilities:Define...

  • Cloud Operations Engineer Terraform Terratest

    7 days ago

    Bengaluru, Karnataka, India Ajmera Infotech Inc. Full time

    Job Summary:Ajmera Infotech is seeking a highly skilled Cloud Operations Engineer specializing in Terraform and Terratest to join our team in India. The ideal candidate will have extensive experience in Terraform, Azure Cloud support, and the automation of LLM model deployments.Key Responsibilities:Develop and maintain Terraform configuration to provision...

  • LLM Software Architect

    2 weeks ago

    Bengaluru, Karnataka, India Mazenet solution Full time

    Job Title: LLM EngineerMazenet solution is seeking a highly skilled LLM Engineer to join our team. As an LLM Engineer, you will be responsible for designing and developing scalable software solutions, leading architecture design, and ensuring the performance and reliability of our systems.Key Responsibilities:Design and develop scalable software solutions...

  • LLM Solutions Architect

    2 weeks ago

    Bengaluru, Karnataka, India Mazenet solution Full time

    Mazenet solution is seeking a highly skilled LLM Solutions Architect to design and develop scalable software solutions using Python, LLM solution patterns, and cloud platforms. The ideal candidate will have strong experience working with Python, LLM solution patterns, and tools (RAG, Vector DB, Agentic workflows, LoRA, etc.) cloud platforms (AWS, Azure,...

  • LLM Hardware Design Engineer

    7 days ago

    Bengaluru, Karnataka, India Orison Solutions Full time

    Job Title: LLM Hardware Design DeveloperJob Summary:We are seeking an exceptional hardware design developer to play a pivotal role in using the hardware design platform to generate training data for enterprise LLMs. This unique position offers the chance to directly contribute to the sophistication of enterprise LLMs, ensuring they operate with unparalleled...

  • LLM Hardware Design Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Orison Solutions Full time

    Job DescriptionOrison Solutions is seeking an exceptional hardware design developer to play a pivotal role in utilizing the hardware design platform to generate vital training data for enterprise LLMs. This unique position offers the chance to directly contribute to the sophistication of enterprise LLMs, ensuring they operate with unparalleled efficiency and...

  • LLM Software Architect

    1 week ago

    Bengaluru, Karnataka, India ITC Infotech Full time

    Job SummaryWe are seeking a highly skilled LLM Software Architect to join our team at ITC Infotech. As a key member of our engineering team, you will be responsible for designing and developing scalable and distributed software systems.Key ResponsibilitiesTranslate business requirements into technical specificationsOwn the technical execution of projects,...

  • LLM Model Architect

    3 days ago

    Bengaluru, Karnataka, India Mazenet solution Full time

    Mazenet solution seeks a highly skilled LLM Model Architect to design and develop scalable software solutions using Python and cloud platforms (AWS, Azure, GCP).Responsibilities:Translate business to technical requirementsOwn technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocationData driven decision making...