Cloud LLM Infrastructure Engineer

8 hours ago

Bengaluru, Karnataka, India NTT DATA Services Full time

Cloud LLM Ops Engineer

Job Summary:

We are seeking a passionate and experienced Cloud LLM Ops Engineer to join our growing team. You will play a critical role in building, automating, and maintaining our infrastructure on a leading cloud platform (Microsoft Azure, AWS, or GCP).

Responsibilities:

  • Utilize Infrastructure as Code (IaC) tools like Terraform to automate infrastructure provisioning and configuration for microservices deployments.
  • Implement and maintain Continuous Integration and Continuous Delivery (CI/CD) pipelines using tools like Azure DevOps to ensure smooth deployments of APIs and microservices.
  • Manage containerized applications using Docker and orchestrate deployments using Kubernetes and AKS.
  • Design, implement, and manage robust and scalable infrastructure on a leading cloud platform (Microsoft Azure, AWS, or GCP), utilizing their respective message routing services (e.g., Azure Service Bus, SQS, or Pub/Sub) for efficient communication within microservices architectures.
  • Design and implement source code management systems, branching strategy, versioning and release management.
  • Implement best practices for LLM Ops, ensuring efficient and reliable deployments of Large Language Models.
  • Collaborate with developers, data scientists, and researchers to understand application requirements for microservices and translate them into infrastructure solutions.
  • Monitor and maintain system health and performance of microservices and APIs, identifying and resolving potential issues proactively.
  • Implement security best practices using cloud platform services for authentication and authorization to ensure compliance with organizational security policies.
  • Automate routine tasks using scripting languages (Bash, Python, etc.) to improve efficiency and scalability across deployments.
  • Stay up-to-date on the latest advancements in cloud technologies, LLM Ops, GenAI solutions, and experience with configuring cloud-based load balancing and API management solutions, including familiarity with configuration options on leading cloud platforms (e.g., Azure Application Gateway, AWS API Gateway, GCP Apigee).
  • Participate in knowledge sharing and provide technical guidance to the team on DevOps best practices and emerging technologies.

Qualifications:

  • Proven experience as a DevOps Engineer with a strong understanding of cloud computing principles and microservices architectures.
  • Expertise in a leading cloud platform (Microsoft Azure, AWS, or GCP), including virtual machines, networking, storage, security services, and message routing.
  • In-depth knowledge of containerization technologies like Docker and container orchestration using Kubernetes and AKS (or equivalent platform).
  • Solid understanding of Infrastructure as Code (IaC) tools like Terraform.
  • Experience with CI/CD methodologies and tools for microservices deployments.
  • Familiarity with Large Language Models (LLMs) and GenAI solutions deployment best practices.
  • Excellent scripting skills (Bash, Python, etc.) for automation tasks.
  • Strong problem-solving and analytical skills.
  • Excellent communication and collaboration skills to work effectively with cross-functional teams.
  • Ability to work independently and manage multiple priorities effectively.
  • Passion for learning and staying current with new technologies.

Preferred Qualifications:

  • Experience working in a fast-paced, dynamic environment.
  • Certifications in cloud platform technologies (e.g., Azure Solutions Architect Expert, AWS Certified Solutions Architect - Associate).

Experience with Git version control system.

  • Cloud LLM Infrastructure Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Cloud LLM Ops Engineer Role Summary:We are seeking a highly skilled Cloud LLM Ops Engineer to join our team at NTT DATA Services. As a key member of our team, you will play a critical role in designing, implementing, and maintaining our cloud-based infrastructure for Large Language Models (LLMs) and GenAI solutions.Key Responsibilities:Design and implement...

  • Cloud LLM Infrastructure Specialist

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Cloud LLM Infrastructure SpecialistWe are seeking a highly skilled Cloud LLM Infrastructure Specialist to join our team at NTT DATA Services. As a key member of our team, you will play a critical role in designing, building, and maintaining our cloud-based infrastructure for Large Language Models (LLMs) and GenAI solutions.Key Responsibilities:Design and...

  • Cloud LLM Infrastructure Specialist

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Cloud LLM Infrastructure SpecialistWe are seeking a highly skilled Cloud LLM Infrastructure Specialist to join our team at NTT DATA Services. As a key member of our team, you will play a critical role in designing, building, and maintaining our cloud-based infrastructure for Large Language Models (LLMs) and GenAI solutions.Key Responsibilities:Design and...

  • Cloud Infrastructure Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Title: Cloud LLM Ops EngineerAbout the Role:We're seeking a skilled Cloud LLM Ops Engineer to join our team at NTT DATA Services. As a Cloud LLM Ops Engineer, you will play a critical role in building, automating, and maintaining our infrastructure on a leading cloud platform. You will be responsible for implementing and maintaining Continuous...

  • Cloud LLM Operations Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Summary:We are seeking a highly skilled Cloud LLM Operations Engineer to join our team at NTT DATA Services. As a key member of our team, you will play a critical role in building, automating, and maintaining our infrastructure on a leading cloud platform (Microsoft Azure, AWS, or GCP). In addition to core DevOps principles, you'll be an expert in...

  • AWS Cloud Infrastructure Engineer

    1 week ago

    Bengaluru, Karnataka, India Centilytics | Intelligent Cloud Management Full time

    Job Title: Sr. AWS DevOps EngineerJob Location: BengaluruJob Type: Full-time Experience: 7-8 years in DevOps, cloud infrastructure management, and CI/CD pipeline automation Job Summary: We are seeking an experienced DevOps Engineer with over 7-8 years of expertise in automating infrastructure provisioning, managing data pipelines, and optimizing deployment...

  • Cloud Infrastructure Engineer

    5 days ago

    Bengaluru, Karnataka, India NetApp Full time

    Job Title: Cloud Infrastructure EngineerNetApp is seeking a skilled Cloud Infrastructure Engineer to join our team. As a Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and maintaining cloud-based infrastructure to support our SaaS/IaaS offerings.Key Responsibilities:Design and implement cloud-based infrastructure to...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NetApp Full time

    Job Title: Cloud Infrastructure EngineerJob SummaryWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at NetApp. As a Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and maintaining cloud-based infrastructure solutions that meet the needs of our customers. You will work closely with our...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Bengaluru, Karnataka, India SAP Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at SAP. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining our cloud infrastructure to ensure high levels of reliability and performance.Key ResponsibilitiesDesign and implement cloud infrastructure...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NetApp Full time

    Job Title: Cloud Infrastructure/Site Reliability EngineerJob SummaryWe are seeking a highly skilled Cloud Infrastructure/Site Reliability Engineer to join our team at NetApp. As a Cloud Infrastructure/Site Reliability Engineer, you will be responsible for designing, deploying, and maintaining cloud-based infrastructure and services. Your primary focus will...

  • Cloud Operations Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Ajmera Infotech Inc. Full time

    Job Title: Cloud Operations EngineerAjmera Infotech Inc. is seeking a highly skilled Cloud Operations Engineer to join our team in India. The ideal candidate will have extensive experience in Terraform, Azure Cloud support, and the automation of LLM model deployments.Key Responsibilities:Design and maintain tools for managing/improving the infrastructure and...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Arting Digital Private Limited Full time

    Job Title: Cloud Infrastructure EngineerJob Summary:We are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Arting Digital Private Limited. As a Cloud Infrastructure Engineer, you will be responsible for designing, building, and maintaining highly available, scalable, and performant infrastructure for our applications.Key...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Arting Digital Private Limited Full time

    Job Title: Cloud Infrastructure EngineerJob Summary:We are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Arting Digital Private Limited. As a Cloud Infrastructure Engineer, you will be responsible for designing, building, and maintaining highly available, scalable, and performant infrastructure for our applications.Key...

  • Cloud Infrastructure Engineer

    7 days ago

    Bengaluru, Karnataka, India NetApp Full time

    Job Title: Cloud Infrastructure EngineerAt NetApp, we are seeking a skilled Cloud Infrastructure Engineer to join our team. As a Cloud Infrastructure Engineer, you will play a crucial role in designing, implementing, and maintaining cloud-based infrastructure to support our SaaS/IaaS offerings.Key Responsibilities:Design and implement cloud-based...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NetApp Full time

    Job Title: Cloud Infrastructure EngineerAt NetApp, we are seeking a highly skilled Cloud Infrastructure Engineer to join our team. As a Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and maintaining cloud-based infrastructure solutions that support our SaaS/IaaS offerings.Key Responsibilities:Design and implement...

  • Cloud Infrastructure Engineer

    4 days ago

    Bengaluru, Karnataka, India NetApp Full time

    Job Title: Cloud Infrastructure Engineer Job SummaryAs a Cloud Infrastructure Engineer at NetApp, you will be responsible for designing, implementing, and maintaining cloud-based infrastructure to support our SaaS/IaaS offerings. You will work closely with cloud service provider teams to ensure the smooth operation of vital cloud services.Key...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Flipkart Full time

    About the Role:We are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Flipkart. As a Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and maintaining our private cloud infrastructure.Key Responsibilities:Design and implement scalable and highly available cloud infrastructureCollaborate with...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NetApp Full time

    Job Title: Cloud Infrastructure EngineerJob SummaryWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at NetApp. As a Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and maintaining cloud-based infrastructure to support our SaaS/IaaS offerings. You will work closely with our development team to...

  • Cloud Operations Engineer Terraform Azure

    1 week ago

    Bengaluru, Karnataka, India Ajmera Infotech Inc. Full time

    About the RoleAjmera Infotech Inc. is seeking a highly skilled Cloud Operations Engineer specializing in Terraform and Azure to join our team in India. The ideal candidate will have extensive experience in Terraform, Azure Cloud support, and the automation of LLM model deployments.Key ResponsibilitiesDevelop and maintain Terraform configuration to provision...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Epsilon Full time

    Job Title: Cloud Infrastructure EngineerWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Epsilon. As a Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and managing cloud-based infrastructure for our clients.Key Responsibilities:Design and implement cloud-based infrastructure using AWS,...