Cloud LLM Infrastructure Engineer

1 month ago

Bengaluru, Karnataka, India NTT DATA Services Full time

Cloud LLM Ops Engineer Role Summary:

We are seeking a highly skilled Cloud LLM Ops Engineer to join our team at NTT DATA Services. As a key member of our team, you will play a critical role in designing, implementing, and maintaining our cloud-based infrastructure for Large Language Models (LLMs) and GenAI solutions.

Key Responsibilities:

  • Design and implement scalable and secure cloud infrastructure using leading cloud platforms (Microsoft Azure, AWS, or GCP).
  • Develop and maintain Continuous Integration and Continuous Delivery (CI/CD) pipelines to ensure smooth deployments of APIs and microservices.
  • Manage containerized applications using Docker and orchestrate deployments using Kubernetes and AKS.
  • Collaborate with developers, data scientists, and researchers to understand application requirements and translate them into infrastructure solutions.
  • Monitor and maintain system health and performance of microservices and APIs, identifying and resolving potential issues proactively.
  • Implement security best practices using cloud platform services for authentication and authorization to ensure compliance with organizational security policies.
  • Automate routine tasks using scripting languages (Bash, Python, etc.) to improve efficiency and scalability across deployments.
  • Stay up-to-date on the latest advancements in cloud technologies, LLMops, GenAI solutions, and experience with configuring cloud-based load balancing and API management solutions.

Requirements:

  • Proven experience as a DevOps Engineer with a strong understanding of cloud computing principles and microservices architectures.
  • Expertise in a leading cloud platform (Microsoft Azure, AWS, or GCP), including virtual machines, networking, storage, security services, and message routing.
  • In-depth knowledge of containerization technologies like Docker and container orchestration using Kubernetes and AKS (or equivalent platform).
  • Solid understanding of Infrastructure as Code (IaC) tools like Terraform.
  • Experience with CI/CD methodologies and tools for microservices deployments.
  • Familiarity with Large Language Models (LLMs) and GenAI solutions deployment best practices.
  • Excellent scripting skills (Bash, Python, etc.) for automation tasks.
  • Strong problem-solving and analytical skills.
  • Excellent communication and collaboration skills to work effectively with cross-functional teams.
  • Ability to work independently and manage multiple priorities effectively.
  • Passion for learning and staying current with new technologies.

Preferred Qualifications:

  • Experience working in a fast-paced, dynamic environment.
  • Certifications in cloud platform technologies (e.g., Azure Solutions Architect Expert, AWS Certified Solutions Architect - Associate).

Experience with Git version control system.

  • Cloud LLM Infrastructure Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Cloud LLM Ops EngineerJob Summary:We are seeking a passionate and experienced Cloud LLM Ops Engineer to join our growing team. You will play a critical role in building, automating, and maintaining our infrastructure on a leading cloud platform (Microsoft Azure, AWS, or GCP).Responsibilities:Utilize Infrastructure as Code (IaC) tools like Terraform to...

  • Cloud LLM Infrastructure Specialist

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Cloud LLM Infrastructure SpecialistWe are seeking a highly skilled Cloud LLM Infrastructure Specialist to join our team at NTT DATA Services. As a key member of our team, you will play a critical role in designing, building, and maintaining our cloud-based infrastructure for Large Language Models (LLMs) and GenAI solutions.Key Responsibilities:Design and...

  • Cloud LLM Infrastructure Specialist

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Cloud LLM Infrastructure SpecialistWe are seeking a highly skilled Cloud LLM Infrastructure Specialist to join our team at NTT DATA Services. As a key member of our team, you will play a critical role in designing, building, and maintaining our cloud-based infrastructure for Large Language Models (LLMs) and GenAI solutions.Key Responsibilities:Design and...

  • Cloud LLM Infrastructure Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    We are seeking a Cloud LLM Ops Engineer to build, automate, and maintain our infrastructure on a leading cloud platform. This role involves core DevOps principles, containerization, and orchestration using Kubernetes and AKS, enabling seamless deployments of our Large Language Models and GenAI solutions.Key Responsibilities:Implement and maintain Continuous...

  • Cloud Infrastructure Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Title: Cloud LLM Ops EngineerAbout the Role:We're seeking a skilled Cloud LLM Ops Engineer to join our team at NTT DATA Services. As a Cloud LLM Ops Engineer, you will play a critical role in building, automating, and maintaining our infrastructure on a leading cloud platform. You will be responsible for implementing and maintaining Continuous...

  • Cloud LLM Pipeline Architect

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionCloud LLM Pipeline ArchitectAbout the RoleWe are seeking a skilled Cloud LLM Pipeline Architect to design, implement, and maintain our Large Language Model (LLM) infrastructure on a leading cloud platform. As a key member of our team, you will play a critical role in building, automating, and optimizing our LLM pipeline, ensuring seamless...

  • Cloud LLM Operations Specialist

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Cloud LLM Operations SpecialistWe are seeking an experienced Cloud LLM Operations Specialist to join our team at NTT DATA Services. This is a critical role that involves building, automating, and maintaining our infrastructure on a leading cloud platform.Key Responsibilities:Utilize Infrastructure as Code (IaC) tools like Terraform to automate infrastructure...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Bengaluru, Karnataka, India My R Cloud Full time

    Job Description:At My R Cloud, we are seeking a skilled Cloud Infrastructure Engineer to join our team. As a key member of our infrastructure team, you will be responsible for designing, implementing, and managing our cloud infrastructure to ensure high availability, scalability, and performance.Key Responsibilities:- Design and implement cloud...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Cloud Software Group Full time

    About This Job: At Cloud Software Group, we are seeking an experienced Cloud Infrastructure Engineer to join our team. As a key member of our engineering organization, you will play a critical role in designing and building highly resilient and scalable cloud services.Key Responsibilities:Partner with development teams to design and implement cloud...

  • AWS Cloud Infrastructure Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Centilytics | Intelligent Cloud Management Full time

    Job Title: Sr. AWS DevOps EngineerJob Location: BengaluruJob Type: Full-time Experience: 7-8 years in DevOps, cloud infrastructure management, and CI/CD pipeline automation Job Summary: We are seeking an experienced DevOps Engineer with over 7-8 years of expertise in automating infrastructure provisioning, managing data pipelines, and optimizing deployment...

  • Cloud Infrastructure Operations Engineer

    6 days ago

    Bengaluru, Karnataka, India Banyan Cloud Full time

    About UsHonest Data technologies Pvt Ltd is a pioneering subsidiary of Banyan Cloud USA, a leading Cyber Security Product Company headquartered in San Jose California USA. Our flagship product Banyan Cloud is a groundbreaking CNAP Platform simplifying cloud security for multi-cloud and on-premises environments.This is an exceptional opportunity to be part of...

  • Cloud Infrastructure Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NetApp Full time

    Job Title: Cloud Infrastructure EngineerNetApp is seeking a skilled Cloud Infrastructure Engineer to join our team. As a Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and maintaining cloud-based infrastructure to support our SaaS/IaaS offerings.Key Responsibilities:Design and implement cloud-based infrastructure to...

  • Cloud Infrastructure Engineer

    1 month ago

    Bengaluru, Karnataka, India Arting Digital Private Limited Full time

    Job Title: Cloud Infrastructure EngineerJob Summary:We are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Arting Digital Private Limited. As a Cloud Infrastructure Engineer, you will be responsible for designing, building, and maintaining highly available, scalable, and performant infrastructure for our applications.Key...

  • Cloud Infrastructure Engineer

    1 month ago

    Bengaluru, Karnataka, India Arting Digital Private Limited Full time

    Job Title: Cloud Infrastructure EngineerJob Summary:We are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Arting Digital Private Limited. As a Cloud Infrastructure Engineer, you will be responsible for designing, building, and maintaining highly available, scalable, and performant infrastructure for our applications.Key...

  • Cloud Infrastructure Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NetApp Full time

    Job Title: Cloud Infrastructure EngineerAt NetApp, we are seeking a skilled Cloud Infrastructure Engineer to join our team. As a Cloud Infrastructure Engineer, you will play a crucial role in designing, implementing, and maintaining cloud-based infrastructure to support our SaaS/IaaS offerings.Key Responsibilities:Design and implement cloud-based...

  • Cloud Infrastructure Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NetApp Full time

    Job Title: Cloud Infrastructure Engineer Job SummaryAs a Cloud Infrastructure Engineer at NetApp, you will be responsible for designing, implementing, and maintaining cloud-based infrastructure to support our SaaS/IaaS offerings. You will work closely with cloud service provider teams to ensure the smooth operation of vital cloud services.Key...

  • Cloud Infrastructure Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Flipkart Full time

    About the Role:We are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Flipkart. As a Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and maintaining our private cloud infrastructure.Key Responsibilities:Design and implement scalable and highly available cloud infrastructureCollaborate with...

  • Cloud Infrastructure Engineer

    1 month ago

    Bengaluru, Karnataka, India NetApp Full time

    Job Title: Cloud Infrastructure EngineerJob SummaryWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at NetApp. As a Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and maintaining cloud-based infrastructure to support our SaaS/IaaS offerings. You will work closely with our development team to...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Apex Systems Full time

    We are looking for a skilled Cloud Infrastructure Engineer to join our team at Apex Systems. The ideal candidate will have a strong background in site reliability engineering and devops, with a focus on cloud infrastructure. Key Responsibilities:• Design and implement scalable cloud infrastructure solutions using Terraform and CloudFormation. •...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Pythian Full time

    Job Description: We are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Pythian.About the Role: As a Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and maintaining our cloud infrastructure. This includes setting up and configuring cloud-based systems, ensuring high availability and scalability,...