Cloud LLM Ops Engineer

1 week ago

Bengaluru, India NTT DATA Full time

Job Description

Cloud LLM Ops Engineer

Job Summary:

We are seeking a passionate and experienced Cloud LLMops Engineer to join our growing team. You will play a critical role in building, automating, and maintaining our infrastructure on a leading cloud platform (Microsoft Azure, AWS, or GCP). In addition to core DevOps principles, you'll be an expert in containerization and orchestration using Kubernetes and AKS, enabling seamless deployments of our Large Language Models (LLMs) and GenAI solutions.

Responsibilities:

Utilize Infrastructure as Code (IaC) tools like Terraform to automate infrastructure provisioning and configuration for microservices deployments.Implement and maintain Continuous Integration and Continuous Delivery (CI/CD) pipelines using tools like Azure DevOps to ensure smooth deployments of APIs and microservices.Manage containerized applications using Docker and orchestrate deployments using Kubernetes and AKS.Design, implement, and manage robust and scalable infrastructure on a leading cloud platform (Microsoft Azure, AWS, or GCP), utilizing their respective message routing services (e.g., Azure Service Bus, SQS, or Pub/Sub) for efficient communication within microservices architectures.Design and implement source code management systems, branching strategy, versioning and release management.Implement best practices for LLMops, ensuring efficient and reliable deployments of Large Language Models.Collaborate with developers, data scientists, and researchers to understand application requirements for microservices and translate them into infrastructure solutions.Monitor and maintain system health and performance of microservices and APIs, identifying and resolving potential issues proactively.Implement security best practices using cloud platform services for authentication and authorization to ensure compliance with organizational security policies.Automate routine tasks using scripting languages (Bash, Python, etc.) to improve efficiency and scalability across deployments.Stay up-to-date on the latest advancements in cloud technologies, LLMops, GenAI solutions, and experience with configuring cloud-based load balancing and API management solutions, including familiarity with configuration options on leading cloud platforms (e.g., Azure Application Gateway, AWS API Gateway, GCP Apigee).Participate in knowledge sharing and provide technical guidance to the team on DevOps best practices and emerging technologies.

Qualifications:

Proven experience as a DevOps Engineer with a strong understanding of cloud computing principles and microservices architectures.Expertise in a leading cloud platform (Microsoft Azure, AWS, or GCP), including virtual machines, networking, storage, security services, and message routing.In-depth knowledge of containerization technologies like Docker and container orchestration using Kubernetes and AKS (or equivalent platform).Solid understanding of Infrastructure as Code (IaC) tools like Terraform.Experience with CI/CD methodologies and tools for microservices deployments.Familiarity with Large Language Models (LLMs) and GenAI solutions deployment best practices.Excellent scripting skills (Bash, Python, etc.) for automation tasks.Strong problem-solving and analytical skills.Excellent communication and collaboration skills to work effectively with cross-functional teams.Ability to work independently and manage multiple priorities effectively.Passion for learning and staying current with new technologies.

Preferred Qualifications:

Experience working in a fast-paced, dynamic environment.Certifications in cloud platform technologies (e.g., Azure Solutions Architect Expert, AWS Certified Solutions Architect - Associate).

Experience with Git version control system.

Apply

Listen to the story of Employee Voice

Annette Barnabas

Business Analysis Associate Director

India

Read more

Vanathi Asok

Director – Project and Application Services

India

Read more

Swathi Sujir

Business Operations Supervisor

India

Read more

Apply Back to search results

  • Cloud LLM Ops Engineer

    2 months ago

    Bengaluru, India NTT DATA Services Full time

    Cloud LLM Ops EngineerJob Summary:We are seeking a passionate and experienced Cloud LLMops Engineer to join our growing team. You will play a critical role in building, automating, and maintaining our infrastructure on a leading cloud platform (Microsoft Azure, AWS, or GCP). In addition to core DevOps principles, you'll be an expert in containerization and...

  • Cloud LLM Infrastructure Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Cloud LLM Ops EngineerJob Summary:We are seeking a passionate and experienced Cloud LLM Ops Engineer to join our growing team. You will play a critical role in building, automating, and maintaining our infrastructure on a leading cloud platform (Microsoft Azure, AWS, or GCP).Responsibilities:Utilize Infrastructure as Code (IaC) tools like Terraform to...

  • Cloud LLM Infrastructure Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Cloud LLM Ops Engineer Role Summary:We are seeking a highly skilled Cloud LLM Ops Engineer to join our team at NTT DATA Services. As a key member of our team, you will play a critical role in designing, implementing, and maintaining our cloud-based infrastructure for Large Language Models (LLMs) and GenAI solutions.Key Responsibilities:Design and implement...

  • Cloud LLM Infrastructure Specialist

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    We are seeking a Cloud LLM Ops Engineer to build, automate, and maintain our infrastructure on a leading cloud platform. This role involves core DevOps principles, containerization, and orchestration using Kubernetes and AKS, enabling seamless deployments of our Large Language Models and GenAI solutions.Key Responsibilities:Implement and maintain Continuous...

  • Manager - ML Ops Engineer

    1 month ago

    Bengaluru, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose - the relentless pursuit of a world that works better for people - we...

  • Cloud LLM Pipeline Architect

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionCloud LLM Pipeline ArchitectAbout the RoleWe are seeking a skilled Cloud LLM Pipeline Architect to design, implement, and maintain our Large Language Model (LLM) infrastructure on a leading cloud platform. As a key member of our team, you will play a critical role in building, automating, and optimizing our LLM pipeline, ensuring seamless...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Title: Cloud LLM Ops EngineerAbout the Role:We're seeking a skilled Cloud LLM Ops Engineer to join our team at NTT DATA Services. As a Cloud LLM Ops Engineer, you will play a critical role in building, automating, and maintaining our infrastructure on a leading cloud platform. You will be responsible for implementing and maintaining Continuous...

  • Cloud LLM Operations Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Summary:We are seeking a highly skilled Cloud LLM Operations Engineer to join our team at NTT DATA Services. As a key member of our team, you will play a critical role in building, automating, and maintaining our infrastructure on a leading cloud platform (Microsoft Azure, AWS, or GCP). In addition to core DevOps principles, you'll be an expert in...

  • Cloud LLM Infrastructure Specialist

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Cloud LLM Infrastructure SpecialistWe are seeking a highly skilled Cloud LLM Infrastructure Specialist to join our team at NTT DATA Services. As a key member of our team, you will play a critical role in designing, building, and maintaining our cloud-based infrastructure for Large Language Models (LLMs) and GenAI solutions.Key Responsibilities:Design and...

  • LLM Engineer

    2 months ago

    Bengaluru, India Mazenet solution Full time

    LLM EngineerWe are seeking a highly skilled LLM Engineer with a minimum of 5 years of experience in software development and 1-2 years in LLM solution development. The ideal candidate will have strong experience working with Python, LLM solution patterns and tools (RAG, Vector DB, Agentic workflows, LoRA, etc.) cloud platforms (AWS, Azure, GCP), and DevOps...

  • Cloud LLM Infrastructure Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Cloud LLM Infrastructure SpecialistWe are seeking a highly skilled Cloud LLM Infrastructure Specialist to join our team at NTT DATA Services. As a key member of our team, you will play a critical role in designing, building, and maintaining our cloud-based infrastructure for Large Language Models (LLMs) and GenAI solutions.Key Responsibilities:Design and...

  • LLM Engineer

    1 week ago

    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.Translate business to technical requirementsOwn technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocationData driven decision making skills with focus on achieving product goalsDesign, develop and deploy LLM based...

  • Manager/Lead - LLM

    3 weeks ago

    Bengaluru, India Resourcetree Full time

    Role : Manager / Lead - LLM OpsExperience : 5 - 10 years Location : BangaloreRole and Responsibilities :- Define and disseminate LLMOps best practices for Aris Global products.- Evaluate and compare different LLMOps tools to incorporate the best practices.- Collaborate with architects, engineers, data-scientists, and SMEs to design, implement and oversee the...

  • LLM Engineer

    5 days ago

    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.- Translate business to technical requirements- Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation- Data driven decision making skills with focus on achieving product goals- Design, develop and deploy LLM...

  • Cloud Ops Admin Gcp

    5 months ago

    Bengaluru, India Applied Cloud Computing Full time

    Proven 5+ years experience leading and managing Cloud Infrastructure - VPC, Compute, Storage, Container Services, Kubernetes and other relevant services. - Strong Linux /CentOS/ Ubuntu/GKE system administration skills (patching, configuration, etc.) - Automation (Chef, Puppet) - Experience of full software development lifecycle experience using Agile /...

  • Gen AI ML Ops Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Encora Inc. Full time

    Job Title: Gen AI ML Ops EngineerAbout the Role:We are seeking a highly skilled Gen AI ML Ops Engineer to join our team at Encora. As a key member of our AI engineering team, you will be responsible for deploying and maintaining machine learning models in production environments.Key Responsibilities:Deploy and maintain machine learning models in production...

  • LLM Engineer

    3 weeks ago

    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.Translate business to technical requirementsOwn technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocationData driven decision making skills with focus on achieving product goalsDesign, develop and deploy LLM based...

  • LLM Engineer

    3 weeks ago

    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.Translate business to technical requirementsOwn technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocationData driven decision making skills with focus on achieving product goalsDesign, develop and deploy LLM based...

  • LLM Engineer

    3 weeks ago

    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems. Translate business to technical requirements Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation Data driven decision making skills with focus on achieving product goals Design, develop and deploy LLM based...

  • LLM Developer

    3 months ago

    Bengaluru, India Edge In Asia Recruitment Private Limited Full time

    Bangalore: RemoteHyderabad: Hybrid (2 days in the office)Role Overview:Join our innovative IT services firm, where you'll contribute to cutting-edge AI and machine learning projects. We're looking for experienced LLM Developers to develop, fine-tune, and integrate large language models (LLMs) within our cloud-based AI platforms.Some of the key...