AI Runtime Engineer

7 days ago


Bengaluru Karnataka India, Karnataka Capgemini Engineering Full time

AI Runtime Engineer

Location: Bangalore (or as per requirement)

Experience: 7+ years


Choosing Capgemini means joining a team where you’ll be empowered to build cutting-edge AI infrastructure, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in enabling scalable, fault-tolerant AI systems that power next-generation machine learning workloads.


Your Role

As an AI Runtime Engineer, you will design and optimize distributed AI runtimes that enable high-performance, multi-node, multi-GPU training at scale. You’ll work closely with AI infrastructure teams to build elastic, fault-tolerant systems and ensure seamless orchestration for advanced AI workloads.


In this role, you will:

  • Architect and implement distributed AI runtime systems with elastic scaling and job recovery.
  • Optimize performance at low levels (CUDA, NCCL, PyTorch internals) for multi-GPU workloads.
  • Develop custom runtime architectures for large-scale AI training pipelines.
  • Integrate orchestration tools like Kubernetes, Ray, TorchElastic, Horovod for containerized AI workloads.
  • Implement fault recovery mechanisms and observability hooks for runtime health monitoring.
  • Collaborate with AI researchers and platform engineers to ensure efficient resource utilization and throughput optimization.
  • Contribute to CI/CD pipelines for AI infrastructure and runtime deployments.


Your Profile


Mandatory Skills:

  • Hands-on experience in distributed training systems, multi-node/multi-GPU orchestration.
  • Expertise in PyTorch internals, CUDA, NCCL, and performance profiling.
  • Strong knowledge of Kubernetes, containerization, and orchestration frameworks.

Preferred Skills:

  • Experience with TorchElastic, Ray, Horovod.
  • Open-source contributions to PyTorch or runtime libraries.
  • Background in HPC, compilers, or systems research.


Education:

  • Bachelor’s/Master’s in Computer Science, Engineering, or related field.


  • AI Runtime Engineer

    1 week ago


    Bengaluru, Karnataka, India Capgemini Engineering Full time US$ 10,00,000 - US$ 20,00,000 per year

    AI Runtime EngineerLocation:Bangalore (or as per requirement)Experience:7+ yearsChoosing Capgemini means joining a team where you'll be empowered to build cutting-edge AI infrastructure, supported by a collaborative global community, and inspired to reimagine what's possible. Join us in enabling scalable, fault-tolerant AI systems that power next-generation...

  • Lead AI Engineer

    1 week ago


    Bengaluru, Karnataka, India Capgemini Full time US$ 9,00,000 - US$ 18,00,000 per year

    Long Description Location: Bangalore Experience: 7+ yearsChoosing Capgemini  joining a team where you'll be empowered to build cutting-edge AI infrastructure, supported by a collaborative global community, and inspired to reimagine what's possible. Join us in enabling scalable, fault-tolerant AI systems that power next-generation machine learning...

  • Founding AI Engineer

    2 weeks ago


    Bengaluru, Karnataka, India, Karnataka Refold AI Full time

    About this roleWe want AI engineers who ship to prod, not publish to arxiv.If you've built something with LLMs that actually works—not a demo, not a notebook, something real—you'll fit right in. We're looking for engineers who've wrestled with memory management, nailed context persistence, and know why most AI agents forget everything after two turns....

  • Reasoning AI Team

    5 hours ago


    Bengaluru, Karnataka, India Sarvam AI Full time

    Senior Security Engineer - Sarvam AIAbout JobThe Sarvam AI Reasoning team is building sophisticated reasoning capabilities for India's first sovereign AI platform. We are seeking a talented Security Engineer to join our organization. In this role, you'll be responsible for designing and implementing comprehensive security frameworks that protect our AI...


  • Bengaluru, Karnataka, India, Karnataka Biocliq AI Full time

    About the RoleWe are seeking a motivated Generative AI Engineer with 1–3 years of hands-on experience in building, fine-tuning, and deploying generative models. You will work on real-world applications of LLMs, vision-language models, and multimodal generative systems, contributing to product features, internal automation tools, and customer-facing...


  • Bengaluru, Karnataka, India, Karnataka Tradl AI Full time

    : ' Welcome to TRADL, India’s AI Trading Quant Intelligence layer. We are building the foundational technology to revolutionize retail and professional trading across the Indian financial markets (NSE/BSE). Our mission is to empower Indian traders and investors with hedge fund-grade AI systems that seamlessly integrate natural language processing, advanced...


  • Bengaluru, Karnataka, India Sustainability Economics Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Location:Bengaluru, KarnatakaAbout the Company:Sustainability is a global organization, pioneering the convergence of clean energy and AI, enabling profitable energy transitions while powering end-to-end AI infrastructure. By integrating AI-driven cloud solutions with sustainable energy, we create scalable, intelligent ecosystems that drive efficiency,...

  • AI Outcomes Manager

    1 week ago


    Bengaluru, Karnataka, India, Karnataka Adopt AI Full time

    Company Description Adopt AI powers modern applications with innovative AI solutions, enabling users to perform complex actions and automate workflows through natural language commands. By facilitating dynamic planning and execution, Adopt AI allows individuals to interact with applications effortlessly, simplifying tasks and unlocking new opportunities for...

  • AI engineer

    2 weeks ago


    Bengaluru, Karnataka, India Weekday AI Full time ₹ 8,00,000 - ₹ 15,00,000 per year

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 8-15 LPA)Min Experience: 6 yearsLocation: NOIDA, Bengaluru, NCR, Delhi, GurugramJobType: full-timeWe are seeking a highly skilled and motivated AI Engineer with deep expertise in Generative AI (Gen AI) and Large Language Models (LLMs) to join our innovative AI team. The ideal candidate...

  • AI Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Weekday AI Full time ₹ 6,00,000 - ₹ 8,00,000 per year

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 6-8 LPA)Min Experience: 0 yearsLocation: BangaloreJobType: full-timeWe are looking for a passionate and motivated AI Engineer to join our growing team. This role is ideal for individuals who are eager to build a career in artificial intelligence and machine learning. You will work...