AI Infrastructure Engineer GPU

5 days ago


Greater Visakhapatnam Area, India LEO DOES IT INC Full time ₹ 15,00,000 - ₹ 25,00,000 per year

AI Infrastructure Engineer (GPU & Server Specialist) – Onsite

We're looking for an
AI Infrastructure Engineer
to help us build a world-class
GPU server environment
for training large language models (GPT-style AI). This role is
onsite
and hands-on — setting up the latest GPUs, servers, and high-performance clusters.

What You'll Do

  • Deploy and configure
    GPU servers
    (NVIDIA H100/A100 or AMD MI300).
  • Set up
    server clusters
    with high-speed networking (InfiniBand, NVLink).
  • Manage
    storage systems
    (NVMe, Lustre, BeeGFS) for AI training data.
  • Optimize environments for
    PyTorch, TensorFlow, and Hugging Face models
    .
  • Monitor and maintain
    system health and performance
    .

What We're Looking For

  • 5+ years of experience in
    HPC, GPU servers, or AI infrastructure
    .
  • Strong knowledge of
    Linux, CUDA, drivers, and GPU optimization
    .
  • Experience with
    cluster management
    (Kubernetes/Docker).
  • Familiarity with
    distributed AI training frameworks
    (DeepSpeed, Horovod, Megatron-LM).

Nice to Have

  • Experience training or supporting
    large language models (LLMs)
    .
  • Background in
    liquid cooling / advanced data center systems
    .
  • Knowledge of
    MLOps practices
    for scaling AI workloads.

Tech Stack

  • GPUs:
    NVIDIA H100/A100, AMD Instinct MI300
  • Servers:
    NVIDIA DGX, Supermicro, Dell, Lambda Labs
  • Networking:
    InfiniBand, NVSwitch, RoCE
  • Software:
    PyTorch, TensorFlow, Hugging Face, DeepSpeed


  • Greater Hyderabad Area, India Stealth AI Startup Full time

    Job Title: Associate Vice President – Presales (AI Consulting & Infrastructure) 📍 Location: Hyderabad (Work from Office) About Us We are a well-funded stealth-mode AI startup building the future of AI Infrastructure and delivering high-impact AI Consulting projects to global enterprises. Our core offerings include: - Cloud GPU Infrastructure (leveraging...

  • GPU Modelling Expert

    2 weeks ago


    Greater Bengaluru Area, India Global Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Experience: 15+ years (Senior / SME level)Proficiency in C/C++ programming languagesExperience in GPU modeling and simulationExpertise in Computer ArchitectureKnowledge of Graphics/Compute APIs like OpenGL and/or DirectX, OpenCL and/or CUDA, VulkanStrong debugging and problem-solving skillsUnderstanding of GPU architecture and graphics pipelineKnowledge of...


  • Greater Hyderabad Area, India Mulya Technologies Full time

    Principal IP/RTL Design Engineer for TPU / GPU Hyderabad / Bangalore Founded by highly respected Silicon Valley veterans - with its design centers established in Santa Clara, California. / Hyderabad/ Bangalore Our pay comprehensively beats "ALL" Semiconductor product players in the Indian market. Position Overview Seeking an IP/RTL Design Engineer with 5+...


  • Greater Hyderabad Area, India Mulya Technologies Full time

    Principal IP/RTL Design Engineer for TPU / GPU Hyderabad / Bangalore Founded by highly respected Silicon Valley veterans - with its design centers established in Santa Clara, California. / Hyderabad/ Bangalore Our pay comprehensively beats "ALL" Semiconductor product players in the Indian market. Position Overview Seeking an IP/RTL Design Engineer with...


  • Greater Hyderabad Area, India Mulya Technologies Full time

    IP/RTL Design Architect for GPU Hyderabad Founded by highly respected Silicon Valley veterans - with its design centers established in Santa Clara, California. / Hyderabad/ Bangalore Our pay comprehensively beats "ALL" Semiconductor product players in the Indian market. Position Overview Seeking an IP/RTL Design Engineer with 8+ years of experience to design...


  • Greater Hyderabad Area, India Stealth AI Startup Full time

    Job Title: Associate Vice President – Presales (AI Consulting & Infrastructure) Location: Hyderabad (Work from Office) About Us We are a well-funded stealth-mode AI startup building the future of AI Infrastructure and delivering high-impact AI Consulting projects to global enterprises. Our core offerings include: Cloud GPU Infrastructure ...


  • Greater Hyderabad Area, India Stealth AI Startup Full time

    Job Title:Associate Vice President – Presales (AI Consulting & Infrastructure)📍 Location: Hyderabad (Work from Office)About UsWe are a well-funded stealth-mode AI startup building the future of AI Infrastructure and delivering high-impact AI Consulting projects to global enterprises.Our core offerings include:Cloud GPU Infrastructure (leveraging NVIDIA...


  • Greater Hyderabad Area, IN Stealth AI Startup Full time

    Job Title:Associate Vice President – Presales (AI Consulting & Infrastructure) Location: Hyderabad (Work from Office)About UsWe are a well-funded stealth-mode AI startup building the future of AI Infrastructure and delivering high-impact AI Consulting projects to global enterprises.Our core offerings include:Cloud GPU Infrastructure (leveraging NVIDIA...


  • Greater Hyderabad Area, India Mulya Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    IP/RTL Design Architect for GPUHyderabadFounded by highly respected Silicon Valley veterans - with its design centers established in Santa Clara, California. / Hyderabad/ BangaloreOur pay comprehensively beats "ALL" Semiconductor product players in the Indian market.Position OverviewSeeking an IP/RTL Design Engineer with 8+ years of experience to design...


  • Greater Hyderabad Area, India Mulya Technologies Full time

    Principal IP/RTL Design Engineer for TPU / GPU Hyderabad / BangaloreFounded by highly respected Silicon Valley veterans - with its design centers established in Santa Clara, California. / Hyderabad/ BangaloreOur pay comprehensively beats "ALL" Semiconductor product players in the Indian market. Position OverviewSeeking an IP/RTL Design Engineer with 5+ years...