Senior ML Engineer – LLM Pre-Training, Distributed Training
2 weeks ago
IndiaAI is building India’s next-gen foundational LLMs. We’re looking for a hands-on Senior ML Engineer experienced in large-scale pre-training, distributed GPU systems, and data creation pipelines. You will work with Megatron-LM, NVIDIA NeMo, DeepSpeed, PyTorch Distributed, and SLURM to train 7B–70B+ models on multi-node GPU clusters.
What You’ll Do
- Build & optimize LLM pre-training pipelines (7B–70B+).
- Implement distributed training using PyTorch Distributed, DeepSpeed (ZeRO/FSDP), Megatron-LM, NVIDIA NeMo.
- Manage multi-node GPU jobs via SLURM and optimize NCCL communication.
- Lead large-scale data creation, cleaning, deduplication, tokenization & sharding for multilingual datasets (with focus on Indian languages).
- Build high-throughput dataloaders, monitoring dashboards & training workflows.
- Collaborate with infra teams to optimize GPU utilization, networking, and storage systems.
What You Bring
- 5+ years in ML Engineering / DL Systems.
- Prior experience training large transformer models (ideal: 7B+).
- Strong in NeMo, Megatron-LM, DeepSpeed, PyTorch Distributed.
- Experience with SLURM & multi-node GPU clusters (A100/H100).
- Understanding of transformer internals (attention, RoPE, FlashAttention, parallelism).
- Experience in data pipelines — cleaning, dataset assembly, tokenization.
Bonus Skills
- Indic-language data experience
- MoE training
- Kernel-level optimization (Triton/CUDA)
- Open-source contributions (Megatron, NeMo, DeepSpeed, PyTorch)
-
Senior ML Engineer – LLMs
4 days ago
Bengaluru, Karnataka, India, Karnataka Hodos360.ai Full timeJob Title: Senior ML Engineer – LLMsCompany: Hodos 360Location: Bangalore (Work From Office – WFO)Shift: 5:00 PM to 2:00 AM ISTExperience: 3–8 yearsAbout Hodos 360Hodos 360 builds AI-driven products and solutions for global businesses, with a strong focus on Large Language Models (LLMs) and automation. We work closely with clients to understand their...
-
Senior ML Engineer
1 week ago
Bengaluru, Karnataka, India, Karnataka gnani.ai Full timeIndiaAI is building aligned, safe, and multilingual LLMs for 1.4B people. We’re hiring a Senior ML Engineer/Applied Scientist to lead post-training, covering SFT, DPO, GRPO, RFT, RLHF, multi-turn chat tuning, reward modeling, and evaluation — with a strong focus on Indic and low-resource languages.What You’ll DoBuild and scale SFT pipelines (single &...
-
LLM Systems
1 week ago
Bengaluru, Karnataka, India Weekday Full time ₹ 8,00,000 - ₹ 20,00,000This role is for one of our clientsIndustry: Human Resources ServicesSeniority level: Mid-Senior levelMin Experience: 6 yearsLocation: Bengaluru, Karnataka, NCR, DelhiJobType: full-time ₹8,00,000 - ₹20,00,000 a year We are seeking a highly skilled LLM Systems & MLOps Architect to drive end-to-end architecture, optimization, and deployment of large-scale...
-
Senior ML Engineer
2 weeks ago
Bengaluru, Karnataka, India gnani Full time US$ 1,00,000 - US$ 2,00,000 per yearIndiaAI is building aligned, safe, and multilingual LLMs for 1.4B people. We're hiring a Senior ML Engineer/Applied Scientist to leadpost-training, coveringSFT, DPO, GRPO, RFT, RLHF, multi-turn chat tuning, reward modeling, and evaluation— with a strong focus onIndic and low-resource languages.What You'll DoBuild and scale SFT pipelines (single &...
-
-Senior ML Engineer
2 weeks ago
Bengaluru, Karnataka, India Nexthire Full time ₹ 12,00,000 - ₹ 24,00,000 per yearSenior Machine Learning EngineerLocation: Onsite - BengaluruCompany: : Y Combinator backed Insurtech StartupAbout is transforming the underwriting landscape with Generative AI. Our SaaS solutions help insurance companies in the US make smarter, faster decisions by optimizing underwriting processes, reducing risk, and improving premiums. As we expand, we're...
-
AI/ML Engineer
5 days ago
Bengaluru, Karnataka, India NexaPent Full time ₹ 6,00,000 - ₹ 18,00,000 per yearRole Summary (Urgent Opening)One of our clients who are into Product base development (MNC Company) are looking for an experienced AI/ML Engineer with 7–8 years of practical expertise to join our growing technology team. This role demands strong hands-on skills in machine learning engineering, Python programming, and exposure to cutting-edge AI...
-
Senior AI/ML Engineer
2 weeks ago
Bengaluru, Karnataka, India Softway Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWe're seeking a Senior AI/ML Engineer who will design, fine-tune, and deploy machine learning models, including LLMs, within our serverless AWS infrastructure. Collaborating with backend engineers and product teams, you'll integrate AI solutions focused on scalability, performance, and seamless deployment.We're looking for expertise in Python, AI/ML...
-
Senior Machine Learning Engineer
2 weeks ago
Bengaluru, Karnataka, India, Karnataka TruMetric.AI Full timeSenior Machine Learning EngineerAbout the Role:We are looking for a Senior Machine Learning Engineer who can take complex machine learning models and make them work in real-world production environments. This role is ideal for someone who not only has deep expertise in machine learning but also understands the challenges of deployment, scalability, and...
-
AI/ML Engineer
1 week ago
Bengaluru, Karnataka, India, Karnataka HDFC Bank Full timeJob Purpose:An experienced AI/ML Engineer to design, develop and maintain AI / ML and GenAI based solutions on enterprise platform on Industry best and open-source models at scale along with governance and security frameworksDesired Skills :Strong background in designing and implementing machine learning and deep learning algorithms and responsible AI...
-
Machine Learning Infrastructure Engineer
1 week ago
Bengaluru, Karnataka, India, Karnataka slice Full timeAbout ussliceA new bank for a new Indiaslice’s purpose is to make the world better at using money and time, with a major focus on building the best consumer experience for your money. We’ve all felt how slow, confusing, and complicated banking can be. So, we’re reimagining it. We’re building every product from scratch to be fast, transparent, and...