Lead ML Engineer

2 weeks ago

Hyderabad, Telangana, India Fission Labs Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Role: AI/ML Lead

Experience: 7-11 years

Designation: Associate Architect

Location: Hyderabad & Pune

______________________________________________

GEN AI & FINE TUNING OF LLMs IS MUST

______________________________________________

Key Responsibilities:

Architecture & Infrastructure

  • Design, implement, and optimize end-to-end ML training workflows including infrastructure setup, orchestration, fine-tuning, deployment, and monitoring.
  • Evaluate and integrate multi-cloud and single-cloud training options across AWS and other major platforms.
  • Lead cluster configuration, orchestration design, environment customization, and scaling strategies.
  • Compare and recommend hardware options (GPUs, TPUs, accelerators) based on performance, cost, and availability.

Technical Expertise Requirements

  • At least 4-5 years in AI/ML infrastructure and large-scale training environments.
  • Expert in AWS cloud services (EC2, S3, EKS, SageMaker, Batch, FSx, etc.) and familiar with Azure, GCP, and hybrid/multi-cloud setups.
  • Strong knowledge of AI/ML training frameworks (PyTorch, TensorFlow, Hugging Face, DeepSpeed, Megatron, Ray, etc.).
  • Proven experience with cluster orchestration tools (Kubernetes, Slurm, Ray, SageMaker, Kubeflow).
  • Deep understanding of hardware architectures for AI workloads (NVIDIA, AMD, Intel Habana, TPU).

LLM Inference Optimization

  • Expert knowledge of inference optimization techniques including speculative decoding, KV cache optimization (MQA/GQA/PagedAttention), and dynamic batching.
  • Deep understanding of prefill vs decode phases, memory-bound vs compute-bound operations.
  • Experience with quantization methods (INT4/INT8, GPTQ, AWQ) and model parallelism strategies.

Inference Frameworks

  • Hands-on experience with production inference engines: vLLM, TensorRT-LLM, DeepSpeed-Inference, or TGI.
  • Proficiency with serving frameworks: Triton Inference Server, KServe, or Ray Serve.
  • Familiarity with kernel optimization libraries (FlashAttention, xFormers).

Performance Engineering

  • Proven ability to optimize inference metrics: TTFT (first token latency), ITL (inter-token latency), and throughput.
  • Experience profiling and resolving GPU memory bottlenecks and OOM issues.
  • Knowledge of hardware-specific optimizations for modern GPU architectures (A100/H100).

Fine tuning

  • Drive end-to-end fine-tuning of LLMs, including model selection, dataset preparation/cleaning, tokenization, and evaluation with baseline metrics.
  • Configure and execute fine-tuning experiments (LoRA, QLoRA, etc.) on large-scale compute setups, ensuring optimal hyperparameter tuning, logging, and checkpointing.
  • Document fine-tuning outcomes by capturing performance metrics (losses, BERT/ROUGE scores, training time, resource utilization) and benchmark against baseline models.

If you've done only POCs and not production ready ML models which scale, Please skip to apply

  • AI/ML Lead Engineer

    2 weeks ago

    Hyderabad, Telangana, India Innocito Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Hello,We are hiring for AI/ML Lead to work with our Product based client in Hyderabad.Location : HyderabadWork from officeFulltimeBachelor's or master's degree in computer science or equivalent degree or demonstrable experience.Proven experience as a Lead Software Engineer in AI/ML and Data Science.Minimum of 8+ years of working experience.Leadership...

  • ML Engineer

    2 weeks ago

    Hyderabad, Telangana, India Neev Systems Full time

    Home » ML EngineerML Engineerby HR Neev SystemsOctober 21, 2025October 21, 2025Experience: 5+ YearsLocation : HyderabadAbout The RoleWe are seeking a highly skilled and experiencedMachine Learning Engineerto lead the design and implementation of cutting-edge ML solutions across our organization. You will be responsible for prototyping and taking models all...

  • Lead Engineer – SQA in AI/ML

    5 days ago

    Hyderabad, Telangana, India Silicon Labs Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Silicon Labs (NASDAQ: SLAB) is the leading innovator in low-power wireless connectivity, building embedded technology that connects devices and improves lives. Merging cutting-edge technology into the world's most highly integrated SoCs, Silicon Labs provides device makers the solutions, support, and ecosystems needed to create advanced edge connectivity...

  • AI/ML Technical Lead

    2 weeks ago

    Hyderabad, Telangana, India Yash Technologies Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Associate Lead Data Scientist - AI/ML Job YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation. At YASH, we're a cluster of the brightest stars working with cutting-edge...

  • AI ML Lead

    1 day ago

    Hyderabad, Telangana, India Mondee Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Position:- AIML LeadExperience Required- 7-10 yearsJob Type- Full-timeLocation - Hyderabad, IndiaNotice:- 0-30daysOverviewWe are seeking adynamic AI/ML Leaderto drive innovation and implementation across AI, Generative AI, and Multimodal AI initiatives. The ideal candidate will lead the end-to-end development of intelligent solutions that enhance...

  • Ml Engineer

    1 week ago

    Hyderabad, Telangana, India Solix Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Solix Technologies Inc. is a leading provider of big data applications for enterprise archiving, data privacy, and advanced analytics. We are on a mission to help organizations manage and leverage their data for maximum value, efficiency, and compliance.Job Summary:We are seeking a highly skilled and motivated Machine Learning Engineer with hands-on...

  • Lead - AI/ ML/ GenAI

    1 day ago

    Hyderabad, Telangana, India ProClink Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    Title: Technical Lead (AI/ML/GenAI)Job Description:We are seeking a highly skilled and innovative Technical Lead ( AI/ML/GenAI) with strong hands-on experience in Agentic AI, Machine Learning, and Cloud Platforms like AWS and Databricks. The ideal candidate will be proficient in building intelligent systems using agentic frameworks to deliver scalable,...

  • ML Engineer

    2 weeks ago

    Hyderabad, Telangana, India Amgen Technology Private Limited Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    CDNA_ML Engineer – Data Science Enablement Career CategoryEngineering Job Description HOW MIGHT YOU DEFY IMAGINATION? If you feel like you're part of something bigger, it's because you are. At Amgen, our shared mission—to serve patients—drives all that we do. It is key to our becoming one of the world's leading biotechnology companies. We...

  • AI/ML Lead

    2 weeks ago

    Hyderabad, Telangana, India ValueMomentum Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    Job Title:AI/ML LeadJob ID:POS-16044Primary Skill:AWS ServicesLocation:HyderabadExperience:9.00Secondary Skills:GenAI, Langchain,LLMs, and RAGJob Location:HyderabadMode of Work:Work From OfficeExperience:7-12 YearsAbout The JobWe are seeking an AI Architect to join their team in Erie, PA. We are looking for a senior data scientist/agentic AI architect with...

  • AI/ML Engineer

    2 weeks ago

    Hyderabad, Telangana, India Goldman Sachs Services Pvt Ltd Full time ₹ 80,00,000 - ₹ 2,00,00,000 per year

    Compliance-Bengaluru-Associate-AI/ML Engineer YOUR IMPACT Are you passionate about leveraging cutting-edge AI/ML techniques, including Large Language Models, to solve complex, mission-critical problems in a dynamic environment? Do you want to contribute to safeguarding a leading global financial institution? OUR IMPACT We are Compliance Engineering,...