Senior Distributed Training Research Engineer

4 weeks ago

Bengaluru, Karnataka, India Krutrim Full time
Senior Distributed Training Research Engineer (Frontier LLMs)
Location:

Bangalore (India)
Type of Job:

Full-time

About Krutrim:
Krutrim is building AI computing for the future. Our envisioned AI computing stack encompasses the AI computing infrastructure, AI Cloud, multilingual and multimodal foundational models, and AI-powered end applications. We are India's first AI unicorn and built the first foundation model from the country.
Our AI stack is empowering consumers, startups, enterprises and scientists across India and the world to build their end AI applications or AI models. While we are building foundational models across text, voice, and vision relevant to our focus markets, we are also developing AI training and inference platforms that enable AI research and development across industry domains. The platforms being built by Krutrim have the potential to impact millions of lives in India, across income and education strata, and across languages.
The team at Krutrim represents a convergence of talent across AI research, Applied AI, Cloud Engineering, and semiconductor design. Our teams operate from three locations: Bangalore, Singapore & San Francisco.

Job Description:
We are seeking an experienced Senior Generative AI Model Research Engineer to efficiently train frontier and foundation multimodal large language models. In this critical role, you will be responsible for scalable training methodologies to develop a variety of generative AI models such as large language models, voice/speech foundation models, vision and multi-modal foundation models using cutting-edge techniques and frameworks. In this hands-on role, you will optimize and implement state of art neural architecture, robust training and inference infrastructure to efficiently take complex models with hundreds of billions and trillions of parameters to production while optimizing for low latency, high throughput, and cost efficiency.

Key Responsibilities:
Architect Distributed Training Systems: Design and implement highly scalable distributed training pipelines for LLMs and frontier models, leveraging model parallelism (tensor, pipeline, expert) and data parallelism techniques.
Optimize Performance: Utilize deep knowledge of CUDA, C++, and low-level optimizations to enhance model training speed and efficiency across diverse hardware configurations.
Implement Novel Techniques: Research and apply cutting-edge parallelism techniques like Flash Attention to accelerate model training and reduce computational costs.
Framework Expertise: Demonstrate proficiency in deep learning frameworks such as PyTorch, TensorFlow, and JAX, and tailor them for distributed training scenarios.
Scale to Hundreds of Billions of Parameters: Work with massive models, ensuring stable and efficient training across distributed resources.
Evaluate Scaling Laws: Design and conduct experiments to analyze the impact of model size, data, and computational resources on model performance.
Collaborate: Partner closely with research scientists and engineers to integrate research findings into production-ready training systems.

Qualifications:
Advanced Degree: Ph.D. or Master's degree in Computer Science, Machine Learning, or a related field.
Proven Experience: 5+ years of experience in distributed training of large-scale deep learning models, preferably LLMs or similar models.
Deep Learning Expertise: Strong theoretical and practical understanding of deep learning algorithms, architectures, and optimization techniques.
Parallelism Mastery: Extensive experience with various model and data parallelism techniques, including tensor parallelism, pipeline parallelism, and expert parallelism.
Framework Proficiency: Expert-level knowledge of PyTorch, TensorFlow, or JAX, with a demonstrated ability to extend and customize these frameworks.
Performance Optimization: Proven track record of optimizing deep learning models for speed and efficiency using CUDA, C++, and other performance-enhancing tools.
Research Acumen: Familiarity with current research trends in large model training and the ability to apply new techniques to real-world problems.
Join Krutrim to shape the future of AI and make a significant impact on 100s of millions of lives across India and the world. If you're passionate about pushing the boundaries of AI and want to work with a team at the forefront of innovation, we want to hear from you

  • Distributed Training Research Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Krutrim Full time

    About KrutrimKrutrim is a pioneer in building AI computing for the future. Our envisioned AI computing stack encompasses the AI computing infrastructure, AI Cloud, multilingual and multimodal foundational models, and AI-powered end applications. We are India's first AI unicorn and built the first foundation model from the country.Our AI stack is empowering...

  • AI Training System Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Krutrim Full time

    We are seeking an experienced Senior Generative AI Model Research Engineer to work on developing scalable training methodologies for large language models and frontier models. In this hands-on role, you will be responsible for designing and implementing highly scalable distributed training pipelines for LLMs and frontier models, leveraging model parallelism...

  • Senior Distributed Systems Engineer

    5 days ago

    Bengaluru, Karnataka, India LinkedIn Full time

    About the Role">We are seeking a highly experienced Senior Distributed Systems Engineer to join our team as Principal Staff Software Engineer, Systems Infrastructure.

  • Senior Mechanical Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Abha Engineer Full time

    We are looking for a Senior Mechanical Engineer Roles are described below. 1. Manpower Planning. 2. Preparing of Project Cost. 3. Schedule wise work execution. 4. As Drawing & quality work execution. 5. Client & Third Party Manage. 6. Working Team Manage & Review. 7. Reporting to Management. 8. ROB & FOB Fabrication & Erection Work Knowledge.

  • Lead Electrical Engineering Professional

    1 week ago

    Bengaluru, Karnataka, India Lam Research Full time

    As a Senior Electrical Systems Design Manager at Lam Research, you will lead a team of engineers in designing and developing electronic solutions for advanced applications.ResponsibilitiesLead a team of engineers in designing and developing complex electrical systems, sub-systems, and solutions.Develop functional specifications for electrical,...

  • Teacher Training Expert

    1 week ago

    Bengaluru, Karnataka, India Indus Training and Research Institute Full time

    The Indus Training and Research Institute is dedicated to excellence in teacher preparation and is seeking passionate educators to join our team.As a member of our faculty, you will be responsible for developing and delivering cutting-edge teacher education programs.We offer a collaborative environment that values innovation and thought leadership in...

  • Teacher Training Specialist

    5 days ago

    Bengaluru, Karnataka, India Indus Training And Research Institute Full time

    **Our Vision**We envision a future where education is transformed by innovative thinking and collaborative efforts. As a Teacher Educator at Indus Training and Research Institute, you will be part of a team that values innovation and thought leadership in education.Join us in shaping the future of teaching by developing and delivering high-quality teacher...

  • Senior Distributed Systems Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Oracle Full time

    Overview: We're looking for hands-on engineers with expertise and passion in solving difficult problems in distributed systems, virtualized infrastructure, and highly available services. If this is you, at Oracle, you can design and build innovative new systems from the ground up. These are exciting times in our space - we are growing fast, still at an early...

  • Lead Electrical Engineer for Innovation

    7 days ago

    Bengaluru, Karnataka, India Lam Research Full time

    About the JobWe are seeking a highly skilled Senior Electrical Systems Designer to join our team at Lam Research. As an electrical engineer with a focus on design and development, you will be responsible for designing and developing complex electrical systems, sub-systems, and solutions.The ideal candidate will have a bachelor's degree in electrical or...

  • Distributed Systems Engineer

    7 days ago

    Bengaluru, Karnataka, India HackerEarth Full time

    About Distributed Systems EngineeringDistributed systems are complex systems composed of multiple interconnected components that work together to achieve a common goal. As a Senior Software Engineer, you will be responsible for designing, developing, and deploying these systems.Key ResponsibilitiesDesign and develop scalable distributed systems that can...

  • Distributed Systems Engineer

    7 days ago

    Bengaluru, Karnataka, India Oracle Full time

    **About the Team**We are a global agile team responsible for developing and automating components of one of our distributed services. As a Senior Software Development Engineer IDC VN Edge, you will have the opportunity to contribute to innovative designs and develop scalable and secure distributed systems using JAVA and related technologies.Key...

  • Distributed System Engineer

    7 days ago

    Bengaluru, Karnataka, India BazaarVoice Full time

    **Job Title:** Distributed System Engineer**Job Summary:**We are seeking a top-notch Senior Staff Software Engineer to join our team. The ideal candidate is extremely curious, a strong communicator, and highly enthusiastic about designing and implementing distributed, fault-tolerant systems that empower not only the success of the team but the organization...

  • Distributed Systems Engineering Manager

    2 weeks ago

    Bengaluru, Karnataka, India LinkedIn Full time

    We're looking for a highly experienced Software Engineering Manager, Systems Infrastructure to join our team at LinkedIn. As a key member of our software engineering team, you'll be responsible for managing a team of engineers and owning significant parts of our products that require design, architecture, and coding.About the Role:This is a unique...

  • Senior Backend Software Engineer

    1 week ago

    Bengaluru, Karnataka, India HashiCorp Full time

    **Job Summary**We're looking for a highly skilled Senior Backend Software Engineer - Distributed Systems to join our team at HashiCorp. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable and secure distributed systems.**Key Responsibilities**Design, prototype, and implement features and tools...

  • Senior Researcher

    7 days ago

    Bengaluru, Karnataka, India Microsoft Full time

    Overview At Microsoft, we operate the largest collaboration services in the world with 100s of millions of consumer/enterprise mailboxes, documents, and conversations. We are an Applied Research team driving medium and long-term product innovations. We closely collaborate with multiple research teams and product groups across the globe who bring a...

  • Expert AI Computing Researcher

    2 weeks ago

    Bengaluru, Karnataka, India Krutrim Full time

    Key ResponsibilitiesDistributed Training Systems Architect: Design and implement highly scalable distributed training pipelines for LLMs and frontier models, leveraging model parallelism (tensor, pipeline, expert) and data parallelism techniques.Performance Optimization Expert: Utilize deep knowledge of CUDA, C++, and low-level optimizations to enhance model...

  • Senior Engineering Manager

    7 days ago

    Bengaluru, Karnataka, India Zscaler Full time

    About ZscalerZscaler is a leading cloud security company that protects thousands of enterprise customers worldwide. Our mission is to make the cloud a safe place to do business and provide a seamless user experience.Job Description:We are seeking a Senior Manager to lead our engineering team and drive innovation in cloud security. The ideal candidate will...

  • Distributed Systems Engineer

    6 days ago

    Bengaluru, Karnataka, India Target Full time

    At Target, we prioritize relationships, fuel, and develop talent by creating growth opportunities. We succeed as one Target team, driven by our purpose to care, grow, and win together.Job RequirementsWe're looking for a talented Senior Java Engineer with:4-year degree or equivalent experience.5+ years of software development experience.Strong proficiency in...

  • Senior Distributed Systems Expert

    7 days ago

    Bengaluru, Karnataka, India Oracle Full time

    Job DescriptionWe're seeking a seasoned expert in distributed systems and highly available services to join our team. As a Senior Distributed Systems Expert, you'll play a key role in driving design decisions and providing technical guidance to junior team members. You'll be responsible for designing and building innovative new systems, working closely with...

  • Senior Data Engineer

    7 days ago

    Bengaluru, Karnataka, India BestEx Research Full time

    About BestEx ResearchBestEx Research is a financial technology and research firm specializing in building sophisticated execution algorithms and transaction cost modeling tools servicing multiple asset classes. The firm provides its services to performance-demanding hedge funds, CTAs, asset managers, and banks through a traditional electronic broker and in a...