Lead AI Compiler Engineer

4 weeks ago

Hyderabad, Telangana, India Advanced Micro Devices (AMD) Full time
Job Description

We are looking for an AI Compiler Engineer to join this high impact team working in the growing field of on-device AI inference acceleration as an individual contributor or as a technical lead in the AI group (AIG).

As an AI Compiler Engineer, you will design and optimize AI compiler stack and tools that enable efficient execution of state-of-the-art open source as well as proprietary AI models such as LLMs, transformer models, etc., to AMD NPUs for on-device AI inference use-cases.

You will work on transforming high-level AI models into efficient, low-level code that can run on NPU.

Your work will directly impact the performance, efficiency, and scalability of our AI solutions.

SCOPE OF WORK:

- Operator Fusion:Identify and implement performance optimization opportunities by reducing memory traffic through operator fusion at different memory hierarchy levels, e.g., attention block.
- Problem Partitioning and Dataflow Orchestration:Design of algorithms to optimally map given AI operation to the NPU comprising of an interconnected array of AI engines.
- Design and implementation of algorithms to orchestrate dataflow through multi-level memory hierarchy.
- Kernel Design and Development:Design and implement highly optimized C++/intrinsic based kernels for AI related operators.
- Develop vectorized code that leverages SIMD (Single Instruction, Multiple Data) and VLIW (Very Long Instruction Word) for optimal performance.
- Perform performance, program memory, and accuracy tradeoffs.
- Testing and Validation:Develop CPU models for the ML operators in C++/Python to validate accuracy.
- Write unit tests and integration tests to ensure correctness and reliability.
- Performance Profiling and Tuning:Profile and analyze the performance of model layers.
- Identify performance/accuracy bottlenecks and alleviate those.
- Documentation and Collaboration:Effective technical communication of day-to-day work and document design specs.
- Follow good coding practices, using version control system.
- Collaborate with cross-functional teams spanning over AI research, core architecture, and software engineering.

REQUIRED SKILLS:

- Excellent C/C++ and Python coding skills.
- Good understanding of SIMD, VLIW processor architecture.
- Experience with vectorized programming (SIMD).
- Thorough understanding of fixed and floating point arithmetic.
- Good understanding of various operators in state-of-the-art AI models.
- Knowledge of low-level hardware details (cache hierarchy, DMA programming).
- Excellent problem-solving skills, especially on debug, and a passion for on-device AI.
- Prefer candidates with past experience on AI compiler design.

  • Compiler Engineer

    6 days ago

    Hyderabad, Telangana, India Celestial AI Full time ₹ 1,20,000 - ₹ 1,80,000 per year

    About Celestial AIAs Generative AI continues to advance, the performance drivers for data center infrastructure are shifting from systems-on-chip (SOCs) to systems of chips. In the era of Accelerated Computing, data center bottlenecks are no longer limited to compute performance, but rather the system's interconnect bandwidth, memory bandwidth, and memory...

  • Compiler/Language Engineer

    3 weeks ago

    Hyderabad, Telangana, India One Click AI Full time

    Job Title : Compiler/Language Engineer (Golang Focus)About the Role : We are looking for an experienced Golang Developer with strong expertise in compiler development and query optimization. You will be responsible for designing, implementing, and optimizing Graph Query Language (GQL) features, focusing on compiler enhancements, execution planning, and...

  • AI and ML Engineer

    6 days ago

    Hyderabad, Telangana, India Lead Masters AI Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Internship Opportunity – LeadMasters AI (Dubai-Registered AI Company)About LeadMasters AILeadMasters AI is a Dubai-registered Company operating out of Hyderabad. We build solutions in AI-driven marketing automation, social media management, CRM workflows, and intelligent lead generation. Our mission is to help businesses scale with agentic AI-powered...

  • Lead AI Engineer

    1 week ago

    Hyderabad, Telangana, India Weekday AI Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    This role is for Weekday's client.Role OverviewAs the Lead AI Engineer, you will be responsible for spearheading the design, development, and deployment of AI solutions. You will work with various large language models (LLMs)—both open-source and proprietary—optimizing them through fine-tuning, prompt engineering, agentic frameworks, and...

  • GPU Compiler

    21 hours ago

    Hyderabad, Telangana, India Qualcomm Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    General Summary:Our power efficient GPU solution is fundamental to enable new exciting markets like VR, IoT, AI, drone, autonomous driving etc. GPU compiler is a key component of graphics solution. We are looking for talented, self-motivated engineers to create world class GPU compiler products to enable high performance graphics and compute with low power...

  • Software Engineer Fresher

    1 week ago

    Hyderabad, Telangana, India Lead Masters AI Full time ₹ 2,00,000 - ₹ 12,00,000 per year

    Internship Opportunity – LeadMasters AI (Dubai-Registered AI Company)About LeadMasters AILeadMasters AI is a Dubai-registered Company operating out of Hyderabad. We build solutions in AI-driven marketing automation, social media management, CRM workflows, and intelligent lead generation. Our mission is to help businesses scale with agentic AI-powered...

  • Graphics Compiler Automation Engineer

    3 weeks ago

    Hyderabad, Telangana, India Qualcomm Full time

    Company Qualcomm India Private Limited Job Area Engineering Group Engineering Group Software Engineering General Summary Job overview Our power efficient GPU solution is fundamental to enable exciting new markets like VR IoT AI drone autonomous driving etc GPU compiler is a key component of graphics solution We are looking for talented ...

  • AI Engineer

    20 hours ago

    Hyderabad, Telangana, India Deccan AI Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Location:Hyderabad (On-site/Hybrid)Company:Deccan AIEmployment Type:Full-TimeExperience:1–3 YearsAbout Deccan AIDeccan AI is at the forefront of building advanced AI solutions for real-world applications. We're passionate about pushing the boundaries of artificial intelligence, natural language processing, and intelligent agent systems. Join us and work...

  • Graphics Compiler Automation engineer

    4 days ago

    Hyderabad, Telangana, India Qualcomm Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Company:Qualcomm India Private LimitedJob Area:Engineering Group, Engineering Group > Software EngineeringGeneral Summary: Job Description Job overview:Our power efficient GPU solution is fundamental to enable exciting new markets like VR, IoT, AI, drone, autonomous driving etc. GPU compiler is a key component of graphics solution. We are looking for...

  • Graphics Compiler Automation engineer

    17 hours ago

    Hyderabad, Telangana, India Qualcomm Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Company:Qualcomm India Private LimitedJob Area:Engineering Group, Engineering Group > Software EngineeringGeneral Summary:Job DescriptionJob overview:Our power efficient GPU solution is fundamental to enable exciting new markets like VR, IoT, AI, drone, autonomous driving etc. GPU compiler is a key component of graphics solution. We are looking for talented,...