AI Inference Kernel Engineer

2 weeks ago


bangalore, India Phinity Full time

We look forward to when AI can discover the next quantum AI accelerator, or when AI can make RL much more compute-efficient. We want to enable AI to bootstrap its own intelligence, to discover new computational paradigms. Just as AlphaEvolve discovered a 23% speedup in Gemini's critical kernels and achieved 32.5% improvements in FlashAttention, we're building the infrastructure that will enable every AI model to optimize its own compute stack. Of course, to automate algorithm and hardware discovery, we need to break the data barrier. CUDA is a low-resource language, and kernel optimization depends a lot on context and hardware that models simply are not trained on. Phinity is building the canonical training data infrastructure that will enable agentic hardware engineering and optimization, which will fuel algorithmic discovery. We are building environments for agents to learn to write kernel from a spec and optimize them on specific hardware, and eventually, to discover new hardware breakthroughs. Our customers include one of the largest frontier model labs. We're seeking top engineers for a contractor role who can optimize hardware for model training and inference workloads, who can bake their industry experience into a model. This is a hybrid Systems Engineer/AI research role where you will be looking through and debugging model reasoning traces and designing the optimal CUDA problems to teach unreleased models to automate your work in industry. Please do not apply unless you have optimized kernels before. Skill requirements: Languages: CUDA, C++, Python, Frameworks: JAX/XLA, PyTorch, TensorFlow (at the C++ level), Pallas Libraries: cuBLAS, cuDNN, CUTLASS, CUB, Thrust Compiler Tools: NVCC, PTX assembly, MLIR/XLA understanding Hardware Knowledge: SM architecture, tensor cores, memory hierarchies (HBM, L2, shared, registers) Apply if you have: Achieved >10x speedups on production ML workloads Written kernels that outperform vendor libraries Optimized attention, GEMM, or convolution at the assembly level Built custom fusions that beat XLA/Triton compiler output Published papers or open-source kernels used in production



  • bangalore, India Phinity Full time

    We look forward to when AI can discover the next quantum AI accelerator, or when AI can make RL much more compute-efficient. We want to enable AI to bootstrap its own intelligence, to discover new computational paradigms. Just as AlphaEvolve discovered a 23% speedup in Gemini's critical kernels and achieved 32.5% improvements in FlashAttention, we're...


  • bangalore, India Turiyam AI Full time

    Company Overview:At TuriyamAI, we are pioneering world leading GenAI semiconductor solutions from India, for India and the World. Our breakthrough solutions are set to redefine the future of AI computing, driving unparalleled efficiency, performance, and accessibility for enterprises worldwide.Job Description:We are looking for an exceptional engineers to...


  • Bangalore, India Turiyam AI Full time

    Company Overview: At TuriyamAI, we are pioneering world leading GenAI semiconductor solutions from India, for India and the World. Our breakthrough solutions are set to redefine the future of AI computing, driving unparalleled efficiency, performance, and accessibility for enterprises worldwide. Job Description: We are looking for an exceptional engineers to...


  • Bangalore Division, India Turiyam AI Full time

    Company Overview: At TuriyamAI, we are pioneering world leading GenAI semiconductor solutions from India, for India and the World. Our breakthrough solutions are set to redefine the future of AI computing, driving unparalleled efficiency, performance, and accessibility for enterprises worldwide. Job Description: We are looking for an exceptional engineers to...


  • bangalore district, India Turiyam AI Full time

    Company Overview: At TuriyamAI, we are pioneering world leading GenAI semiconductor solutions from India, for India and the World. Our breakthrough solutions are set to redefine the future of AI computing, driving unparalleled efficiency, performance, and accessibility for enterprises worldwide. Job Description: We are looking for an exceptional engineers to...


  • bangalore, India Cerebras Systems Full time

    Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programming simplicity of a single device. This approach allows Cerebras to deliver industry-leading training and inference speeds and empowers machine learning users to...


  • Bangalore, India Mulya Technologies Full time

    Principal Machine Learning Engineer - Multimodal AI & Inference Bangalore Founded in 2023,by Industry veterans HQ in California,US We are revolutionizing sustainable AI compute through intuitive software with composable silicon Overview: You will design, optimize, and deploy large multimodal models (language, vision, audio, video) to run efficiently on a...


  • bangalore, India Mulya Technologies Full time

    Principal Machine Learning Engineer - Multimodal AI & InferenceBangaloreFounded in 2023,by Industry veterans HQ in California,USWe are revolutionizing sustainable AI compute through intuitive software with composable silicon Overview:You will design, optimize, and deploy large multimodal models (language, vision, audio, video) to run efficiently on a...

  • Kernel Engineer

    1 week ago


    bangalore, India People's Growth HR Solutions Full time

    Job Title: Kernel EngineerLocation: Bangalore, IndiaExperience: 4+ YearsKey Responsibilities:Design, develop, and maintain the core operating system of our products Collaborate with software development team to integrate new features and functionalities into the kernel Identify and troubleshoot any issues related to the kernel and provide timely solutions...


  • Bangalore Division, India Mulya Technologies Full time

    Principal Machine Learning Engineer - Multimodal AI & Inference Bangalore Founded in 2023,by Industry veterans HQ in California,US We are revolutionizing sustainable AI compute through intuitive software with composable silicon Overview: You will design, optimize, and deploy large multimodal models (language, vision, audio, video) to run efficiently on a...