Senior Software Engineer

Azure AI Infrastructure team is looking for passionate engineers to build the largest deep-learning infrastructure service at Microsoft In this role you will be tasked with building new components to bring the latest innovations in AI Infrastructure onto the Azure AI Platform You will partner with top engineering talent within Azure AI Infrastructure and across Azure to work on cluster orchestration job scheduling storage networking containerization and operating system integration Your work will enable various AI languages and run-times on Azure AI Infrastructure to bring distributed deep learning training and inferencing to life In addition you will build infrastructure components required to build deploy monitor and service highly available and scalable Microsoft Service Fabric and Kubernetes clusters under your care You will lead development and customer support from the frontline and establish architecture service excellence guidelines and a high-quality bar Candidates must have a track record for delivering engineering and service excellence on a mid-to-large scale service Who are WeWe are engineers on Azure AI Infrastructure We believe that building a planet-scale AI Supercomputer from the ground-up which addresses the fundamental pain-points of data scientists and AI practitioners and takes AI to the unprecedented scale is an opportunity of a lifetime If you share the same dream as us come join us What Is Azure AI InfrastructureHigh scale AI workloads are always testing the limits of the infrastructure stack Large-scale model training and inference with huge data volumes of training data on hundreds-thousands of GPUs make it a true engineering challenge Azure AI Infrastructure is a globally distributed multi-tenant service that provides robust cost-effective and competitive AI infrastructure compute networking and storage for AI training and inferencing By abstracting workloads from underlying infrastructure Azure AI Infrastructure creates a shared pool of resources that can be dynamically provisioned for full utilization of expensive GPU compute and enabling data scientists to productively build scale experiment and iterate their models on top of a robust performant scalable and cost-effective distributed infrastructure built for AI In Azure AI Infrastructure we are constantly seeking to apply the best ideas from AI ML distributed systems distributed databases machine learning information retrieval networking and security Responsibilities Responsibilities Deliver a robust container orchestration platform for Azure AI Infrastructure Design and build the scheduling sub-system that is responsible for delivering on the SLAs for AI training and inferencing workloads Design and build storage and caching system for efficient DNN training and inferencing Design and build control plane APIs for creation and management of training jobs and inference model metadata Deliver node management fault detection and node repair as a service to improve job model reliability Deliver world-class monitoring systems and telemetry pipelines to enhance service and job observability for both end-users and operators Codify security and compliance requirements by building and strengthening system defenses against malicious attacks and exploits Leverage performance and profiling tools to identify hot spots and bottlenecks across hardware and software boundaries from CPU GPU microcode OS networking code and drive end-to-end job performance Qualifications Required and Preferred 6 years of experience with coding in one of C C or C Rust go Experience working with the Linux operation system and Kubernetes cluster orchestration Experience with improving service operations or engineering fundamentals Excellent collaboration skills A masters or bachelors degree in computer science or a related field At least 5 years of experience building and shipping production software or services AIPLATFORM Microsoft is an equal opportunity employer All qualified applicants will receive consideration for employment without regard to age ancestry color family or medical care leave gender identity or expression genetic information marital status medical condition national origin physical or mental disability political affiliation protected veteran status race religion sex including pregnancy sexual orientation or any other characteristic protected by applicable laws regulations and ordinances If you need assistance and or a reasonable accommodation due to a disability during the application or the recruiting process please send a request via the Ability to meet Microsoft customer and or government security screening requirements are required for this role These requirements include but are not limited to the following specialized security screenings Microsoft Cloud Background Check This position will be required to pass the Microsoft Cloud background check upon hire transfer and every two years thereafter