
Senior Engineer I
4 days ago
Dive in and do the best work of your career at DigitalOcean. Journey alongside a strong community of top talent who are relentless in their drive to build the simplest scalable cloud. If you have a growth mindset, naturally like to think big and bold, and are energized by the fast-paced environment of a true industry disruptor, you'll find your place here. We value winning together—while learning, having fun, and making a profound difference for the dreamers and builders in the world.
We're seeking an experienced Senior Software Engineer to drive the design, development and scaling of our Large Language Model (LLM) inference services. As a Senior Software Engineer at DigitalOcean, you will join a dynamic team dedicated to revolutionizing cloud computing and AI. This team will be building a new product that will bring our famed DigitalOcean Simplicity to the world of LLM hosting, serving, and optimization. In this role, you will build systems for inference serving of popular open source / open weights LLMs as well as custom models, develop novel techniques for optimizing these models and scale the platform to handle millions of users across the globe.
What You'll Be Doing:- Design and implement an inference platform for serving large language models optimized for the various GPU platforms they will be run on.
- Develop and shepherd complex AI and cloud engineering projects through the entire product development lifecycle (PDLC) - ideation, product definition, experimentation, prototyping, development, testing, release, and operations.
- Optimize runtime and infrastructure layers of the inference stack for best model performance.
- Build native cross platform inference support across NVIDIA and AMD GPUs for a variety of model architectures.
- Contribute to open source inference engines to make them perform better on DigitalOcean cloud.
- Build tooling and observability to monitor system health, and build auto tuning capabilities.
- Build benchmarking frameworks to test model serving performance to guide system and infrastructure tuning efforts.
- Mentor engineers on inference systems, GPU infrastructure, and distributed systems best practices.
- 4+ years of experience in software engineering, which should include 1+ years building AI/ML technologies (ideally related to LLM hosting and inference).
- Enduring interest in distributed systems design, AI/ML, and implementation at scale in the cloud.
- Deep expertise in cloud computing platforms and modern AI/ML technologies.
- Experience with modern LLMs, ideally related to hosting, serving, and optimizing such models.
- Experience with one or more inference engines would be a bonus: vLLM, SGLang, Modular Max etc.
- Experience researching, evaluating, and building with open source technologies.
- Proficiency in programming languages commonly used in cloud development, such as Python and Go.
- Experience with various GPU platforms from AMD and NVIDIA and associated toolsets for tuning, configuring, and accelerating workloads on them would be ideal, but not required (e.g., CUDA and ROCm).
- A strong sense of ownership and a drive to figure out and resolve any issues preventing you and your team from delivering value to your customers
- An appreciation for process and developing cross-disciplinary collaboration between engineering, operations, support, and product groups
- Familiarity with end-to-end quality best practices and their implementation
- Experience coordinating with partner teams across time zones and geographies
- Experience with infrastructure as code (IaC) tools like Terraform or Ansible
- A passion for coaching and mentoring junior software engineers
- We innovate with purpose. You'll be a part of a cutting-edge technology company with an upward trajectory, who are proud to simplify cloud and AI so builders can spend more time creating software that changes the world. As a member of the team, you will be a Shark who thinks big, bold, and scrappy, like an owner with a bias for action and a powerful sense of responsibility for customers, products, employees, and decisions.
- We prioritize career development. At DO, you'll do the best work of your career. You will work with some of the smartest and most interesting people in the industry. We are a high-performance organization that will always challenge you to think big. Our organizational development team will provide you with resources to ensure you keep growing. We provide employees with reimbursement for relevant conferences, training, and education. All employees have access to LinkedIn Learning's 10,000+ courses to support their continued growth and development.
- We care about your well-being. Regardless of your location, we will provide you with a competitive array of benefits to support you from our Employee Assistance Program to Local Employee Meetups to flexible time off policy, to name a few. While the philosophy around our benefits is the same worldwide, specific benefits may vary based on local regulations and preferences.
- We reward our employees. The salary range for this position is based on market data, relevant years of experience, and skills. You may qualify for a bonus in addition to base salary; bonus amounts are determined based on company and individual performance. We also provide equity compensation to eligible employees, including equity grants upon hire and the option to participate in our Employee Stock Purchase Program.
- We value diversity and inclusion. We are an equal-opportunity employer, and recognize that diversity of thought and background builds stronger teams and products to serve our customers. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.
This is a hybrid role based out of Hyderabad, India.
#LI-Hybrid
-
System Senior Engineer I
4 weeks ago
Hyderabad, Telangana, India Alter Domus Full timeABOUT US We are Alter Domus Meaning The Other House in Latin Alter Domus is proud to be home to 85 of the top 30 asset managers in the alternatives industry and more than 5 000 professionals across 23 countries With a deep understanding of what it takes to succeed in alternatives we believe in being different Invest yourself in the alternative ...
-
Senior Engineer
6 days ago
Hyderabad, Telangana, India Exyte Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Title: Senior Engineer - I&CLocation: HyderabadWork Mode: Work from officeJob Summary:The instrumentation and Control (I&C) engineer is responsible for engineering design at various phases of the project to meet project requirements in the field of instrumentation and process automation. The engineer shall be involved in proposal preparation along with...
-
Software Engineer I
20 hours ago
Hyderabad, Telangana, India Spacelabs Healthcare Full time US$ 80,000 - US$ 1,20,000 per yearOverviewSoftware Engineer-I will be involved in the development of software technologies for medical devices. The right candidate will be proactive, with great communication skills, demonstrate attention to details, have a passion for technology, and an excitement to produce great products. Software Engineer-I shall be responsible for the development of...
-
Senior Quality Engineer I
3 weeks ago
Hyderabad, Telangana, India Marriott Tech Accelerator Full timeAbout Us Marriott International Inc headquartered in Bethesda Maryland USA was founded in May 1927 by J Willard Marriott and Alice S Marriott with a modest nine-seat A W root beer stand Guided by the family s leadership and core principles Marriott International today has grown into a global hospitality giant operating approximately 9 000...
-
Senior Network Engineer I
2 weeks ago
Hyderabad, Telangana, India Marriott Tech Accelerator Full timeAbout Marriott Marriott Tech Accelerator is part of Marriott International a global leader in hospitality Marriott International Inc is a leading American multinational company that operates a vast array of lodging brands including hotels and residential properties It consists of over 30 well-known brands and nearly 8 900 properties situated in 141...
-
Senior Network Engineer I
3 weeks ago
Hyderabad, Telangana, India Marriott Tech Accelerator Full timeAbout Us Marriott International Inc headquartered in Bethesda Maryland USA was founded in May 1927 by J Willard Marriott and Alice S Marriott with a modest nine-seat A W root beer stand Guided by the family s leadership and core principles Marriott International today has grown into a global hospitality giant operating approximately 9 000...
-
Data Engineer I
2 weeks ago
Hyderabad, Telangana, India Phenom Full timeJob DescriptionJob descriptionRole Overview:- We are looking for a highly skilled Product Development Engineer I to development of scalable, secure, and highly efficient backend services and systems. You will work on building innovative solutions and ensure the operational excellence of our platforms.Position Summary- We're looking for a Developer to join...
-
Senior Software Engineer I
17 hours ago
Hyderabad, Telangana, India Optum Full time ₹ 20,00,000 - ₹ 25,00,000 per yearOptum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers,...
-
Senior Civil Engineering
2 days ago
Hyderabad, Telangana, India VB® Engineering (I) Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole DescriptionThis is a full-time on-site role for a Senior Civil Engineer, located in Telangana, India. The Senior Civil Engineer will be responsible for designing and managing civil engineering projects, overseeing water resource management, and ensuring effective project management. Day-to-day tasks will include planning and executing engineering...
-
Engineer I
1 week ago
Hyderabad, Telangana, India TechnipFMC Full time ₹ 4,00,000 - ₹ 8,00,000 per yearJob Purpose Participates in engineering solutions as part of a SSE project taskforce, in accordance with TechnipFMC standards, procedures, processes, schedules, and budget, with a continuous concern for quality, targets, and customer satisfaction. Job Description • Participates in projects under supervision of more senior engineers and assists them in...