Senior Member of Technical Staff OCI AI/ML

Senior Software Development Engineer - OCI AI Platform, Services & Solutions Org
OCI is Oracle's next-generation cloud platform, built for the most demanding enterprise workloads. We are focused on delivering high-performance computing, storage, networking, and platform services at global scale.
The AI Platform, Services & Solutions organization within OCI is building a robust ecosystem to support the end-to-end lifecycle of AI and machine learning workloads. From GPU infrastructure and training pipelines to model serving and deployment tools—we empower teams across Oracle and our customers to build and deploy AI at scale.
We are looking for a Senior Software Engineer to join our growing team and help shape the future of AI infrastructure and services at Oracle. You will work on critical components of OCI's AI platform, including high-scale GPU cluster management, self-service ML infrastructure, and model serving systems.
Work on critical AI infrastructure that powers Oracle's GenAI and ML initiatives. Contribute to high-impact projects with visibility across Oracle Cloud. Collaborate with top engineers and researchers in a fast-paced, innovation-driven environment. Grow your career in a supportive, mission-driven team building the future of enterprise AI.
This is a highly technical, hands-on role where you'll build large-scale distributed systems, optimize AI/ML workflows, and collaborate with cross-functional teams to deliver scalable and reliable solutions.

Design, implement, and operate scalable services for GPU-based model training, tuning, and inference.
Build tools and APIs that enable internal and external users to easily launch, monitor, and manage ML workloads.
Collaborate with product, infrastructure, and ML engineering teams to define and deliver key platform features.
Optimize performance, reliability, and efficiency of AI infrastructure using best-in-class engineering practices.
Contribute to platform automation, observability, CI/CD pipelines, and operational excellence.
Troubleshoot complex issues in distributed systems and participate in on-call rotations as needed.
Mentor junior engineers and participate in design and code reviews.

What You'll Do

• Build cloud service on top of the modern Infrastructure as a Service (IaaS) building blocks at OCI
• Design and build distributed, scalable, fault tolerant software systems
• Participate in the entire software lifecycle – development, testing, CI and production operations
• Leverage internal tooling at OCI to develop, build, deploy and troubleshoot software
• Participate in on-call for the service with the team

Qualifications

• 4+ years of experience shipping scalable, cloud native distributed systems
• Experience building control plane/data plane solutions for cloud native companies
• Proficient in Go, Java, Python
• Experience with Kubernetes controller and operators
• Experienced at building highly available services, possessing knowledge of common service-oriented design patterns and service-to-service communication protocols
• Experience with production operations and best practices for putting quality code in production and troubleshoot issues when they arise
• Able to effectively communicate technical ideas verbally and in writing (technical proposals, design specs, architecture diagrams and presentations) 
• BS in Computer Science, or equivalent experience

Preferred Qualifications

• MS in Computer Science
• Experience in diagnosing, troubleshooting and resolving performance issues in complex environments
• Deep understanding of Unix-like operating systems
• Production experience with Cloud and ML technologies
• Generative AI, LLM, Machine learning experience

Career Level - IC3