Senior AI Engineer – LLM

About Zscaler

Zscaler accelerates digital transformation so our customers can be more agile, efficient, resilient, and secure. Our cloud native Zero Trust Exchange platform protects thousands of customers from cyberattacks and data loss by securely connecting users, devices, and applications in any location.

Here, impact in your role matters more than title and trust is built on results. We believe in transparency and value constructive, honest debate—we're focused on getting to the best ideas, faster. We build high-performing teams that can make an impact quickly and with high quality. To do this, we are building a culture of execution centered on customer obsession, collaboration, ownership and accountability. 

We value high-impact, high-accountability with a sense of urgency where you're enabled to do your best work and embrace your potential. If you're driven by purpose, thrive on solving complex challenges and want to make a positive difference on a global scale, we invite you to bring your talents to Zscaler and help shape the future of cybersecurity.

Our Engineering team built the world's largest cloud security platform from the ground up, and we keep building. With more than 100 patents and big plans for enhancing services and increasing our global footprint, the team has made us and our multitenant architecture today's cloud security leader, with more than 15 million users in 185 countries. Bring your vision and passion to our team of cloud architects, software engineers, security experts, and more who are enabling organizations worldwide to harness speed and agility with a cloud-first strategy.

We are looking for highly skilled and experienced AI/ML engineers to join our team. You will be reporting to the Senior Manager, Data Science. You will be responsible for:

• Building production-grade AI systems with LLMs, LangChain, RAG pipelines, and integrating structured/unstructured data for enterprise solutions
• Implementing and fine-tuning LLMs using frameworks like LangChain, LlamaIndex, Hugging Face, and designing retrieval workflows with databases like FAISS, Pinecone, or Milvus
• Developing scalable Python microservices and APIs, ensuring front-end integration with React, , or TypeScript
• Deploying services on AWS/GCP using EKS, ECS, or Cloud Run, containerizing with Docker/Kubernetes, and implementing CI/CD pipelines with Jenkins or GitHub Actions
• Collaborating with cross-functional teams to deliver AI services and staying updated on advancements in LLMs and RAG systems to drive innovation

• 4–8 years of software or AI engineering experience, including 2+ years of hands-on work with LLMs, LangChain, or RAG systems, with a focus on cloud security, scalability, and performance optimization
• Extensive experience with Python for AI service development, API integration, and data processing, along with building RESTful or GraphQL APIs
• Practical hands-on expertise with LangChain, RAG pipelines, or similar frameworks, LLM integration, prompt design, and embedding-based retrieval
• Proficiency in deploying applications on AWS/GCP with EKS, ECS, or Cloud Run, and strong knowledge of Docker, Kubernetes, and cloud-native orchestration

• Experience developing conversational UIs, copilots, or AI-enabled dashboards, and integrating front-end features using React, , or TypeScript
• Exposure to Hugging Face Transformers, LlamaIndex, LangGraph ecosystems, and knowledge of vector databases and data pipeline management
• Understanding of compliance, privacy, and responsible AI principles

#LI-Hybrid

#LI-NT1

At Zscaler, we are committed to building a team that reflects the communities we serve and the customers we work with. We foster an inclusive environment that values all backgrounds and perspectives, emphasizing collaboration and belonging. Join us in our mission to make doing business seamless and secure.

Our Benefits program is one of the most important ways we support our employees. Zscaler proudly offers comprehensive and inclusive benefits to meet the diverse needs of our employees and their families throughout their life stages, including:

• Various health plans
• Time off plans for vacation and sick time
• Parental leave options
• Retirement options
• Education reimbursement
• In-office perks, and more

Learn more about Zscaler's Future of Work strategy, hybrid working model, and benefits here.

By applying for this role, you adhere to applicable laws, regulations, and Zscaler policies, including those related to security and privacy standards and guidelines.

Zscaler is committed to providing equal employment opportunities to all individuals. We strive to create a workplace where employees are treated with respect and have the chance to succeed. All qualified applicants will be considered for employment without regard to race, color, religion, sex (including pregnancy or related medical conditions), age, national origin, sexual orientation, gender identity or expression, genetic information, disability status, protected veteran status, or any other characteristic protected by federal, state, or local laws. See more information by clicking on the Know Your Rights: Workplace Discrimination is Illegal link.

Pay Transparency

Zscaler complies with all applicable federal, state, and local pay transparency rules.

Zscaler is committed to providing reasonable support (called accommodations or adjustments) in our recruiting processes for candidates who are differently abled, have long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support.