DevOps Engineer III

Get To Know Us First Who We Are At interface.ai, we’re redefining the future of banking with AI. Our cutting-edge Generative AI-powered platform serves over 100 banks and credit unions, delivering hyper-personalized customer interactions across voice, chat, and employee-assisting solutions. Our mission : To make banking effortless, intelligent, and profitable—enhancing user experience while boosting revenue and efficiency for financial institutions. We’re not just another AI company. Our proprietary AI, built 100% in-house, is designed for zero-shot learning, achieving 90%+ accuracy on Day 1. With a world-class team from Microsoft, ISB, and IIMs, and a 1,800% growth rate in the last year, we’re shaping the future of AI in financial services. Join us to build something transformative. Careers - LinkedIn - Role – DevOps Engineer III Location: India (Remote) Function: Engineering – Product Engineering Level: Senior Reports to: Engineering Manager – Product Engineering About the Role At interface.ai, we are building BankGPT – the world’s first AI-powered digital banking platform that leverages large language models, multi-agent orchestration, real-time streaming, and voice AI. To support this mission, we are seeking a DevOps Engineer III who will own infrastructure end-to-end, design systems from scratch, and enable highly resilient AI workloads at scale. This is a senior, hands-on role that requires deep expertise in cloud-native DevOps, infrastructure automation, observability, and security. You’ll not only build and optimize systems but also influence best practices, mentor peers, and contribute to critical decision-making around platform reliability and scalability. What You’ll Do Infrastructure Ownership – Design, implement, and scale infra across AWS, GCP, or Azure; drive high availability, multi-AZ, and DR/BCP strategies. Cloud-Native Enablement – Build and manage Kubernetes clusters (EKS/GKE), service mesh (Istio/Linkerd), and ingress controllers for secure and resilient workloads. CI/CD & Automation – Architect CI/CD pipelines (ArgoCD/GitOps, Jenkins) and build custom deployment portals and automation tools to accelerate developer productivity. AI/LLM Reliability – Define and track key metrics (latency, cost, throughput, containment) for AI/LLMs and agent workflows. Observability & Tracing – Implement end-to-end tracing for multi-turn queries and real-time pipelines using OpenTelemetry, Prometheus, and Grafana. Vector Databases – Manage and tune vector DBs (Pinecone, Weaviate, Milvus, etc.) for high concurrency, hybrid retrieval, reranking, and resilience. Resilience & Scaling – Design autoscaling, failover, and health-check–based routing strategies for workloads like WebSockets, RAG pipelines, and voice (STT/TTS). Scripting & Tooling – Write Bash/Python/Go scripts for operational tooling, log rotation, API integrations, and rollout automation. Collaboration – Partner with AI and engineering teams to support complex workflows, while driving DevOps best practices across the organization What You’ll Bring 5–8 years of core DevOps experience with a strong track record of building infra from scratch (not just maintaining existing systems). Deep expertise in Docker, Kubernetes, Helm, and container orchestration. Hands-on with Terraform, Crossplane, and declarative infra management. Strong experience in CI/CD pipelines (ArgoCD, Jenkins, GitOps workflows) and building custom automation. Proven ability to deploy AI/LLMs & agent workflows reliably in production. Expertise in defining/tracking AI workflow metrics and observability of multi-turn queries. Mandatory expertise with vector databases – tuning, scaling, and optimizing retrieval performance. Proficiency in monitoring & logging tools (Prometheus, Grafana, OpenTelemetry, ELK/OpenSearch). Familiarity with service mesh (Istio/Linkerd), networking, and multi-cluster workloads. Proficiency in scripting/programming (Python, Bash, Go preferred). Knowledge of security best practices in cloud environments (IAM, secrets, secure networking). Bonus Points: Experience working on AI-enabled or ML-integrated platforms Understanding of compliance, security, and auditability requirements in regulated environments Prior experience working in fast-paced, high-growth product teams Why Join Us? Remote-first culture – Work from anywhere, with top-tier colleagues. High ownership, high impact – Your work will define the future of banking. Comprehensive Benefits – We take care of our people.