DevOps Engineer III

Get To Know Us FirstWho We AreAt interface.ai, we’re redefining the future of banking with AI. Our cutting-edge Generative AI-powered platform serves over 100 banks and credit unions, delivering hyper-personalized customer interactions across voice, chat, and employee-assisting solutions.Our mission :To make banking effortless, intelligent, and profitable—enhancing user experience while boosting revenue and efficiency for financial institutions.We’re not just another AI company. Our proprietary AI, built 100% in-house, is designed for zero-shot learning, achieving 90%+ accuracy on Day 1. With a world-class team from Microsoft, ISB, and IIMs, and a 1,800% growth rate in the last year, we’re shaping the future of AI in financial services.Join us to build something transformative.Careers - - – DevOps Engineer IIILocation: India (Remote)Function: Engineering – Product EngineeringLevel: SeniorReports to: Engineering Manager – Product EngineeringAbout the RoleAt interface.ai, we are building BankGPT – the world’s first AI-powered digital banking platform that leverages large language models, multi-agent orchestration, real-time streaming, and voice AI. To support this mission, we are seeking a DevOps Engineer III who will own infrastructure end-to-end, design systems from scratch, and enable highly resilient AI workloads at scale.This is a senior, hands-on role that requires deep expertise in cloud-native DevOps, infrastructure automation, observability, and security. You’ll not only build and optimize systems but also influence best practices, mentor peers, and contribute to critical decision-making around platform reliability and scalability.What You’ll DoInfrastructure Ownership – Design, implement, and scale infra across AWS, GCP, or Azure; drive high availability, multi-AZ, and DR/BCP strategies.Cloud-Native Enablement – Build and manage Kubernetes clusters (EKS/GKE), service mesh (Istio/Linkerd), and ingress controllers for secure and resilient workloads.CI/CD & Automation – Architect CI/CD pipelines (ArgoCD/GitOps, Jenkins) and build custom deployment portals and automation tools to accelerate developer productivity.AI/LLM Reliability – Define and track key metrics (latency, cost, throughput, containment) for AI/LLMs and agent workflows.Observability & Tracing – Implement end-to-end tracing for multi-turn queries and real-time pipelines using OpenTelemetry, Prometheus, and Grafana.Vector Databases – Manage and tune vector DBs (Pinecone, Weaviate, Milvus, etc.) for high concurrency, hybrid retrieval, reranking, and resilience.Resilience & Scaling – Design autoscaling, failover, and health-check–based routing strategies for workloads like WebSockets, RAG pipelines, and voice (STT/TTS).Scripting & Tooling – Write Bash/Python/Go scripts for operational tooling, log rotation, API integrations, and rollout automation.Collaboration – Partner with AI and engineering teams to support complex workflows, while driving DevOps best practices across the organizationWhat You’ll Bring5–8 years of core DevOps experience with a strong track record of building infra from scratch (not just maintaining existing systems).Deep expertise in Docker, Kubernetes, Helm, and container orchestration.Hands-on with Terraform, Crossplane, and declarative infra management.Strong experience in CI/CD pipelines (ArgoCD, Jenkins, GitOps workflows) and building custom automation.Proven ability to deploy AI/LLMs & agent workflows reliably in production.Expertise in defining/tracking AI workflow metrics and observability of multi-turn queries.Mandatory expertise with vector databases – tuning, scaling, and optimizing retrieval performance.Proficiency in monitoring & logging tools (Prometheus, Grafana, OpenTelemetry, ELK/OpenSearch).Familiarity with service mesh (Istio/Linkerd), networking, and multi-cluster workloads.Proficiency in scripting/programming (Python, Bash, Go preferred).Knowledge of security best practices in cloud environments (IAM, secrets, secure networking).Bonus Points:Experience working on AI-enabled or ML-integrated platformsUnderstanding of compliance, security, and auditability requirements in regulated environmentsPrior experience working in fast-paced, high-growth product teamsWhy Join Us?Remote-first culture – Work from anywhere, with top-tier colleagues.High ownership, high impact – Your work will define the future of banking.Comprehensive Benefits – We take care of our people.