ML Infrastructure Architect

2 weeks ago

Bellary, Karnataka, India beBeeMlEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Senior MLOps Engineer

We're looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. You'll partner with researchers, product teams, and DevOps to turn prototypes into production services that meet strict SLAs for latency, reliability, and cost efficiency.

Key Responsibilities:

  • Design and implement scalable ML pipelines (training, evaluation, deployment) for LLMs, CV, and multimodal models.
  • Lead efforts in model serving, versioning, automated CI/CD, and real-time monitoring of AI workflows.
  • Build and optimize GPU-backed serving infrastructure targeting p99 latency < 100 ms, 99.9% uptime, and > 80% GPU utilization.
  • Drive initiatives on model governance, automated drift detection ( 80% utilization.
  • Partner with AI researchers, product managers, and legal to align MLOps standards with compliance and roadmap goals.
  • Mentor junior engineers, run quarterly brown-bags, own onboarding docs (upskill 5+ engineers/quarter), and publish ≥ 1 open-source contribution or talk annually.

Requirements:

  • 9–14 years in software engineering, including ≥ 4 years in MLOPs or ML infrastructure.
  • Strong expertise in cloud platforms (AWS/GCP/Azure), Kubernetes, Docker, Terraform, Helm, Kubeflow, and MLflow.
  • Experience with inference frameworks (Triton, TensorFlow Serving, BentoML, TorchServe).
  • Familiarity with distributed training, workload schedulers, and GPU-cluster orchestration.
  • Proficiency in Python, TypeScript, and infrastructure-as-code (Terraform, Helm, etc.).
  • Proven track record building reliable, scalable ML systems in production.

Critical Skills:

  • Vector DB integration (Qdrant, Pinecone).
  • Agent orchestration (LangChain, LlamaIndex).
  • Multi-tenant security and RBAC.
  • Observability stacks (Prometheus/Grafana, ELK).
  • CI/CD for FastAPI/NestJS services.

Preferred Qualifications:

  • Master's/PhD in CS/AI and certifications such as AWS ML Specialty, Google Cloud Professional ML Engineer, or CNCF CKA/CKAD.
  • Prior experience at AI-focused startups or enterprises scaling ML for 100–500 orgs.
  • Understanding of low-latency streaming inference or agent-based LLM systems.
  • Excellent written and verbal communication, and a proven ability to drive consensus across functions.

  • Cloud Infrastructure Architect

    1 week ago

    Bellary, Karnataka, India beBeeInfrastructure Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Cloud Infrastructure Architect Job DescriptionWe are seeking a highly skilled and experienced Cloud Infrastructure Architect to lead the design, implementation, and maintenance of our AWS cloud infrastructure.In this role, you will be responsible for designing, deploying, and managing our cloud infrastructure, including EC2 instances, S3 buckets, VPCs, RDS...

  • Senior AI/ML Architect

    2 weeks ago

    Bellary, Karnataka, India beBeeArtificialIntelligence Full time ₹ 15,00,000 - ₹ 20,00,000

    About the JobWe are seeking a Senior AI/ML Architect to spearhead the design, development, and implementation of cutting-edge AI and machine learning models. As a key member of our team, you will lead the charge in guiding our engineers in ensuring the successful deployment of projects that leverage AI/ML technologies to solve complex business problems.Core...

  • AWS Cloud Infrastructure Architect

    2 weeks ago

    Bellary, Karnataka, India beBeeCloud Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job DescriptionWe are seeking a highly skilled and experienced Cloud Solutions Architect to join our team. In this role, you will play a pivotal part in establishing and leading the development of a Cloud Center of Excellence environment leveraging AWS technologies.You will be responsible for designing, implementing, and optimizing our cloud infrastructure...

  • AI/ML Strategist

    2 weeks ago

    Bellary, Karnataka, India beBeeMachinelearning Full time ₹ 18,00,000 - ₹ 22,50,000

    We are seeking a highly skilled expert in AI/ML with strong expertise in analysing business requirements and implementing advanced AI/ML solutions within the Oil & Gas domain.The ideal candidate will specialize in Exploration & Production (E&P), Operations & Maintenance (O&M), Supply Chain, and HSE datasets, acting as a vital bridge between business and IT...

  • Machine Learning Infrastructure Specialist

    2 weeks ago

    Bellary, Karnataka, India beBeeInfrastructure Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    A seasoned Machine Learning Infrastructure Specialist is sought after to lead the development and implementation of scalable machine learning models on cloud platforms. This individual will have a strong foundation in software engineering and machine learning, with prior experience working with ML Ops & DS, deploying, monitoring, and scaling ML models on...

  • Chief Architect

    1 week ago

    Bellary, Karnataka, India beBeeSystemDesigner Full time ₹ 15,00,000 - ₹ 17,00,000

    About People Prime Worldwide: Our client is a leading IT services and consulting firm providing digital transformation, cloud computing, data analytics, enterprise application integration, infrastructure management, and application development services.Its industry-specific solutions are designed to address complex business challenges by combining domain...

  • Technical Architect for AI Systems

    2 weeks ago

    Bellary, Karnataka, India beBeeSystemDesigner Full time ₹ 20,00,000 - ₹ 30,00,000

    Job OverviewWe are seeking a highly skilled Technical Architect to play a key role in building infrastructure that powers millions of AI-driven code reviews at scale.This is an exciting opportunity to work on cutting-edge AI systems with massive real-world developer impact.Create scalable, highly available systems on GCP (or AWS) using Kubernetes, Docker,...

  • Senior Data Architect Position

    1 week ago

    Bellary, Karnataka, India beBeeDataArchitecture Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Role: Data ArchitectDescription:We are seeking an accomplished Data Architect to design, implement, and manage data pipelines and systems. The ideal candidate will have a strong background in cloud-based infrastructure, data warehousing, and big data technologies.Tech Stack:AWSPythonPySparkSQLKey Requirements:Expertise in cloud-based architecture, data...

  • Chief SAP AI Integration Specialist

    1 week ago

    Bellary, Karnataka, India beBeeAI Architect Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Opportunity:We are seeking a skilled professional to design and deliver AI-enhanced solutions integrated with SAP platforms. The ideal candidate will have experience in collaborating with cross-functional teams, leading the development of AI use cases, and ensuring secure access to data across SAP and external systems.Main Responsibilities:Collaborate...

  • Chief Cloud Architect

    1 week ago

    Bellary, Karnataka, India beBeeTechnical Full time ₹ 35,00,000 - ₹ 40,00,000

    Job Description:We are seeking a seasoned Technical Lead to drive cloud strategies, AI integration, and microservices architecture. The ideal candidate will have strong expertise in cloud platforms, AI/ML adoption, and modern application design.The successful applicant will be responsible for defining enterprise architecture strategies and roadmaps,...