Senior Java Engineer – Model Inference Platform

13 hours ago

bangalore, India Tata Consultancy Services Full time

Key Responsibilities Design, build, and optimize high-performance microservices using Java 17+, Spring Boot, and reactive frameworks. Develop and maintain APIs for model registration, inference request routing, and model version management. Integrate with Seldon Core / KServe for model orchestration, deployment, A/B testing and shadow testing of ML models. Implement asynchronous, event-driven architectures using Kafka, Pub/Sub, or RabbitMQ for high-throughput inference workloads. Build monitoring, tracing, and observability into inference pipelines using Prometheus, Grafana, and OpenTelemetry. Work closely with MLOps and data engineering teams to integrate CI/CD for ML models, manage containers, and deploy to Kubernetes / cloud-native platforms (GCP GKE, AWS EKS, or Azure AKS). Collaborate with data scientists and architects to ensure efficient model packaging, feature ingestion, and inference scaling. Apply performance tuning, caching strategies (Redis, Hazelcast), and load balancing to sustain millisecond-level response times. Mentor engineers and participate in design reviews to ensure architectural consistency, quality, and scalability. Required Qualifications 12+ years of backend engineering experience with Java HPC (17 or above) in large-scale, distributed systems. Deep understanding of microservices, event-driven architectures, and reactive programming. Proven expertise in Spring Boot, Kafka, REST/gRPC APIs, JPA/Hibernate, Redis, and SQL/NoSQL databases. Strong understanding of containerization (Docker) and Kubernetes orchestration. Hands-on experience integrating or developing AI/ML inference platforms such as Seldon, KServe, TensorFlow Serving, or TorchServe. Familiarity with model lifecycle management, feature stores, and inference request optimization. Experience with cloud environments (AWS, GCP, or Azure) and CI/CD pipelines (Jenkins, ArgoCD, GitLab CI). Knowledge of observability and performance tuning in high-concurrency, low-latency applications. Strong communication, analytical, and problem-solving skills with the ability to lead technical discussions across teams. Preferred Skills Exposure to Python-based ML pipelines and REST/gRPC integrations with data science environments. Familiarity with model governance, A/B testing, and multi-model serving architectures. Experience with API gateways (Kong, Istio, or Envoy) and service mesh architectures. Understanding of data serialization formats (Avro, Protobuf, Parquet) and streaming analytics. Knowledge of GPU/CPU optimization for inference workloads Exp Range: 10 TO 15 Location: Pan India Interview Type: Weekday Virtual Drive Date: 16-Oct-2025 Day: Thursday

  • Senior Java Engineer – Model Inference Platform

    5 days ago

    bangalore, India Tata Consultancy Services Full time

    Key ResponsibilitiesDesign, build, and optimize high-performance microservices using Java 17+, Spring Boot, and reactive frameworks.Develop and maintain APIs for model registration, inference request routing, and model version management.Integrate with Seldon Core / KServe for model orchestration, deployment, A/B testing and shadow testing of ML...

  • Senior Ai Research Engineer, Model Inference

    4 weeks ago

    Bangalore, Karnataka, India Tether Operations Full time

    Join Tether and Shape the Future of Digital Finance At Tether we re not just building products we re pioneering a global financial revolution Our cutting-edge solutions empower businesses from exchanges and wallets to payment processors and ATMs to seamlessly integrate reserve-backed tokens across blockchains By harnessing the power of blockchain...

  • Java Software Engineer

    2 weeks ago

    bangalore, India IntraEdge Full time

    Java Software Engineer Location: Remote Responsibilities Develop and maintain backend microservices using Python, Java and Spring Boot Build and integrate APIs (both GraphQL and REST) for scalable service communication Deploy and manage services on Google Cloud Platform (GKE) Work with Google Cloud Spanner (Postgres dialect) and pub/sub tools like Confluent...

  • Senior Engineer – AI

    2 weeks ago

    bangalore, India IntraEdge Full time

    Seeking a hands-on Senior Engineer with proven expertise in Artificial Intelligence (AI/ML) and Java development . This role combines deep technical skills with the ability to design, build, and optimize AI-powered enterprise applications . The engineer will be responsible for developing scalable Java-based systems , integrating AI/ML models into production,...

  • Senior Engineer – AI

    2 weeks ago

    bangalore, India IntraEdge Full time

    Seeking a hands-on Senior Engineer with proven expertise in Artificial Intelligence (AI/ML) and Java development. This role combines deep technical skills with the ability to design, build, and optimize AI-powered enterprise applications. The engineer will be responsible for developing scalable Java-based systems, integrating AI/ML models into production,...

  • Java Software Engineer

    2 weeks ago

    bangalore, India IntraEdge Full time

    Java Software EngineerLocation: RemoteResponsibilitiesDevelop and maintain backend microservices using Python, Java and Spring BootBuild and integrate APIs (both GraphQL and REST) for scalable service communicationDeploy and manage services on Google Cloud Platform (GKE)Work with Google Cloud Spanner (Postgres dialect) and pub/sub tools like Confluent Kafka...

  • Senior Data Scientist

    4 days ago

    bangalore, India Recro Full time

    About the job Role : Senior Data Scientist (AI & Data) Location: Remote (Work from Home) We’re hiring a Senior Data Scientist to build the next generation of intelligent decision systems that power pricing, supply optimization, ranking, and personalization in our global B2B hotel marketplace. This is a high-impact role at the intersection of machine...

  • Senior Data Scientist

    2 days ago

    bangalore, India Recro Full time

    About the job Role : Senior Data Scientist (AI & Data) Location: Remote (Work from Home) We’re hiring a Senior Data Scientist to build the next generation of intelligent decision systems that power pricing, supply optimization, ranking, and personalization in our global B2B hotel marketplace. This is a high-impact role at the intersection of machine...

  • Senior Data Scientist

    4 days ago

    bangalore, India Recro Full time

    Role : Senior Data Scientist (AI & Data) Location: Remote (Work from Home) We’re hiring a Senior Data Scientist to build the next generation of intelligent decision systems that power pricing, supply optimization, ranking, and personalization in our global B2B hotel marketplace. This is a high-impact role at the intersection of machine learning,...

  • Senior Data Scientist

    6 days ago

    bangalore, India Recro Full time

    About the jobRole : Senior Data Scientist (AI & Data)Location: Remote (Work from Home)We’re hiring a Senior Data Scientist to build the next generation of intelligentdecision systems that power pricing, supply optimization, ranking, and personalizationin our global B2B hotel marketplace.This is a high-impact role at the intersection of machine learning,...