Google Cloud Platform

4 days ago

Bengaluru, Karnataka, India People Prime Worldwide Full time ₹ 12,00,000 - ₹ 36,00,000 per year

About the Company

Our client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future.

Job Description Important Note (Please Read Before Applying)

Do NOT apply if:

You have less than 5 years in GCP.

You do not have hands-on
PyTorch
,
TensorFlow
.

You are on a notice period longer than 15 days.

Apply ONLY if you meet ALL criteria above. Random / irrelevant applications will not be processed.

Job Title:
Google Cloud Platform

Location:
Remote (Global) | Preferred: US / EU Time Zones

Job Type:
Full-Time

Experience Required:
8+ Years

About the Role:

We're looking for a
Senior ML Inference Engineer
with deep expertise in
containerized ML workflows
,
large model inference
, and
cloud-native deployment
. You'll work at the intersection of
MLOps
,
deep learning
, and
cloud infrastructure
, helping productionize some of the most powerful language models available today.

Key Responsibilities:

  • Deploy and optimize
    large-scale models
    (e.g., Mixtral, Gemma) for
    inference performance
    and
    latency
    .
  • Build and maintain
    highly optimized Docker containers
    , using multi-stage builds and best practices for performance and security.
  • Work with
    high-performance inference servers
    such as
    vLLM
    for efficient GPU utilization in production.
  • Manage and automate deployment on
    Google Cloud Platform (GCP)
    using tools like
    GKE
    ,
    Cloud Run
    , and
    Artifact Registry
    .
  • Support model deployment pipelines for Google Cloud's
    Model Garden
    , handling complex dependency resolution.
  • Write and maintain
    clear, reproducible documentation
    for container builds, deployment processes, and system management.

Requirements:

  • 8+ years
    of experience in software/ML engineering roles.
  • Advanced knowledge of
    PyTorch
    and
    TensorFlow
    .
  • Strong hands-on experience with
    Docker
    and container-based deployment workflows.
  • Proven experience with
    ML inference optimization
    , especially in GPU-accelerated environments.
  • Familiarity with
    LLMs and open-weight models
    (e.g., Mixtral, Gemma, LLaMA, Falcon).
  • Solid grasp of
    Google Cloud services
    for container orchestration.
  • Excellent communication skills and a passion for clean, scalable infrastructure.

Nice to Have:

  • Experience with other inference frameworks (e.g., TensorRT, ONNX Runtime, DeepSpeed).
  • Familiarity with
    CI/CD pipelines
    and
    infrastructure as code
    .

  • Senior UX Designer, Cloud Business Platforms

    2 weeks ago

    Bengaluru, Karnataka, India Google Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Hyderabad, Telangana, India; Bengaluru, Karnataka, India.Minimum qualifications:Bachelor's degree or equivalent practical experience.6 years of experience in product design or UX.Experience designing across multiple platforms, and...

  • Google Cloud Platform Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Fractal Analytics Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    GCP Engineer - Digi Ops It's fun to work in a company where people truly BELIEVE in what they are doing We're committed to bringing passion and customer focus to the business. Job Location: All Fractal Location Job Description Platform – • Google Cloud Platform • Cloud Storage Bucket • DataProc • Dataflow • Big Query • Cloud Run • IAM...

  • Google Cloud Platform Architect

    7 days ago

    Bengaluru, Karnataka, India Tayana Mobility Technologies Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job Summary : As a Google Cloud Platform (GCP) Cloud Architect, you will be responsible for designing, implementing, and maintaining cloud infrastructure solutions to ensure high availability, scalability, and security. You will work closely with engineering teams to optimize cloud environments and support business-critical applications.Key Roles &...

  • Senior Software Engineer, Capital Markets Technology, Cloud Platform

    2 weeks ago

    Bengaluru, Karnataka, India Google Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Minimum qualifications:Bachelor's degree or equivalent practical experience.5 years of experience with software development in one or more programming languages.3 years of experience in testing, maintaining, or launching software products.1 year of experience with software design and architecture.Preferred qualifications:Master's degree or PhD in Computer...

  • Senior Software Engineer, Capital Markets Technology, Cloud Platform

    1 week ago

    Bengaluru, Karnataka, India Google Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Minimum qualifications:Bachelor's degree or equivalent practical experience.5 years of experience with software development in one or more programming languages.3 years of experience in testing, maintaining, or launching software products.1 year of experience with software design and architecture.Preferred qualifications:Master's degree or PhD in Computer...

  • Senior Software Engineer, Capital Markets Technology, Cloud Platform

    2 days ago

    Bengaluru, Karnataka, India Google Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Minimum qualifications:Bachelor's degree or equivalent practical experience.5 years of experience with software development in one or more programming languages.3 years of experience in testing, maintaining, or launching software products.1 year of experience with software design and architecture.Preferred qualifications:Master's degree or PhD in Computer...

  • Technical Account Manager, Cloud

    3 days ago

    Bengaluru, Karnataka, India Google Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Minimum qualifications:Bachelor's degree in Computer Science, Engineering, a related technical field, or equivalent practical experience.5 years of experience in a customer-facing role working with stakeholders, driving customer technical implementations or transformation programs.Experience supporting customers in cloud operations (e.g., launch or capacity...

  • Technical Account Manager, Cloud

    1 day ago

    Bengaluru, Karnataka, India Google Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Minimum qualifications:Bachelor's degree in Computer Science, Engineering, a related technical field, or equivalent practical experience.5 years of experience in a customer-facing role working with stakeholders, driving customer technical implementations or transformation programs.Experience supporting customers in cloud operations (e.g., launch or capacity...

  • Principal Architect, Banking and Financial Services, Cloud

    7 days ago

    Bengaluru, Karnataka, India Google Full time ₹ 17,50,000 - ₹ 25,00,000 per year

    Note: By applying to this position you will have an opportunity to share your preferred working location from the following:Bengaluru, Karnataka, India; Mumbai, Maharashtra, India.Minimum qualifications:Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience.10 years of experience as an enterprise architect or in...

  • Software Engineer III, Cloud Business Platforms, Salesforce

    2 weeks ago

    Bengaluru, Karnataka, India Google Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Minimum qualifications:Bachelor's degree or equivalent practical experience.2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree.2 years of experience with data structures or algorithms.Preferred qualifications:5 years of experience in designing, coding, and implementing Web...