AIOps Engineer

2 weeks ago

Hyderabad, Telangana, India T3 strategic Partners Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Description: AI Ops Engineer - (ML Ops & LLM Ops).

Location: Hyderabad or Remote (within India).

Experience: Years.

IMMEDIATE JOINERS PREFERRED FROM IT SERVICES ORGANIZATION.

Role Overview:

We are looking for experienced AI Ops Engineers with deep expertise in MLOps, LLM deployment, and AI infrastructure management.

The ideal candidate will design and operate robust pipelines that support the full lifecycle of Large Language Models (LLMs) from training and fine-tuning to production deployment, monitoring, and optimization.

Key Responsibilities:

- Design, implement, and maintain CI/CD pipelines for LLM training, fine-tuning, evaluation, and deployment.

- Integrate tools like SonarQube and Checkmarx to enforce code quality and security standards.

- Establish comprehensive versioning for models, datasets, prompts, and configurations to ensure traceability.

- Package and deploy LLMs using Docker and Kubernetes for scalable, consistent runtime environments.

- Set up end-to-end monitoring for model performance metricslatency, throughput, cost, and output quality (hallucination, coherence, safety).

- Implement alerting mechanisms to detect anomalies, performance degradation, and model drift.

- Manage and fine-tune cloud infrastructure (AWS, Azure) and GPU/TPU environments for optimal performance.

- Use Terraform or CloudFormation for automated environment provisioning and configuration management.

- Apply cost optimization strategies for LLM inference and serving while maintaining reliability.

- Architect systems for high availability, fault tolerance, and resilience in AI workloads.

- Diagnose and resolve infrastructure or model-related issues in production environments.

- Contribute to frameworks ensuring model explainability, fairness, and traceability.

- Automate data ingestion, retraining triggers, and pipeline orchestration using modern MLOps tools.

- Build and manage complex LLM workflows through orchestration platforms for efficient end-to-end operations.

- Continuously monitor and address model degradation, data drift, and other operational risks.

Required Skills & Experience:

years in DevOps, ML Ops, or AI Infrastructure roles.

- Strong hands-on experience with LLM deployment, MLOps frameworks, and cloud platforms (AWS, Azure).

- Proficiency in Docker, Kubernetes, Terraform, and CI/CD tools (Jenkins, GitLab CI/CD, etc.)

- Deep understanding of LLM lifecycle management, performance tuning, and observability.

- Knowledge of security and compliance for AI systems.

- Experience with GPU/TPU optimization and cost-efficient scaling.

- Proven problem-solving and incident management abilities.

- Strong communication and cross-functional collaboration skills.

- Exposure to generative AI, prompt engineering, or RLHF pipelines.

- Familiarity with LLM-specific monitoring tools and safety frameworks.

- Open-source contributions in MLOps or AI Ops are a plus.

- Certifications in Cloud (AWS/Azure) or DevOps practices preferred.

  • Principal Engineer, Software

    2 weeks ago

    Hyderabad, Telangana, India ANSR Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    ANSR is hiring for one of its clients.About T-Mobile:T-Mobile US, Inc. (NASDAQ: TMUS), headquartered in Bellevue, Washington, is America's supercharged Un-carrier, connecting millions through its strong nationwide network and flagship brands, T-Mobile and Metro by T-Mobile. Customers benefit from an unmatched combination of value, quality, and exceptional...

  • Solution Engineer

    2 weeks ago

    Hyderabad, Telangana, India Infoshare soft Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Location: Hyderabad, IndiaDepartment: Product development Solution EngineerJob Type: Full-time | On-siteExperience Level: 10+ YearsWhat You'll DoAs a CloudFabrix Solution Engineer (SE), you will lead and support the field engineer community across global customer opportunities. You will collaborate with the local Sales and Engineering teams. You will work...

  • Principal Software Engineer

    5 days ago

    Hyderabad, Telangana, India hackajob Full time US$ 2,00,000 - US$ 2,50,000 per year

    hackajob*is collaborating withJ.P. Morgan*to connect them with exceptional tech professionals for this role.At Chief Data Analytics Office, we drive our firm's strategic investments in AI/ML and data-oriented tools and capabilities. Our Platform Engineering team is at the forefront of building innovative platforms, automating infrastructure operations, and...

  • Product Manager – Enterprise AI Operations

    20 hours ago

    Hyderabad, Telangana, India Eli Lilly and Company Full time US$ 1,50,000 - US$ 2,00,000 per year

    At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities...

  • Staff Software Engineer

    1 week ago

    Hyderabad, Telangana, India CBRE Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Hyderabad - Telangana - IndiaCBRE Group, Inc. is seeking an experienced L2 Staff Software Engineer to join its Managed Services Team in Hyderabad, Gurugram, or Noida. The role focuses on ensuring system reliability, scalability, and efficiency through incident management, automation, and collaboration with cross-functional teams.Key ResponsibilitiesDebug and...

  • Managed Services Pre-Sales Lead

    6 days ago

    Hyderabad, Telangana, India Jade Global Full time US$ 1,50,000 - US$ 2,00,000 per year

    Key Responsibilities:Lead end-to-end pre-sales lifecycle for large Managed Services RFPs (typically $1M$25M+).Collaborate with Sales, Delivery, Practice, and Leadership teams to shape winning responses.Own solution architecture, pricing models, delivery constructs (onshore/offshore), and transition approaches.Leverage experience in managing 100+ member...

  • AI Solutions Architect

    1 week ago

    Hyderabad, Telangana, India Tekone It Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryWe are seeking a highly experienced AI Architect / GenAI & Agentic Systems Lead to design, develop, and scale enterprise-grade AI platforms and agentic solutions.The ideal candidate will possess deep expertise across Generative AI, AgentOps, cloud-native engineering, and AI platform strategy, with hands-on proficiency in LLMs, orchestration...

  • ML Data Scientist

    2 weeks ago

    Hyderabad, Telangana, India Apple Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    Marcom is the globally led creative team responsible for Apple's consumer-facing marketing. We ensure the seamless execution of world-class communications across all media and platforms. Every day, hundreds of millions of Apple customers worldwide interact with our products. We drive the strategic and creative work that provides both new and existing...

  • BU Master Data Associate Director

    6 days ago

    Hyderabad, Telangana, India Eli Lilly and Company Full time US$ 1,50,000 - US$ 2,00,000 per year

    At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities...

  • BU Integrated Data Associate Director

    2 weeks ago

    Hyderabad, Telangana, India Eli Lilly and Company Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities...