LLM Ops Engineer

2 days ago

Hyderabad, Telangana, India Apple Full time ₹ 12,00,000 - ₹ 36,00,000 per year

We work on Apple scale opportunities and challenges. We are engineers at heart. We like solving technical problems. We believe a good engineer has the curiosity to dig into inner workings of technology and is always experimenting, reading and in constant learning mode. If you are a software engineer with passion to code and dig deeper into any technology, love knowing the internals, fascinated by distributed systems architecture, we want to hear from you.

Description

We are seeking a highly skilled LLM Ops and ML Ops Engineer to lead the deployment, scaling, monitoring, and optimization of large language models (LLMs) across diverse environments. This role is critical to ensuring our machine learning systems are production-ready, high-performing, and resilient. The ideal candidate will have deep expertise in Python programming / Go Programming, a comprehensive understanding of LLM internals, and hands-on experience with various inference engines and deployment strategies. The person should be capable of exhibiting deftness to balance multiple simultaneous competing priorities and deliver solutions in a timely manner. The person should be able to understand complex architectures and be comfortable working with multiple teams KEY RESPONSIBILITIES: - Design and build scalable infrastructure for fine-tuning, and deploying large language models. - Develop and optimize inference pipelines using popular frameworks and engines (e.g. TensorRT, vLLM, Triton Inference Server). - Implement observability solutions for model performance, latency, throughput, GPU/TPU utilization, and memory efficiency. - Own the end-to-end lifecycle of LLMs in production-from experimentation to continuous integration and continuous deployment (CI/CD). - Collaborate with research scientists, ML engineers, and backend teams to operationalize groundbreaking LLM architectures. - Automate and harden model deployment workflows using Python, Kubernetes, Containers and orchestration tools like Argo Workflows and GitOps. - Design reproducible model packaging, versioning, and rollback strategies for large-scale serving. - Stay current with advances in LLM inference acceleration, quantization, distillation, and model compilation techniques (e.g., GGUF, AWQ, FP8).

Minimum Qualifications

  • 5+ years of experience in LLM/ML Ops, DevOps, or infrastructure engineering with a focus on machine learning systems.
  • Advance level proficiency in Python/Go, with ability to write clean, performant, and maintainable production code.
  • Deep understanding of transformer architectures, LLM tokenization, attention mechanisms, memory management, and batching strategies.
  • Proven experience deploying and optimizing LLMs using multiple inference engines.
  • Strong background in containerization and orchestration (Kubernetes, Helm).
  • Familiarity with monitoring tools (e.g., Prometheus, Grafana), logging frameworks, and performance profiling.

Preferred Qualifications

  • Experience integrating LLMs into micro-services or edge inference platforms.
  • Experience with Ray distributed inference
  • Hands-on with quantization libraries
  • Contributions to open-source ML infrastructure or LLM optimization tools.
  • Familiarity with cloud platforms (AWS, GCP) and infrastructure-as-code (Terraform).
    Exposure to secure and compliant model deployment workflows

Submit CV

  • llm

    1 week ago

    Hyderabad, Telangana, India procallisto solutions pvt Full time ₹ 15,60,000 - ₹ 18,00,000 per year

    ob Title: Senior AI/ML Engineer – LLMsExperience: 6+ yearsLocation: [ Bangalore / HyderabadWork Mode: OnsiteRole Overview:We are seeking a highly skilled Senior AI/ML Engineer with expertise in Large Language Models (LLMs), Artificial Intelligence, and Machine Learning. The candidate will design, develop, and optimize AI-driven solutions, with a strong...

  • LLM Engineer

    9 hours ago

    Hyderabad, Telangana, India Cantik Technologies Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Company DescriptionCantik Technologies Private Limited, founded in 2017, is a leading provider of IT solutions and services. Based on strong industry expertise and a commitment to customer-centricity and continuous improvement, Cantik Technologies delivers end-to-end technology services, including Managed IT Services, Cloud Solutions, Cybersecurity, and...

  • Machine Learning Engineer- LLM

    2 weeks ago

    Hyderabad, Telangana, India Apple Full time US$ 1,50,000 - US$ 2,00,000 per year

    At Apple, new ideas have a way of becoming extraordinary products, services and customer experiences very quickly. Bring passion and dedication to your job, and there's no telling what you could accomplish. The people here at Apple don't just craft products - they build the kind of wonder that's revolutionised entire industries. It's the diversity of those...

  • LLM Engineer

    2 days ago

    Hyderabad, Telangana, India Huemn Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job OverviewWe are seeking a Junior LLM Engineer to join our dynamic team at Huemn in Hyderabad. This full-time position requires 1 to 3 years of work experience. The ideal candidate will have a strong background in natural language processing and large language models, crucial for advancing our AI-powered tools. You will collaborate with cross-functional...

  • AI / LLM Specialist

    2 days ago

    Hyderabad, Telangana, India Codehive Labs Hyderabad Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role & responsibilitiesThe AI/LLM Specialist will focus on developing, fine-tuning, and embedding large language models into GCP-based data processing and automation pipelines. This role ensures accuracy, scalability, and cost efficiency of AI-driven automation.ResponsibilitiesTrain, fine-tune, and optimize LLMs for automation, mapping, and anomaly...

  • Generative AI Engineer(LLMs

    2 weeks ago

    Hyderabad, Telangana, India Ekshvaku Tech Innovations Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Generative AI Engineer (LLMs & RAG) Healthcare SaaSLocation: Remote / Hyderabad (preferred)Experience: 5+ yearsEmployment Type: Full-timeDomain: Generative AI, Healthcare, SaaSAbout the RoleWe are looking for a hands-on Generative AI Engineer with expertise in Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG). In this role, you will...

  • Senior Machine Learning LLM Engineer

    5 hours ago

    Hyderabad, Telangana, India Nyx Wolves Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Senior Machine Learning / LLM Engineer (Onsite Hyderabad)Experience Required: 5+ Years Location: Hyderabad (Onsite) Interview Process: First round virtual; 2nd round Walk-in at Hyderabad officeAbout the RoleWe are looking for a Senior Machine Learning / LLM Engineer who can combine deep machine learning expertise with hands-on generative AI systems...

  • Prompt/LLM Engineer

    14 hours ago

    Hyderabad, Telangana, India Avontix Full time

    Prompt/LLM EngineerHyderabad, Telangana   ITDescriptionWhy work at nimble?This is a great opportunity to join a well-established and market-leading brand serving a high-growth end market while gaining valuable experience working closely with Executive leadership. As an organization, we are in high-growth mode through acquisition with a laser focus on...

  • LLM Engineer|| Hyderabad

    2 weeks ago

    Hyderabad, Telangana, India Ibotix Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Must-Have Skills:7+ years overall, 2+ years with transformer-based NLP (text generation, summarization, Q&A, classification).Strong expertise in LLMs (GPT, BERT, T5, RoBERTa).Experience in fine-tuning models on domain-specific datasets.Knowledge of attention mechanisms, tokenization, embeddings, and context windows.Skilled in prompt engineering...

  • Senior LLM Engineer(Contract_Hyderabad)

    2 days ago

    Hyderabad, Telangana, India Myliara Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior LLM EngineerExperience : 7+yearsBudget:150LPMOnsiteHyderabadContract:6 monthsImmediate joiners preferredMust Have Skill● Overall 7+ years with at least 2+ years of experience working with transformer-based models and NLP tasks, with a focus on text generation, summarization, question answering, classification, and similar tasks.● Expertise in...