Principal LLM Engineer

17 hours ago

Pune Maharashtra India, Maharashtra Rapid7 Full time

Principal LLM EngineerJoin Rapid7: Secure the Future with AIAre you ready to lead the charge in integrating cutting-edge Large Language Models (LLMs) into world-class Cyber Security products?Rapid7 is looking for a Principal LLM Engineer with a rare combination of deep Data Science expertise, mastery of production MLOps, and 13+ years of experience. You won't just build models; you'll architect the AI systems that protect our customers from the world's most sophisticated threats. This is a role for a proven leader who turns breakthrough research into scalable, high-impact security solutions. What You'll Be Doing: Technical LeadershipAs a Principal Engineer, you will define and execute the technical strategy across three critical domains:1. LLM & AI System ArchitectureYou'll design and build the next generation of AI-powered security features.LLM Orchestration: Architect complex security applications using frameworks like LangChain and LangGraph to connect LLMs with our data and tools.RAG Pipelines: Build and optimise high-performance Retrieval-Augmented Generation (RAG) systems using Vector DBs to give our AI the context it needs from vast security datasets.Model Optimisation: Implement efficient adaptation techniques (LoRA/PEFT) and run rigorous evaluation using tools like Promptfoo/HELM to ensure model accuracy and safety.Governance & Safety: Design and enforce security Guardrails and governance policies for all LLM deployments.2. Security-Focused MLOps & ProductionYou'll ensure our AI is always live, stable, and fighting threats.Real-Time Monitoring: Establish comprehensive monitoring with Prometheus/Grafana/CloudWatch and lead our response to production incidents (PagerDuty, On-call).Model Life Cycle: Master the MLOps pipeline, from model versioning (MLflow/SageMaker) to automating Drift Detection & Retraining.Infrastructure: Use Terraform and Docker/Kubernetes to deploy scalable microservices and APIs.Cloud Security Integration: Leverage AWS Bedrock/SageMaker/Lambda and ensure all deployments adhere to the highest standards of Cloud Security (IAM, VPC, Secrets).CI/CD: Drive continuous deployment for our AI systems using tools like GitHub Actions/Jenkins.3. Data Science & Security FoundationYour background will enable you to solve complex security problems with data.Deep Learning: Apply expertise in NLP, CNN, RNN, etc. to analyse security data (logs, network traffic, etc.).Security Models: Drive the development of Malware Detection models, User behavioural models, and Malware behaviour-based Models.Data Engineering: Lead initiatives in Data Acquisition, Feature Engineering, and transformation across services like S3, DynamoDB, and Redshift.Explainable AI (XAI): Use SHAP/LIME to ensure transparency and explainability in security decisions made by AI. What You'll Bring13+ years of professional experience in Data Science, with a significant focus on LLMs/NLP and production MLOps.Advanced degree (Master's or PhD) in Computer Science, Data Science, or a related field, or equivalent practical experience.A proven track record of taking complex ML/LLM projects from concept to highly available production systems.Familiarity with Cost Optimisation (FinOps) for cloud resources.If you thrive on solving the hardest problems in AI and applying that power to make the world a safer place, we want to hear from you

  • LLM Engineer

    2 days ago

    Pune, Maharashtra, India Zorba Consulting Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role Description :This is a contract remote role for a LLM Engineer with 4+ years of experience. The LLM Engineer will be responsible for developing, deploying, and optimizing large language models (LLMs). The day-to-day tasks include designing NLP solutions, fine-tuning models, collaborating with cross-functional teams, and ensuring model performance and...

  • Principal Engineer – GenAI

    2 days ago

    Pune, Maharashtra, India Codvo Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Principal Engineer – GenAI & Applied AICompany Overview At Codvo, software and people transformations go hand-in-hand. We are a global empathy-led technology services company. Product innovation and mature software engineering are part of our core DNA. Respect, Fairness, Growth, Agility, and Inclusiveness are the core values that we aspire to live by each...

  • Principal Engineer – GenAI

    2 days ago

    Pune, Maharashtra, India Codvo Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Principal Engineer – GenAI & Applied AICompany OverviewAt Codvo, software and people transformations go hand-in-hand. We are a global empathy-led technology services company. Product innovation and mature software engineering are part of our core DNA. Respect, Fairness, Growth, Agility, and Inclusiveness are the core values that we aspire to live by each...

  • LLM Data Scientist

    2 weeks ago

    Pune, Maharashtra, India Gokloud Software Solutions Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Key ResponsibilitiesResponsible for building linguistic models, prompt engineering for large language models (LLM) and designing user interfaces that facilitate natural language input and output.Utilize proven hands-on experience with GPT architectures to design, train, and customize models for LLM, image-to-text, and/or text-to-image projects.Designing and...

  • Principal Data scientist

    16 hours ago

    Pune, Maharashtra, India, Maharashtra YASH Technologies Full time

    We are seeking a highly experienced and visionary Senior Principal Data Scientist to join our dynamic team. This role is pivotal in driving our organization's advanced analytics initiatives and shaping our data-driven strategy. As a thought leader, you will lead complex data science projects, mentor junior scientists, and collaborate with cross-functional...

  • Senior LLM Engineer

    1 week ago

    Pune, Maharashtra, India Infocusp Innovations Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About The RoleWe are looking for a Senior LLM engineer who can actively contribute to building cutting-edge GenAI applications.ResponsibilitiesBuild Gen-AI applications aligned to the business use casesDesign, and optimize prompts for multi-modal models based on the use caseTesting the created GenAI solutions and adding guardrails to prevent unintended/...

  • Principal Solution Architect

    1 week ago

    Pune, Maharashtra, India VidPro Consultancy Services Full time US$ 1,50,000 - US$ 2,00,000 per year

    Experience: 10-15 YearsWork Mode: Pune & HyderabadJob Type: FulltimeMandatory Skills: Solution Architect, Gen AI, LLM's, AI/ML, Python, Azure Cloud (Databricks, DataFactory, Azure Purview) or GCP (Big Query, Vertex.AI,Gemini) .Domain - BFSI, Retail, Supply Chain, OR Manufacturing.Role OverviewWe are seeking a highly experienced Principal Solution Architect...

  • Sr. LLM Developer

    1 week ago

    Pune, Maharashtra, India dentsu Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    We are looking for a Mid-Level LLM Application Developer with 3–5 years of experience in software development, who is passionate about building intelligent applications using Azure OpenAI, Python, and LLM frameworks. This is a full-time role focused on designing, developing, and deploying scalable LLM-powered solutions, including chatbots, knowledge...

  • LLM Engineer_4+Years

    1 week ago

    Pune, Maharashtra, India Zorba AI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company DescriptionAt Zorba AI, we harness the power of Generative AI to help businesses unlock new possibilities and streamline operations. As a cutting-edge Generative AI Solutions company, we specialize in building and integrating advanced AI capabilities that drive meaningful impact across industries. Our expertise ranges from custom AI copilots and...

  • Senior Software Engineer

    4 weeks ago

    Pune, Maharashtra, India Principal Global Services Full time

    Responsibilities Indicative years of experience 5 yearsRole Description Principal Pune is hiring a Mainframe Modernization - Sr Infrastructure Engineer This engineer will be a part of the Platform support under Information Services IS and responsible for helping achieve the strategy around availability of our Mainframe environment through adoption of...