Research Intern – Agentic AI Benchmarking

5 days ago

Bengaluru, Karnataka, India CraftifAI Full time ₹ 9,00,000 - ₹ 12,00,000 per year

About CraftifAI

CraftifAI is pioneering Agentic GenAI for embedded and edge systems, combining LLMs, multi-modal models, and heterogeneous compute optimization into one platform. We are building the next generation of AI development workflows that are silicon-agnostic, hardware-optimized, and capable of real-world autonomy at the edge.Role Overview:

We are seeking a Research Intern to explore and develop benchmarking methodologies for Agentic AI products. The focus will be on evaluating how agentic workflows perform in real-world edge scenarios across dimensions like accuracy, reasoning ability, robustness, latency, memory, and power efficiency. This role is ideal for graduate students or early-career researchers who want to contribute to benchmarking standards and research in Agentic AI.Role Type: Internship (6 months, with potential full time opportunity)

Key Responsibilities:

  • Research, design, and implement benchmarking frameworks tailored for agentic AI systems.
  • Benchmark CraftifAI's Agentic workflows on heterogeneous edge platforms (e.g., NVIDIA Jetson Orin/Thor, Hailo, Rockchip,  ModAIX).
  • Develop evaluation datasets and tasks that reflect real-world edge scenarios (vision + language, decision-making, multi-step reasoning).
  • Adapt and extend existing AI benchmarks (HELM, BIG-bench, AgentBench, GAIA) for embedded and edge constraints.
  • Profile and report performance on latency, throughput, energy efficiency, and robustness.
  • Document findings in technical reports, research notes, or potential publications.

Preferred Background:

  • Enrolled in or recently completed a Master's or PhD in Computer Science, Electrical/Computer Engineering, or related field.
  • Research interest in LLMs, Agentic AI, or AI evaluation/benchmarking.
  • Familiarity with AI frameworks (PyTorch, TensorFlow, Hugging Face, LangChain, AutoGen).
  • Exposure to edge/embedded AI hardware (Nvidia Jetson, Qualcomm, NXP, TI, , etc.).
  • Strong programming skills in Python (C++ a plus).
  • Experience with experimental design, evaluation metrics, or benchmark development is a strong plus.

What will you gain?

  • Hands-on experience defining how Agentic AI is measured in real-world scenarios.
  • Opportunity to contribute to benchmarking research and open-source tools.
  • Exposure to cutting-edge heterogeneous compute platforms.
  • Work alongside a founder-led team shaping the future of Agentic AI

Industry

  • Embedded Software Products

Employment Type

Full-time

  • Agentic Ai Engineer

    4 days ago

    Bengaluru, Karnataka, India Weekday AI Full time ₹ 50,00,000 - ₹ 80,00,000 per year

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 5-8 LPA)Min Experience: 3 yearsLocation: bangaloreJobType: full-timeAs an Agentic AI Engineer, you will design and build advanced AI-driven voice and conversational systems using LLMs, agentic frameworks, and speech intelligence models. This role involves developing scalable AI agents,...

  • Agentic Ai Engineer

    4 days ago

    Bengaluru, Karnataka, India Weekday AI Full time ₹ 5,00,000 - ₹ 8,00,000

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 5-8 LPA)Min Experience: 3 yearsLocation: bangaloreJobType: full-timeAs an Agentic AI Engineer, you will design and build advanced AI-driven voice and conversational systems using LLMs, agentic frameworks, and speech intelligence models. This role involves developing scalable AI agents,...

  • Agentic Ai Engineer

    4 days ago

    Bengaluru, Karnataka, India Weekday AI Full time ₹ 50,00,000 - ₹ 80,00,000 per year

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 5-8 LPA)Min Experience: 3 yearsLocation: bangaloreJobType: full-time As an Agentic AI Engineer, you will design and build advanced AI-driven voice and conversational systems using LLMs, agentic frameworks, and speech intelligence models. This role involves developing scalable AI agents,...

  • Agentic Ai Engineer

    3 days ago

    Bengaluru, Karnataka, India Weekday AI (YC W21) Full time ₹ 50,00,000 - ₹ 80,00,000 per year

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 5-8 LPA)Min Experience: 3 yearsLocation: bangaloreJobType: full-timeAs an Agentic AI Engineer, you will design and build advanced AI-driven voice and conversational systems using LLMs, agentic frameworks, and speech intelligence models. This role involves developing scalable AI agents,...

  • Agentic AI Infrastructure

    1 week ago

    Bengaluru, Karnataka, India InOpTra Digital Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    Looking for USA local candidates.Location- Remote WorkKey ResponsibilitiesArchitect and deploy agentic multi-agent AI frameworks.Develop scalable pipelines integrating LLM → RAG → VectorDB → AgentsBuild and deploy MCP server for Agentic AI Agents and IntegrationBuild observability, latency optimization, and performance monitoring systems.Implement...

  • AI Agent Development Intern

    4 days ago

    Bengaluru, Karnataka, India Smartkeen Tech | NetSuite , Workato, Celigo & Boomi Solution Provider Full time ₹ 3,00,000 - ₹ 6,00,000 per year

    We're Hiring: AI Agent Development InternAre you passionate about building intelligent AI agents, automation, and next-generation workflow orchestration?Smartkeen Technologies Pvt Ltd is looking for an innovative and drivenAI Agent Development Internto join our AI engineering team and gain hands-on experience in building real-world autonomous AI...

  • Agentic AI Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Copperpod AI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Location: BangaloreCommitment: Full-time Role SummaryJob experience : 6-10 yearsWe're seeking a Python-focused engineer skilled in AI and agentic workflows. You'll build anddeploy agents that reason, integrate tools, and automate tasks—serving as our first hire in this area.ResponsibilitiesDevelop workflows where agents act autonomously. E.g., document...

  • Agentic AI architects/engineers

    1 week ago

    Bengaluru, Karnataka, India Xohani Solutions Full time ₹ 15,00,000 - ₹ 22,00,000 per year

    Job role: Responsible AI Engineer – Bangalore,Chennai Job Type: FulltimeJob Mode: Onsite/ Bangalore, Chennai Experience: 8yrsAgentic AI architects/engineers – 8+ yrs experienceAgentic AI architects with deep knowledge of building Gen AI/ Agentic Ai products.Mandatory Skills:Deep learning (CNN , RNN ,GAN , Transformers , Encoder and decoder architecture),...

  • AI Agent Engineer

    1 week ago

    Bengaluru, Karnataka, India GE Vernova Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description SummaryGE Vernova is embracing cutting-edge technologies to streamline operations, improve customer experiences, and drive growth. As part of this vision, we are building a dedicated team to leverage Generative AI and redefine how we engage with our industry. The ultimate goal of the team is to automate prompting, develop a framework for...

  • Agentic Marketing Manager

    4 days ago

    Bengaluru, Karnataka, India Nagent AI Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Marketing Manager – Nagent AIExperience: 3–5 years | Location: Bengaluru (onsite)Reporting: Co-founder & CEOCompany DescriptionNagent AI helps enterprises harness the power of Agentic AI through a state-of-the-art platform that lets teams build, deploy, and scale AI Agents. With 200+ prebuilt agents across marketing, operations, research, and...