Research Intern – Agentic AI Benchmarking

3 days ago

Bengaluru, Karnataka, India CraftifAI Full time ₹ 9,00,000 - ₹ 12,00,000 per year

About CraftifAI

CraftifAI is pioneering Agentic GenAI for embedded and edge systems, combining LLMs, multi-modal models, and heterogeneous compute optimization into one platform. We are building the next generation of AI development workflows that are silicon-agnostic, hardware-optimized, and capable of real-world autonomy at the edge.Role Overview:

We are seeking a Research Intern to explore and develop benchmarking methodologies for Agentic AI products. The focus will be on evaluating how agentic workflows perform in real-world edge scenarios across dimensions like accuracy, reasoning ability, robustness, latency, memory, and power efficiency. This role is ideal for graduate students or early-career researchers who want to contribute to benchmarking standards and research in Agentic AI.Role Type: Internship (6 months, with potential full time opportunity)

Key Responsibilities:

  • Research, design, and implement benchmarking frameworks tailored for agentic AI systems.
  • Benchmark CraftifAI's Agentic workflows on heterogeneous edge platforms (e.g., NVIDIA Jetson Orin/Thor, Hailo, Rockchip,  ModAIX).
  • Develop evaluation datasets and tasks that reflect real-world edge scenarios (vision + language, decision-making, multi-step reasoning).
  • Adapt and extend existing AI benchmarks (HELM, BIG-bench, AgentBench, GAIA) for embedded and edge constraints.
  • Profile and report performance on latency, throughput, energy efficiency, and robustness.
  • Document findings in technical reports, research notes, or potential publications.

Preferred Background:

  • Enrolled in or recently completed a Master's or PhD in Computer Science, Electrical/Computer Engineering, or related field.
  • Research interest in LLMs, Agentic AI, or AI evaluation/benchmarking.
  • Familiarity with AI frameworks (PyTorch, TensorFlow, Hugging Face, LangChain, AutoGen).
  • Exposure to edge/embedded AI hardware (Nvidia Jetson, Qualcomm, NXP, TI, , etc.).
  • Strong programming skills in Python (C++ a plus).
  • Experience with experimental design, evaluation metrics, or benchmark development is a strong plus.

What will you gain?

  • Hands-on experience defining how Agentic AI is measured in real-world scenarios.
  • Opportunity to contribute to benchmarking research and open-source tools.
  • Exposure to cutting-edge heterogeneous compute platforms.
  • Work alongside a founder-led team shaping the future of Agentic AI

Industry

  • Embedded Software Products

Employment Type

Full-time

  • Agentic AI Intern

    2 weeks ago

    Bengaluru, Karnataka, India DeepCognix AI Labs Full time ₹ 3,00,000 - ₹ 6,00,000 per year

    Company DescriptionDeepCognix is a cutting-edge Research and Development firm committed to advancing the frontiers of Artificial Intelligence. We transform ideas into impactful, intelligent solutions through rigorous research, ethical innovation, and cross-disciplinary collaboration. Specializing in deep learning, natural language processing, and AI-powered...

  • Agentic AI Developer

    7 hours ago

    Bengaluru, Karnataka, India ETG Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are seeking a forward-thinking and detail oriented Agentic AI Developer to join our AI Research and Development team. In this role, you will design, implement, and optimize autonomous AI agents capable of reasoning, decision-making, planning, and interacting with dynamic environments and toolchains. You will be building cutting-edge systems at the...

  • Machine Learning Research Intern

    3 days ago

    Bengaluru, Karnataka, India Tonks AI Full time ₹ 9,60,000 per year

    Length: 2 monthsStipend: 80000/monthWill strongly prefer hiring from IITs/IISc/BITS etc2025 or 2026 grads.Will be open if you already have a full-time offer but joining is at a later dateJoining: ImmediateAbout Tonks AIAt Tonks AI, we generate high-quality sim-ready environments and scenarios to bridge the sim-to-real gap for autonomous systems. Our platform...

  • AI Engineer, Agentic AI – Bengaluru

    2 weeks ago

    Bengaluru, Karnataka, India KronosX AI Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About KronosXKronosX AI is building the agentic data infrastructure layerfor the next generation of enterprises. We're solving data chaos in regulated industries withautonomous AI agentsand production-ready automation. Your RoleThis is a startup role,we're only looking for engineers who are truly cut out for startups: hands-on builders who thrive in fast,...

  • Agentic AI Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Copperpod AI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Location: BangaloreCommitment: Full-time Role SummaryJob experience : 6-10 yearsWe're seeking a Python-focused engineer skilled in AI and agentic workflows. You'll build anddeploy agents that reason, integrate tools, and automate tasks—serving as our first hire in this area.ResponsibilitiesDevelop workflows where agents act autonomously. E.g., document...

  • Agentic AI Platform

    2 weeks ago

    Bengaluru, Karnataka, India Uberlife Consulting Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    REQUIRED CRITERIA •Bachelors degree in Computer Science, Engineering, Data Science, or equivalent practical experience. • 6+ years in product management, including 2+ years delivering ML- or AI-powered features. • Working knowledge of the ML lifecycle, with a strong emphasis on LLMs, prompt-engineering, and generative model evaluation techniques. •...

  • AI Agent Engineer

    7 days ago

    Bengaluru, Karnataka, India GE Vernova Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    Job Description SummaryGE Vernova is embracing cutting-edge technologies to streamline operations, improve customer experiences, and drive growth. As part of this vision, we are building a dedicated team to leverage Generative AI and redefine how we engage with our industry. The ultimate goal of the team is to automate prompting, develop a framework for...

  • AI Agent Engineer

    17 minutes ago

    Bengaluru, Karnataka, India GE Vernova Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job Description SummaryGE Vernova is embracing cutting-edge technologies to streamline operations, improve customer experiences, and drive growth. As part of this vision, we are building a dedicated team to leverage Generative AI and redefine how we engage with our industry. The ultimate goal of the team is to automate prompting, develop a framework for...

  • AI Research

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    I hope you're doing well I came across your profile and was impressed by your extensive experience as an/a (mention role/skill). We have a similar opportunity to join our dynamic team at TCS.Role: AI Research / Data Scientist (Masters)Location: Chennai/Bangalore/Pune/HyderabadMode: Full TimeJob Summary: We are looking for a highly skilled and motivated GenAI...

  • Agentic AI

    4 hours ago

    Bengaluru, Karnataka, India Bosch Full time ₹ 2,00,000 - ₹ 6,00,000 per year

    Company DescriptionBosch Global Software Technologies Private Limited is a 100% owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of technology and services, offering end-to-end Engineering, IT and Business Solutions. With over 28,200+ associates, it's the largest software development center of Bosch, outside Germany,...