Arrow Research search

Author name cluster

Daniel Kang

Possible papers associated with this exact author name in Arrow. This page groups case-insensitive exact name matches and is not a full identity disambiguation profile.

2 papers
1 author row

Possible papers

2

NeurIPS Conference 2025 Conference Paper

Establishing Best Practices in Building Rigorous Agentic Benchmarks

  • Yuxuan Zhu
  • Tengjun Jin
  • Yada Pruksachatkun
  • Andy Zhang
  • Shu Liu
  • Sasha Cui
  • Sayash Kapoor
  • Shayne Longpre

Benchmarks are essential for quantitatively tracking progress in AI. As AI agents become increasingly capable, researchers and practitioners have introduced agentic benchmarks to evaluate agents on complex, real-world tasks. These benchmarks typically measure agent capabilities by evaluating task outcomes via specific reward designs. However, we show that many agentic benchmarks have issues in task setup or reward design. For example, SWE-bench-Verified uses insufficient test cases, while $\tau$-bench counts empty responses as successes. Such issues can lead to under- or overestimation of agents’ performance by up to 100% in relative terms. To make agentic evaluation rigorous, we introduce the Agentic Benchmark Checklist (ABC), a set of guidelines that we synthesized from our benchmark-building experience, a survey of best practices, and previously reported issues. When applied to CVE-Bench, a benchmark with a particularly complex evaluation design, ABC reduces performance overestimation by 33%.

PDF Details

RLDM Conference 2019 Conference Abstract

Reinforcement Learning for Network Offloading in Cloud Robotics

  • Sandeep Chinchali
  • Apoorva Sharma
  • Amine Elhafsi
  • Daniel Kang
  • Evgenya Perga-
  • Eyal Cidon
  • Sachin Katti

We apply deep reinforcement learning to a central decision-making problem in robotics - when should a robot use its on-board compute model or, in cases of local uncertainty, query a compute-intensive model in “the cloud”? Today’s robotic systems are increasingly turning to computationally expensive mod- els such as deep neural networks (DNNs) for tasks like object detection, perception and planning. However, resource-constrained robots, like low-power drones, often have insufficient on-board compute resources or power reserves to scalably run the most accurate, state-of-the art neural network compute models. Cloud robotics allows mobile robots to offload compute to centralized servers if they are uncertain locally or want to run more accurate, compute-intensive models. However, cloud robotics comes with a key, often un- derstated cost: communicating with the cloud over congested wireless networks may result in latency and increase network congestion. In fact, sending high data-rate video or LIDAR from multiple robots over congested networks can lead to prohibitive delay for real-time applications. We formulate a novel Robot Offloading Problem — how and when should robots offload sensing tasks, especially if they are uncertain, to improve accuracy while minimizing the cost of cloud communication? We formulate offloading as a sequential decision making problem for robots, and propose a solution using deep reinforcement learning. In both simulations and practical hardware experiments using state-of-the art vision DNNs, our offloading strategy improves vision task performance by between 1. 3-2. 6x of benchmark offloading strategies. We conclude by showing how cloud offloading has an inherent exploration vs. exploitation trade-off since a robot must balance use of a known local model (exploitation) with learning context-dependent utility of the cloud (exploration). Accordingly, we discuss how our model is widely applicable beyond cloud robotics.

PDF Details
v2026.09.13