Skip to main content
Toolathlon-Verified · Website task ID 294 · Canonical task experiments-recordings View the task source at d57361c0

​
Required Tools

MCP Servers
notion
wandb
terminal
filesystem
Local Tools
claim_done
python_execute
handle_overlong_tool_outputs
manage_context
history

​
Instruction

In the table of the Notion page mcp_experiments_recordings, based on the historical experiments of W&B project mbzuai-llm/Guru, list the highest val-core acc mean@1/mean@k scores for each benchmark according to the table headers, and calculate and fill in the Best Step for that run (format: step(average acc)). Instructions:
  • If multiple runs have the same name, treat them as one run for combined statistics.
  • The average score should only be calculated using the arithmetic mean of metrics available at that step; missing metrics are not included.
  • Only operate on the target page under the specified parent page; do not change column names or order.

​
Initial State

​
Local Workspace

workspace/ └── table_template.txt

​
Runtime Setup

This task initializes application or service state during preprocessing. Review the pinned setup source.

​
Legacy Trajectories

These replays were produced on the original Toolathlon release. They are retained for historical inspection and are not Toolathlon-Verified results.