Skip to main content
Toolathlon-Verified · Website task ID 280 · Canonical task llm-training-dataset View the task source at d57361c0

​
Required Tools

MCP Servers
playwright_with_chunk
google_sheet
scholarly
fetch
Local Tools
web_search
python_execute
claim_done
handle_overlong_tool_outputs
manage_context
history

​
Instruction

I’ve been learning about large-scale language models recently, and I’ve decided to train a decoder-only language model on my own. The first step is to prepare pre-training data, so I need your help organizing the pre-training data for llama and gpt-neo into the ptdata sheet in LLM Pre-training Data spreadsheet. The pre-training data should be sorted in descending order by data size, with columns named name, use in llm (the value in each row must be either llama or gpt-neo), size (the numeric value in GB, but do not include “GB” in cell), and link in order. If a dataset is used by both models, list it separately for llama and gpt-neo because the model-specific data sizes may be different. The link to huggingface is preferred; if huggingface doesn’t have the dataset, we’ll try to provide other links.

​
Initial State

​
Runtime Setup

This task initializes application or service state during preprocessing. Review the pinned setup source.

​
Legacy Trajectories

These replays were produced on the original Toolathlon release. They are retained for historical inspection and are not Toolathlon-Verified results.