> ## Documentation Index
> Fetch the complete documentation index at: https://toolathlon.xyz/llms.txt
> Use this file to discover all available pages before exploring further.

# VLM History Completer

> Research the models in the “Text and Image” worksheet of “Directory of Generative AI” and fill its Architecture and Sources columns according to Architecture.txt and Order.txt, entering “unavailable” when needed.

> **Toolathlon-Verified** · Website task ID `290` · Canonical task `vlm-history-completer`
>
> [View the task source at `d57361c0`](https://github.com/hkust-nlp/Toolathlon/tree/d57361c0f1582cf9a0675c0753315bb6b004bd0e/tasks/finalpool/vlm-history-completer)

## Required Tools

<Card>
  <div className="tools-container">
    <div className="mcp-servers-container">
      <div className="mcp-servers-title">
        MCP Servers
      </div>

      <div className="mcp-servers-grid">
        <div className="mcp-server-item">
          <img alt="" aria-hidden="true" src="https://mintcdn.com/hkust/QdN2Y6f6c_GBV7Vj/icons/playwright.png?fit=max&auto=format&n=QdN2Y6f6c_GBV7Vj&q=85&s=27cdb274e8bf99bd45e84d2b86110a06" style={{height: "20px", width: "20px", margin: 0, padding: 0, display: 'inline-block'}} width="64" height="64" data-path="icons/playwright.png" />

          <span className="mcp-server-name">playwright\_with\_chunk</span>
        </div>

        <div className="mcp-server-item">
          <img alt="" aria-hidden="true" src="https://mintcdn.com/hkust/QdN2Y6f6c_GBV7Vj/icons/google_sheet.png?fit=max&auto=format&n=QdN2Y6f6c_GBV7Vj&q=85&s=cfc5bfd3e57c319048ba7370f2bc57c0" style={{height: "20px", width: "20px", margin: 0, padding: 0, display: 'inline-block'}} width="64" height="64" data-path="icons/google_sheet.png" />

          <span className="mcp-server-name">google\_sheet</span>
        </div>

        <div className="mcp-server-item">
          <img alt="" aria-hidden="true" src="https://mintcdn.com/hkust/QdN2Y6f6c_GBV7Vj/icons/arxiv.png?fit=max&auto=format&n=QdN2Y6f6c_GBV7Vj&q=85&s=2c005fce10a43fe8852bb80992170ab2" style={{height: "20px", width: "20px", margin: 0, padding: 0, display: 'inline-block'}} width="64" height="64" data-path="icons/arxiv.png" />

          <span className="mcp-server-name">arxiv\_local</span>
        </div>

        <div className="mcp-server-item">
          <img alt="" aria-hidden="true" src="https://mintcdn.com/hkust/QdN2Y6f6c_GBV7Vj/icons/hf.png?fit=max&auto=format&n=QdN2Y6f6c_GBV7Vj&q=85&s=00acea2e881e1e50bfe7562bc1fdc1ed" style={{height: "20px", width: "20px", margin: 0, padding: 0, display: 'inline-block'}} width="64" height="64" data-path="icons/hf.png" />

          <span className="mcp-server-name">huggingface</span>
        </div>

        <div className="mcp-server-item">
          <img alt="" aria-hidden="true" src="https://mintcdn.com/hkust/ucpMq24upueB4g4R/icons/fetch.png?fit=max&auto=format&n=ucpMq24upueB4g4R&q=85&s=84d5b12d1720f1f17b5fb5c5b9901074" style={{height: "20px", width: "20px", margin: 0, padding: 0, display: 'inline-block'}} width="14" height="14" data-path="icons/fetch.png" />

          <span className="mcp-server-name">fetch</span>
        </div>
      </div>
    </div>

    <div className="local-tools-container">
      <div className="mcp-servers-title">
        Local Tools
      </div>

      <div className="local-tools-grid">
        <div className="local-tool-item">
          <img alt="" aria-hidden="true" src="https://mintcdn.com/hkust/ucpMq24upueB4g4R/icons/claim_done.png?fit=max&auto=format&n=ucpMq24upueB4g4R&q=85&s=94ee5a6cf860bae09936a702c6c6c648" style={{height: "20px", width: "20px", margin: 0, padding: 0, display: 'inline-block'}} width="14" height="14" data-path="icons/claim_done.png" />

          <span className="local-tool-name">claim\_done</span>
        </div>

        <div className="local-tool-item">
          <img alt="" aria-hidden="true" src="https://mintcdn.com/hkust/QdN2Y6f6c_GBV7Vj/icons/google_search.png?fit=max&auto=format&n=QdN2Y6f6c_GBV7Vj&q=85&s=97e296f59b192ca722abc473a9b8f609" style={{height: "20px", width: "20px", margin: 0, padding: 0, display: 'inline-block'}} width="64" height="64" data-path="icons/google_search.png" />

          <span className="local-tool-name">web\_search</span>
        </div>

        <div className="local-tool-item">
          <Icon icon="filter-list" size={20} color="#4286f6" />

          <span className="local-tool-name">handle\_overlong\_tool\_outputs</span>
        </div>

        <div className="local-tool-item">
          <Icon icon="bars-progress" size={20} color="#4286f6" />

          <span className="local-tool-name">manage\_context</span>
        </div>

        <div className="local-tool-item">
          <img alt="" aria-hidden="true" src="https://mintcdn.com/hkust/ucpMq24upueB4g4R/icons/history.png?fit=max&auto=format&n=ucpMq24upueB4g4R&q=85&s=25d885756cf14ced8475bd94adfdecb7" style={{height: "20px", width: "20px", margin: 0, padding: 0, display: 'inline-block'}} width="14" height="14" data-path="icons/history.png" />

          <span className="local-tool-name">history</span>
        </div>
      </div>
    </div>
  </div>
</Card>

## Instruction

Please help me organize and complete the development history of Vision Language Models (VLMs) in the `Text and Image` worksheet of `Directory of Generative AI` spreadsheet. It misses the "Architecture" and "Sources" columns.
So I need you to research the models listed, and then populate the following columns in the same worksheet:

* **Architecture column:** Fill in a description of each model's technical architecture. You can refer to the `Architecture.txt` file in the workspace for the specific types of descriptions required.
* **Sources column:** The requirements for filling this column are outlined in the `Order.txt` file in the workspace.
* If any information is not publicly available, please enter "unavailable".

## Initial State

### Local Workspace

<div className="file-tree">
  <a href="https://github.com/hkust-nlp/Toolathlon/tree/d57361c0f1582cf9a0675c0753315bb6b004bd0e/tasks/finalpool/vlm-history-completer/initial_workspace">workspace</a>/
  ├── Architecture.txt
  └── Order.txt
</div>

### Runtime Setup

This task initializes application or service state during preprocessing. [Review the pinned setup source](https://github.com/hkust-nlp/Toolathlon/tree/d57361c0f1582cf9a0675c0753315bb6b004bd0e/tasks/finalpool/vlm-history-completer/preprocess).

## Legacy Trajectories

<Warning>
  These replays were produced on the original Toolathlon release. They are retained for historical inspection and are not Toolathlon-Verified results.
</Warning>

* ❌ [Claude-4.5-Sonnet](https://toolathlon-traj.xyz/claude-4.5-sonnet_vlm-history-completer)
* ❌ [Deepseek-v3.2-Exp](https://toolathlon-traj.xyz/deepseek-v3.2-exp_vlm-history-completer)