Toolmark Check a package

Sample report

A real run of the same checks every package gets, against Toolmark's own example server. We built that server with planted flaws so that every kind of finding shows up. It is not a published package.

Your own reports look like this and stay private: only people with the link can see them. This one is public on purpose.

toolmark-example-server 1.0.0

Run 2026-11-18. Private: anyone with this link can see it; Toolmark does not publish it unless the package owner does.

5 tools declared: 4 called, 1 not called. Checks: 1 passed, 1 failed, 3 notes to review.
Not a rating; there is no score.

Action needed

Tools with no safety hints at all, so an agent cannot tell from the list which tools only read
get_status, send_digest
A normal result whose text looks like a failure without the MCP error flag (found by matching words; may be a false positive)
get_status
A tool changed files in Toolmark's data folder although its hints say it would not (paths in the tools table; not judged yet, may be a false positive)
read_note

Package facts

  • tool list size: 786 bytes as JSON (names, descriptions and input schemas of 5 tools)

Tools

Not tested is never counted against a tool.

ToolWhat we didDetail
search_notescalledresponded without an error flag to synthetic input (observation, not a verified claim)
passed: rejects input outside its schema
read_notecalledresponded without an error flag to synthetic input (observation, not a verified claim)
files: changed files in Toolmark's data folder although it declares readOnlyHint: true (review item, not judged yet: may be a false positive): /fixture/.last_read (1 changes in total)
get_statuscalledresult text looks like a failure without the error flag (untrusted; for review, not a verdict): status unavailable: fetch failed (index service unreachable)
count_wordscalledoutput violates its own outputSchema: '1' is not of type 'integer'
send_digestnot callednot called: outward-facing or cannot be judged: outward verb in name: 'send'; changes something but does not declare openWorldHint=false: it may change a real account or remote system; outward verb in description: 'Emails'; outward arguments: ['to']

How this was tested

    Only the published package was run, at this exact version, in Toolmark's sandbox with no network and no secrets, with synthetic input; the provider's hosted service, if any, was not tested. server Toolmark's own example server (first-party, in memory), toolmark 0.1.0