Sample report
A real run of the same checks every package gets, against Toolmark's own example server. We built that server with planted flaws so that every kind of finding shows up. It is not a published package.
Your own reports look like this and stay private: only people with the link can see them. This one is public on purpose.
toolmark-example-server 1.0.0
Run 2026-11-18. Private: anyone with this link can see it; Toolmark does not publish it unless the package owner does.
5 tools declared: 4 called, 1 not called. Checks: 1 passed, 1 failed, 3 notes to review.
Not a rating; there is no score.
Action needed
get_status, send_digestget_statusread_notePackage facts
- tool list size: 786 bytes as JSON (names, descriptions and input schemas of 5 tools)
Tools
Not tested is never counted against a tool.
| Tool | What we did | Detail |
|---|---|---|
search_notes | called | responded without an error flag to synthetic input (observation, not a verified claim) passed: rejects input outside its schema |
read_note | called | responded without an error flag to synthetic input (observation, not a verified claim) files: changed files in Toolmark's data folder although it declares readOnlyHint: true (review item, not judged yet: may be a false positive): /fixture/.last_read (1 changes in total) |
get_status | called | result text looks like a failure without the error flag (untrusted; for review, not a verdict): status unavailable: fetch failed (index service unreachable) |
count_words | called | output violates its own outputSchema: '1' is not of type 'integer' |
send_digest | not called | not called: outward-facing or cannot be judged: outward verb in name: 'send'; changes something but does not declare openWorldHint=false: it may change a real account or remote system; outward verb in description: 'Emails'; outward arguments: ['to'] |
How this was tested
Only the published package was run, at this exact version, in Toolmark's sandbox with no network and no secrets, with synthetic input; the provider's hosted service, if any, was not tested. server Toolmark's own example server (first-party, in memory), toolmark 0.1.0