dsh-eval-pack
Official repository. The only official repository of this package, maintained by PerryLink. Same-name repositories under other accounts are not affiliated. Apache-2.0.
Public/synthetic eval-pack lint and deterministic JSON grader; not a validated benchmark.
Status: alpha / public-synthetic / partial / not counted / not GA. No customer evidence, customer data, or production-readiness claim.
English · 简体中文 · Español · Português · हिन्दी
dsh plugin --profile <profile> add dsh-eval-pack
⭐ If this helps, a star makes it easier for the next person to find it. Nothing is gated behind it.
Workflow: local input → plugin → local output. No model call is required.
Install
Install and verify:
dsh plugin --profile <profile> add dsh-eval-pack
dsh --profile <profile> --dump-config | grep dsh-eval-pack
Uninstall:
dsh plugin --profile <profile> remove dsh-eval-pack
What it does
Public/synthetic eval-pack lint and deterministic JSON grader; not a validated benchmark. Runs locally on DeepSeek Harness. The table below is the exact tool surface; the examples use the real command surface.
Input and output stay local; nothing is uploaded.
Tools
Tool names and descriptions are kept in English to match the runtime output.
| Tool | Purpose | Risk |
|---|---|---|
eval.pack_lint |
Validate eval-pack name/version and unique task ids | R0 |
eval.grade |
Deterministic JSON equality grade | R0 |
Quick start
dsh plugin --profile <profile> add dsh-eval-pack
dsh --profile <profile> --dump-config | grep dsh-eval-pack
Limits
- Public/synthetic only; no customer data or customer evidence.
- Alpha/partial, not counted, no GA or production-readiness claim.
- No model or network call unless a tool explicitly says so.
- The exact per-tool boundaries are in the table and
ACCEPTANCE.csv.
Public sample
Public/synthetic fixtures live in test/fixtures/; ACCEPTANCE.csv records the public checks with counted=false.
Development
pnpm install --frozen-lockfile
pnpm build && pnpm lint && pnpm typecheck && pnpm test
Compatibility
| Surface | Status |
|---|---|
| Harness | dsh >=0.2.1-rc.3 <0.3.0 |
| Node | >=24.9.0 <25 |
| Platforms | All; local files only |
| Data | No network, no model call, no upload |
Permissions & data
- Runs locally; no network, no model call, no upload.
- Public/synthetic fixtures only; no customer data, no customer evidence.
- Alpha/partial; not counted, no GA or production-readiness claim.
- Frozen packages stay installable; no new features, only genuine breakage fixes.
Related work
Sibling packages and family indexes: dsh-policy-ledger · dsh-pim-lint
Family
DSH domain plugin family (15 packages + 2 suites)License
Apache-2.0. See LICENSE, NOTICE, THIRD-PARTY-NOTICES.
No comments yet. Be the first to write one.