DSH HUB
HomePlugin StorePlugin PacksCommunityRankingsResourcesPublish Guide
Plugin source
Back to catalog

PerryLink /

PerryLink/dsh-attention-index

Topic repository only

Public, reproducible, task-conditioned scores and attention allocation for DeepSeek Harness plugins.

★ 0 Stars0 Forks0 IssuesN/A Community rating0 Confirmed installs
View on GitHubProject homepage
READMESource: main@0c4aed67

🏆 dsh-score

Public evidence for DeepSeek Harness plugins — and an explicit rule for who gets community attention.

Prior is discovery. A quality claim needs a paired result, a grade, and an independent path.

CI Pages API GitCode License DSH plugin

English · 简体中文

# public evidence (this repo)
open https://perrylink.github.io/dsh-attention-index/

# in-app consumer
dsh plugin --profile web add dsh-community-bench

dsh-score: public evidence, E0 unrated, E2 provisional, no quality #1Animated dsh-score demo: prior is discovery, not a quality claim

The same rule, animated.

Why this exists

Plugin discovery is not a popularity contest, and a download count is not a task-outcome claim. dsh-score separates four things that used to be mixed:

  1. Discovery — is this plugin maintained and visible?
  2. Evidence — was it run with and without on the same task?
  3. Grade — how strong is that evidence (E0–E5)?
  4. Attention — only a positive, adequately powered result gets a quality slot.

At v0.1 the answer is deliberately uncomfortable: there is no quality #1.

Current state

Metric Value
Plugins 42
Capability surfaces 15
Tasks 39 (24 executable pilot + 15 draft)
Signed results 30
E0 / unrated 41
E2 / provisional 1 (a null pilot)
E3+ / positive 0
Quality #1 none
Public contributions 0

The first pilot is dsh-memento@0.5.27 on five memory tasks × three runs/arm. Both arms passed every task: it is a null result, capped at E2 because the task pack is unreviewed, the runner is operator-owned, and the sandbox is network-isolated but not seccomp-hardened. rank is null; top3 is empty.

What a grade means

dsh-score grade ladder: E0 unrated, E1 screened, E2 provisional, E3 measured, E4 replicated, E5 audited
Grade Meaning Quality slot?
E0 unrated — metadata only, no outcome evidence No
E1 screened — executable task + fixture hash No
E2 provisional — paired pilot; review/sandbox/independence incomplete No
E3 measured — ≥5 reviewed tasks, ≥5 runs/arm, positive LCB Yes
E4 replicated — ≥2 independent runners, consistent direction Yes
E5 audited — independent audit + pre-registration Yes

Hard gates: an unreviewed pack or a partial sandbox caps at E2; E5 requires an independent audit in data/audits/index.json. No prior-only row can receive a quality rank. No one can buy a slot.

Full model: docs/SOE-GOE.md · SCORING.md.

What is public

Artifact What it is
Evidence site Human view; E0/unrated is visible, not hidden
data/registry.json Single machine-readable registry
api/v1/registry.json Versioned snapshot + etag
integrations/market/signals.json Decoration sidecar for markets; not a ranking input
badges/index.json Per-plugin badge; unrated is explicit
integrations/dsh-recommend/bench-feed.json Sidecar for dsh-recommend
data/results/ 30 signed arm results (15 pairs; hashes, no session text)
curl https://perrylink.github.io/dsh-attention-index/api/v1/registry.json

Quick start

# 1. Recompute the registry deterministically
node scripts/aggregate.mjs --today 2026-10-18

# 2. Contract checks
node scripts/check-invariants.mjs
node scripts/conformance.mjs
node --test test/*.test.mjs

# 3. Preview the site
python3 -m http.server 8765 --directory site

The pipeline

task pack (pilot, unreviewed)
  → paired with/without runs
  → signed result + environment manifest + fixture hash
  → strict ingest (signature, fixture, duplicate)
  → Newcombe interval + SOE/GOE grade
  → E0/E1 no rank · E2 provisional · E3+ positive quality slot
  • P1 measured-evidence runbook
  • Sandbox requirements
  • P2 integration contract
  • P3 audit checklist
  • P0–P3 status

Not done yet

  • A seccomp/cgroup-hardened sandbox; current bwrap-net has FS/PID/network isolation and a DeepSeek-only egress proxy, but no seccomp.
  • Task review and an independent runner for E3+.
  • FDR/bootstrap are implemented but not wired; holdouts, version binding and token accounting remain.
  • Signed snapshot history and a third-party market pilot.
  • E5 (independent audit) — a self-review is published, but it is not E5.
  • Repository rename to dsh-score-index; URLs are intentionally stable.

No fabricated results. No prior-only #1. No paid rank.

DSH plugin family

Project Role
dsh-score Local, on-demand prior inspector (five dimensions)
dsh-score index (this repo) Public, version-bound evidence layer
dsh-community-bench In-app consumer: reads the public registry; no local scoring
dsh-kit One-command starter pack for the family
PerryLink 40+ Apache-2.0 DSH plugins

⭐ 如果它帮到了你

这个项目是 DSH 插件家族的一员(40+ 个,全部 Apache-2.0)。如果你在用,给个 star —— 它不会解锁任何功能,但会让下一个人在搜索里更容易找到它。

English: part of a 40+ plugin family for DeepSeek Harness. If it is useful, a star helps the next person find it — nothing is gated behind it.

License

Apache-2.0. See LICENSE.

—/ 5

No ratings yet

Manifest verification required

Commit 0c4aed67e943

Community comments

No comments yet. Be the first to write one.

DSH HUB

A community index for DSH plugins. Not an official GitHub or DeepSeek AI product.

CommunityResourcesAPIAbout