huangdaxianer/dsh-dual-model-eval
DeepSeek Harness plugin for isolated side-by-side multi-model coding evaluation
Runs a multi-model evaluation from inside DeepSeek Harness: the README documents what it adds, a use section, and Git/workspace behaviour. Because evaluation needs isolated workspaces per model, the plugin can create Git worktrees and local commits inside the workspace you select — the README is explicit that it does not push those commits, and its security section repeats the general caution that DeepSeek Harness plugins execute with the permissions of the local user and that you should inspect the source and pin a release tag or commit before installing any third-party plugin.
Install
npx @deepseek-ai/dsh@0.1.0-rc.7 plugin --profile web add github:huangdaxianer/dsh-dual-model-eval#v0.1.1README install, quoted verbatim: npx @deepseek-ai/dsh@0.1.0-rc.7 plugin --profile web add github:huangdaxianer/dsh-dual-model-eval#v0.1.1 — a pinned release into the built-in web profile. Update with the same command (it re-resolves the tag) and remove with npx @deepseek-ai/dsh@0.1.0-rc.7 plugin --profile web remove dsh-dual-model-eval. The README targets DeepSeek Harness 0.1.0-rc.7 (dev-preview APIs may change between release candidates); development needs Node.js 22.19+ (or 24+), pnpm and Git, with pnpm run pack:release. No npm package is published (dsh-dual-model-eval returned 404 on registry.npmjs.org on 2026-09-12).
Compatibility
DeepSeek Harness 0.1.0-rc.7 (installed via the matching npx @deepseek-ai/dsh@0.1.0-rc.7 binary). Development requirements: Node.js 22.19+ (or 24+), pnpm and Git. The README's security note warns that DSH plugins run with local-user permissions and that this one can create Git worktrees and local commits inside the selected workspace (it does not push them).
Details
- Repo: huangdaxianer/dsh-dual-model-eval
- Category: Coding & Development
- Stars: 0
- Version: GitHub release v0.1.1 (README targets @deepseek-ai/dsh 0.1.0-rc.7; no npm package)
- Last push: 2026-08-19
- First seen: 2026-08-18
Recent updates
The README documents the compatibility contract (first release targets 0.1.0-rc.7, with APIs subject to change between release candidates) and the security posture (plugins run with local-user permissions; this plugin can create Git worktrees and local commits but does not push them). Update and remove commands are given as the same pinned npx ... plugin invocations.
FAQ
- How do I install dsh-dual-model-eval?
- npx @deepseek-ai/dsh@0.1.0-rc.7 plugin --profile web add github:huangdaxianer/dsh-dual-model-eval#v0.1.1 — the README's command, pinned to release v0.1.1.
- Which harness version does it need?
- DeepSeek Harness 0.1.0-rc.7 per the README (it is a dev preview, so plugin APIs may change between release candidates).
- Does it modify my repository?
- It can create Git worktrees and local commits inside the workspace you select for the evaluation; the README states it does not push those commits and warns that plugins run with local-user permissions.
Alternatives
nexu-io/open-design · dsh-market/dsh-market · xiufengsun-tokenracker