LunFengChen/dsh-failover-queue

CC Switch-style P1/P2/P3 model failover for dsh: reorder priority by dragging, and skip the same-route retry wait on auth, rate-limit, server or timeout errors.

A P1/P- chip on the composer toggles auto failover, drag-reorders priority (P1 primary, P2/P3 backup) and opens the queue editor. On failure, same-route llm-retry runs first; AUTH, RATE_LIMIT, NO_ADAPTER, SERVER, TIMEOUT and TRANSPORT skip that wait, open the circuit and jump to the next P — so a 503 does not sit through twenty identical retries before failing over. HalfOpen probing afterwards means a recovered primary is retried rather than abandoned for the rest of the session.

Models & Providers ★ 0
View on GitHub ↗

Install

dsh plugin --profile web add github:LunFengChen/dsh-failover-queue

The GitHub install line from the README. Three names are worth keeping straight, and the README tabulates them: GitHub LunFengChen/dsh-failover-queue, npm/package @x1a0f3n9/dsh-failover-queue, plugin id and settings namespace dsh-failover-queue. A local-checkout form taking a path is also documented.

Compatibility

After installing, reload the Web GUI — the composer shows a P- chip and Settings gains a Failover page with the same queue editor. Routes are added from the live provider+model catalog. Cooldown behaviour is explicit: after cooldownMs, P1 goes HalfOpen and the next request probes it, so failover is not sticky. While enabled, requests prefer the first healthy P rather than the session picker, which is a behaviour change worth knowing before you turn it on.

Details

Alternatives

KEVINCHEN625/dsh-provider-manager · BruceLanLan/dsh-tier-router · minglu6/dsh-provider-qoder

More plugins in Models & Providers

Browse more in Models & Providers

Guides for Models & Providers plugins