GreyRaphael/dsh-web-fetch-moli

dsh-web-fetch-moli provides a Moli backend for the DSH web_fetch tool: a Rust headless browser daemon uses ~50-60 MB of RAM (over 90% less than Chromium/Playwright), bypasses CSP and certificate errors, drives micro-frontends and dynamic SPAs via CDP layout materialisation, and runs a two-stage LinkeDOM + Readability denoise followed by mdream conversion to return clean LLM-optimized GitHub Flavored Markdown, with the Moli binary auto-downloaded on first use.

dsh-web-fetch-moli gives the DSH web_fetch tool a Moli backend, the ultra-lightweight Rust headless browser, so page fetches render dynamic micro-frontends, single-page apps and static sites at roughly a 50-60 MB memory footprint - over 90% less than the ~1 GB of standard Chromium/Playwright - which allows high concurrency on constrained servers. It bypasses Content Security Policy (Page.setBypassCSP), ignores certificate errors and bypasses Service Worker caching, drives native Moli layout-tree computation via CDP Micro-Clip layout materialisation and scrolls with the W3C standard scrollIntoView, so complex micro-frontends (Alibaba Alfa, qiankun, single-spa) that defeat other lightweight engines still render. A two-stage denoise pipeline (LinkeDOM then Mozilla Readability, then mdream with a pure-JS fallback) returns clean, LLM-optimized GitHub Flavored Markdown, and it waits out Cloudflare challenge interstitials in the same page context.

Tools & Capabilities ★ 5
View on GitHub ↗

Install

dsh plugin --profile web add github:GreyRaphael/dsh-web-fetch-moli

Copied verbatim from the README's Installation block ('Option 1: Install directly via GitHub repository'). The README also documents 'Option 2: Install via npm package name' with dsh plugin --profile web add dsh-web-fetch-moli (the npm package name is documented but was not resolvable on registry.npmjs.org on 2026-10-15, so the GitHub form is shipped).

Compatibility

The plugin drives CDP over the native global WebSocket, so Node 20 is not supported. Zero manual setup: if no moli binary is detected it downloads and unpacks the matching release (Linux, macOS, Windows x86_64 / arm64) into ~/.cache/moli, and existing Moli installs are found on $PATH, ~/.local/bin/moli or via the moliPath setting. Two backends: local (default, manages a local moli serve daemon) and cdp (connects to a remote Moli or Chromium CDP endpoint). Inline base64 images are elided to compact placeholders.

Details

Alternatives

1321928757/dsh-api-kit · 1321928757/dsh-mysql · 1624318455/dsh-plugin-tavily

More plugins in Tools & Capabilities

Browse more in Tools & Capabilities

Guides for Tools & Capabilities plugins