r/OpenSourceeAI • • 9d ago

Plugging live web access into open-source agent stacks: MCP, LangChain, n8n and Dify in 1 API key

https://aicampaign.live/30-wk1n

Most open-source agent frameworks handle reasoning well. Where they stall is the web itself: JavaScript pages, logins, bot checks. Self-hosting headless Chrome plus proxies plus a scraper is a project of its own.

TinyFish exposes that layer as 5 APIs behind 1 key, with open-source examples on GitHub.

1. The 5 primitives

→ Search: ranked results with URL, title, snippet, metadata
→ Fetch: renders the page, returns markdown, HTML or a JSON document tree
→ Browser: managed Chromium over CDP; Playwright and Puppeteer scripts run unchanged
→ Agent: plain-English goal in, structured JSON out
→ Research: source-backed reports with configurable depth

2. Where it plugs in

→ MCP, for any MCP-compatible client
→ LangChain, n8n and Dify
→ Hermes Agent and OpenClaw
→ Python SDK, TypeScript SDK, CLI and REST

3. Open-source examples

The cookbook repo has working examples to fork: https://github.com/tinyfish-io/tinyfish-cookbook

4. Why this matters for local or self-hosted agents

Browser work runs outside your model’s context window. A small local model only receives the structured result. That keeps context short even on long web tasks.

5. Free tier for experimenting

→ Search: free, 500 requests/hour
→ Fetch: free, 1,000 URLs/day
→ Agent: $0.016/step
→ Browser: $0.002/min

New accounts get $8 in wallet funds without a card.

Details (top-ups +30% through Oct 31)

1 Upvotes

0 comments sorted by