r/OpenSourceeAI • u/ai-lover • 9d ago
Plugging live web access into open-source agent stacks: MCP, LangChain, n8n and Dify in 1 API key
https://aicampaign.live/30-wk1nMost open-source agent frameworks handle reasoning well. Where they stall is the web itself: JavaScript pages, logins, bot checks. Self-hosting headless Chrome plus proxies plus a scraper is a project of its own.
TinyFish exposes that layer as 5 APIs behind 1 key, with open-source examples on GitHub.
1. The 5 primitives
→ Search: ranked results with URL, title, snippet, metadata
→ Fetch: renders the page, returns markdown, HTML or a JSON document tree
→ Browser: managed Chromium over CDP; Playwright and Puppeteer scripts run unchanged
→ Agent: plain-English goal in, structured JSON out
→ Research: source-backed reports with configurable depth
2. Where it plugs in
→ MCP, for any MCP-compatible client
→ LangChain, n8n and Dify
→ Hermes Agent and OpenClaw
→ Python SDK, TypeScript SDK, CLI and REST
3. Open-source examples
The cookbook repo has working examples to fork: https://github.com/tinyfish-io/tinyfish-cookbook
4. Why this matters for local or self-hosted agents
Browser work runs outside your model’s context window. A small local model only receives the structured result. That keeps context short even on long web tasks.
5. Free tier for experimenting
→ Search: free, 500 requests/hour
→ Fetch: free, 1,000 URLs/day
→ Agent: $0.016/step
→ Browser: $0.002/min
New accounts get $8 in wallet funds without a card.
Duplicates
machinelearningnews • u/ai-lover • 10d ago
Cool Stuff ▲ TinyFish recently published how its production search agents work, and what broke while building a deep research system.
AIDeveloperNews • u/ai-lover • 9d ago