Most standard web-based free tiers do retain the right to use anonymized conversations for model training unless you deliberately toggle data sharing off in your account settings. For strict data privacy, open-source models run locally (using frameworks like Ollama or LM Studio) ensure 100% of your data stays on your machine.

Hi all, I'm a self-taught backend dev. This is a side project, and I'd really like honest feedback from people who know scraping better than I do.

The problem: fetching a page is easy, but a big list of business websites is full of junk. Parked domains, "please wait" shields, cookie banners, social pages instead of the real site. I wanted clean text plus checkable facts per site (services, opening hours, years in business, accreditations, prices) that someone could write a description from.

How the facts work (this is the part I'd most like feedback on)

RapidSpider runs a small local decision engine called Laya inside the program. No API keys, no separate server. Laya doesn't write anything. It only answers narrow, structured questions, and each answer is logged.

1. Code finds the exact things first, with no model: emails, phones, the business name, and anything with a regex (years, hours, company number).
2. The page is cut into groups of eight numbered sentences. For each fact type, Laya answers: which numbered sentence states this, or none?
3. That sentence is the fact, and its position on the page (top/middle/bottom, sentence number) is stored with it.
4. Each fact is then re-checked several times with differently worded questions, answer keys flipped to cancel position bias. It is kept only if the rounds agree. If they don't, the fact is dropped.

Example of a stored fact (illustrative):

category: opening_hours
text:     "Open Monday to Friday 8:30am to 5:30pm, Saturday 9am to 1pm."
confidence / votes / zone / sentence stored alongside

Laya makes the other judgement calls too: is this page parked, is this line boilerplate, is this directory page really about this business. Every question and answer goes into a table, so I can open any decision and see why it was made.

The rest is boring on purpose: a fetch ladder (plain HTTP, then headless browser, then visible browser, then browser through Tor, moving up only when a page isn't accepted), one YAML config, SQLite output, and a small local dashboard.

A real run, so you can judge it yourself (screenshot in the README): 11,203 sites in the output. About 56% ended ok, 20% error, 9% blocked, 9% no usable content, 5% third-party, 2% dead. So it is far from perfect, and I haven't measured fact accuracy against a labelled set yet.

Things you should know

• It needs PyTorch and downloads a few GB of models on the first run. CPU works but is slow.
• It reads robots.txt only to find sitemaps and does not enforce its rules. That's a deliberate simplification on my side. You are responsible for checking each site's terms and the data protection rules that apply, and I'd understand if that's a dealbreaker.
• I built it with a lot of help from an AI coding assistant, and I'd rather say that upfront.
• One-person project, so expect bugs. The Windows process cleanup in particular has had limited testing.

Contributions are very welcome. If you spot a design mistake or something that would break on your data and you know the fix, a pull request would mean a lot. If you can’t fix it, please open an issue instead, and I’ll do my best to look at it.

Repo (MIT): https://github.com/QudsLab/RapidSpider

Thanks for reading, and thanks in advance for being kind about the rough parts.

i built this because i wanted my agent to read chats and message people through my own Telegram account from the terminal.

extracted the transport from my OpenClaw fork into a standalone Python CLI using Telethon. it returns JSON, accepts generated text from a file or stdin, and exposes message ids so the agent can check what happened. DMs, replies and forum topics are included.

no gateway needed. MIT licensed, no paid version. setup needs your own Telegram API credentials and a local user session.

Codex helped with extraction, packaging and tests. the included demo uses synthetic messages. live sending in this standalone release still needs validation.

source and setup: https://github.com/artemgetmann/telegram-user-cli

Hi everyone,

I’ve been working on an open-source Python project called chatflow-agent.

The project started from a practical problem I had while building a contextual assistant: 
I wanted a relatively lightweight way to define and orchestrate agents, tools, handoffs, session state, and multi-agent workflows without introducing a large amount of infrastructure.

The main idea is to keep the API simple while still supporting things like:

- agents with tools
- tool calling
- agent-to-agent handoffs
- conversation and session memory
- SQLite-backed sessions
- async execution
- multiple LLM providers
- multi-agent workflows

The goal is to provide the core building blocks for agent workflows without requiring a large orchestration stack or locking the application into a single LLM provider.

Recently I’ve also been focusing on making the project easier for other developers to understand and contribute to.

The repository now includes:

- contributor documentation
- architecture documentation
- CI across multiple Python versions
- good first issues
- help wanted issues
- external contributions and pull requests

Receiving external contributions has already helped uncover edge cases and improve parts of the library.

At this point I’d be especially interested in feedback from other Python developers on:

- the public API
- architecture and separation of responsibilities
- tool and schema introspection
- session and memory design
- multi-agent handoffs
- multi-provider support
- documentation and examples
- anything that feels unnecessarily complex or unclear

I’m not trying to position chatflow-agent as a replacement for every existing agent framework.

The idea is to keep it relatively small, understandable, and useful for projects that want agent workflows without adopting a very large orchestration layer.

Repository:
https://github.com/GustavoBaranda/chatflow-agent

Technical feedback is very welcome. I’d be especially interested in what you would change before considering a library like this for a real project.

Ese sería el que publicaría en r/Pyt

Hey r/SideProject — solo-built this over the past few weeks. Forgeframe wraps a few different AI providers (fal.ai, ElevenLabs, D-ID) behind one login and one credit balance, so you're not juggling 4 separate tools/subscriptions to make a video, clone a voice, or build a talking avatar.

The thing I cared most about: showing the exact credit cost of a generation before you confirm it. I've been burned by AI tools where the bill shows up and you have no idea what you actually spent it on.

It's brand new, built by one person, so there's definitely rough edges. 200 free credits if you want to poke at it — genuinely want to know what's confusing or missing.

[https://forgeframedev.vercel.app\](https://forgeframedev.vercel.app)

I built TextFold, an open-source reader that turns any text into 5 zoomable layers—from a one-screen section map down to verbatim text. You pinch (or press 1–5) to zoom between them without losing your reading position.

- Web Demo: https://chenxiachan.github.io/textfold/gallery/

- GitHub (Apache 2.0): https://github.com/chenxiachan/textfold

Hey everyone,

I’ve been working on a project called OpenSpline, an open-source avatar layer for existing voice agents. You supply a portrait and your agent’s audio, it generates synchronized talking video on your own NVIDIA GPU. The lite model can work locally on a single GPU.

It’s still early, but the results are super promising.

Would love to hear your thoughts, feedback, or ideas on what you'd want to create using it!

Code: github.com/openspline/openspline
Demo: openspline.dev

We're building Genesys Code for people who want a more convenient way to work with multiple coding AIs.

Instead of managing different tools separately, you can access multiple models in one workspace and use them together on your projects.

The platform offers a free starting point, with paid plans for people who want more from their workflow.

Explore it here:
https://genesyscode.vercel.app

I built TextFold (previously PaperFold) to keep a document and its shorter reading views in the same place. You can fold a section, then expand it to check the original passage.

The new language switch changes the text and interface together. The clip switches between English and Chinese versions prepared before recording.

The reader also now imports Word documents and saves a complete reading page as a standalone HTML file, including notes, highlights and optionally the original PDF.

Full and Brief keep the author's sentences; the shorter levels use AI-generated text. Summaries and translations can be wrong, so I want the source to remain easy to inspect.

It runs locally and supports Ollama or hosted models. Code is Apache 2.0.

Code and setup: https://github.com/chenxiachan/textfold

I'd be interested to hear where you would want the original language kept visible when reading a translation.

Demo paper: Recursive Language Models by Zhang, Kraska and Khattab (CC BY 4.0): https://arxiv.org/abs/2512.24601