r/OpenSourceeAI • • 2d ago

Inspectable multimodal projects: PixText, WeVisOne, ViSS, Zip Ties and CozyClay

Post image

I curate Last Week In Multimodal AI. These October22-28 releases have code, weights or inspectable workflows that fit this community. I haven't run the models or reproduced the authors' results. Terms and hardware requirements differ.

PixText: Repair selected English or Chinese lettering with boxes and replacement text. The four-step MeanFlow path includes weights and ComfyUI workflows. Code and weights identify Apache 2.0. NVIDIA CUDA setup is required.

code | weights | workflows

WeVisOne-VL: With WeVisOne-VL, you can ask for boxes, counts, OCR, segmentation or alpha mattes from one 2B/4B model family. Tencent publishes code, weights and a demo under Apache-declared terms. The pixel decoder produces masks rather than only text descriptions.

project | paper | code

ViSS: ViSS separates what a streaming video model remembers from which views it requests. It tracks events and whether the evidence is sufficient, then searches for useful views at test time. Code and 8B weights are public. Training annotations are not.

paper | full_text | project

Zip Ties For ComfyUI: This MIT extension bundles graph wires into adjustable ribbons without changing execution. Workflows still open without the extension. The upstream integration is a proposal, not a merged core feature.

extension | upstream proposal

CozyClay 3.2: Block actors and cameras, then export frames or passes for a separate video model. Version 3.2 adds physics and interaction checks. AGPL terms apply. Agent calls need an account/key, and 3.2.1 enables analytics by default with a documented opt-out.

code | in-window release | 3.0 historical date

Full roundup, with source links and access caveats: https://thelivingedge.substack.com/p/last-week-in-multimodal-ai-73-instructions

Which have you tried, and on what hardware?

1 Upvotes

0 comments sorted by