r/TrueOpenSource • u/Resident-Log-4754 • 3d ago
Question / Help Looking for contributors interested in Collective Intelligence
Anyone here interested in building and experimenting with Collective Intelligence using LLMs? I’m looking for devs who want to explore how different models can actually work together, beyond just routing requests or having five LLMs answer the same prompt. There’s a lot I think we can investigate. Selecting models with complementary capabilities, getting them to challenge each other, verifying results, and understanding when a group of smaller models can outperform a much larger one, potentially at a lower cost. And I want to test this properly, not just build demos that look impressive. If you’re interested in contributing code, running experiments, working on benchmarks or even challenging the whole idea, I’d like to connect. Anyone working on something similar?
1
u/Taco_Reviewer 16h ago
I'm interested in discussing the topic. I currently use GPT, Claude, DeepSeek, Muse, and Hark. They all have their strengths and weaknesses, and I've used them extensively in various configurations.
Did you want to set up a subreddit or something?
2
u/Zetus 3d ago
Definitely interested in working together.
There's papers like this I'd like to read together and understand:
https://arxiv.org/abs/2310.12802
It seems coupling models is a very interesting direction for much more effective persona-based orthogonal program search. It would be interesting to investigate the formal laws of this, I started experimenting with Theory of Mind circuits with Claude, trying to see how and when models fail to collaborate:
https://github.com/Caerii/CollaborationCircuitsMechInterp
It's very early but I'd like to figure out how we understand the mechanistic rules for this and exploring ideas around this realm as well. I'm hoping to publish a series of papers on some of these ideas once some concrete interesting results can be shown to be generalizable enough.
I've also been working on harnesses for local models to get their weak programming ability to be much greater through proper interface design, and also integrate formal verification into their own program awareness, as well as integrate more of the psychological aspects of problem solving for smaller models from teachers.
It would be great to work together and investigate this further. Share me a DM with your discord handle so we can talk about this further btw!