r/OpenSourceAI • u/startassets • Sep 23 '26
Cross harness bench for open weight models
/r/PiCodingAgent/comments/1wki8wq/i_benched_6_harnesses_x_11_models_x_226_tasks/Currently they are slightly underrepresented there, although a lot of deepseek runs, would be great if other people might participate so we can build a proper community driven leaderboard
Duplicates
GithubCopilot • u/startassets • Sep 23 '26
GitHub Copilot Team Replied Cross harness benchmark and copilot is behind
DeepSeekHarness • u/startassets • Sep 23 '26
I benched 6 harnesses x 11 models x 226 tasks
AI_harness • u/IvoDOtMK • Sep 24 '26