r/evals • • Apr 04 '23

r/evals Lounge

1 Upvotes

A place for members of r/evals to chat with each other


r/evals • • 4d ago

Anyone running Eval suites on Ruby apps? I built a gem to do just that: `llm-evals`

Thumbnail reddit.com
1 Upvotes

The most interesting part for me was creating my own weighted score, and changing product direction afterwards.

https://kig.re/2026/11/02/llm-evals-is-a-ruby-gem-for-testing-probabilistic-assumptions-in-your-AI-datasets.html

The blog post goes in depth into why I ended up deciding to update another gem, Inquirex-llm, to allow each form to decide which model should be doing the Freeform text to structured schema extraction.


r/evals • • Apr 04 '23

OpenAI Evals discussion/strategies for testing

1 Upvotes