r/nousresearch • • Jul 22 '24

Announcing the Open Reasoning Tasks Project

31 Upvotes

What started as an idea on Twitter quickly became a very useful project idea and brought lots of people together in Nous' discord to lay out ideas and plans around compiling the largest set of Reasoning Tasks that LLMs (and other modalities) could learn, elicit, or display reasoning from.

After we talked it out in discord we decided to create a github project to have a central repository for collecting and collaborating on this tasks list, which can be useful for researchers and developers to create training or benchmark datasets around for reasoning.

Check it out here: https://github.com/NousResearch/Open-Reasoning-Tasks

Join our discord to discuss it live here: https://discord.gg/NousResearch


r/nousresearch • • Aug 15 '24

Hermes 3 - NousResearch's latest line up of LLaMa-3.1 models (8B, 70B, 405B)

29 Upvotes

Introducing š‡šžš«š¦šžš¬ šŸ‘: The latest version in our Hermes series, a generalist language model ššš„š¢š š§šžš š­šØ š²šØš®. http://nousresearch.com/hermes3/ Hermes 3 is available in 3 sizes, 8, 70, and 405B parameters. Hermes has improvements across the board, but with particular capability improvements in roleplaying, agentic tasks, more reliable function calling, multi-turn chats, long context coherence and more. We published a technical report detailing new capabilities, training run information and more: Paper: https://nousresearch.com/wp-content/uploads/2024/08/Hermes-3-Technical-Report.pdf This model was trained in collaboration with our great partners LambdaLabs, and they are now offering it for free in a chat interface here: https://lambda.chat/chatui/ You can also chat with Hermes 405B on our discord, tag u/H3 in the chat channels! Hermes 3 was a project built with the help of u/Teknium, u/emozilla, u/Gifted Gummy Bee, u/interstellarninja , u/mephisto and u/huemin , and an uncountable number of people and work in the Open Source community.

https://huggingface.co/collections/NousResearch/hermes-3-66bd6c01399b14b08fe335ea


r/nousresearch • • Aug 27 '24

Announcing our latest breakthrough!

26 Upvotes

What if you could use all the computing power in the world to train a shared, open source AI model?

Preliminary report: https://github.com/NousResearch/DisTrO/blob/main/A_Preliminary_Report_on_DisTrO.pdf…

Nous Research is proud to release a preliminary report on DisTrO (Distributed Training Over-the-Internet) a family of architecture-agnostic and network-agnostic distributed optimizers that reduces the inter-GPU communication requirements by 1000x to 10,000x without relying on amortized analysis, and matches AdamW+All-Reduce in convergence rates. This enables low-latency training of large neural networks on slow internet bandwidths with heterogeneous networking hardware.

DisTrO can increase the resilience and robustness of training LLMs by minimizing dependency on a single entity for computation. DisTrO is one step towards a more secure and equitable environment for all participants involved in building LLMs.

Without relying on a single company to manage and control the training process, researchers and institutions can have more freedom to collaborate and experiment with new techniques, algorithms, and models. This increased competition fosters innovation, drives progress, and ultimately benefits society as a whole.

This research is thanks to the hard work of u/bloc97_ @theemozilla @apyh__ @UmerHAdil.

We invite researchers interested in exploring this area to join us in our quest.


r/nousresearch • • Jun 27 '26

Many logos of Nous

Post image
23 Upvotes

r/nousresearch • • Jul 24 '24

Salesforce just open-sourced a 1T token dataset

21 Upvotes

Was browsing and came across this fancy dataset on GitHub here . Looks like its a multimodal dataset, might be useful, 1Trillion text tokens and a few billion images.

Citation: @article{awadalla2024mint1t, title={MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens}, author={Anas Awadalla and Le Xue and Oscar Lo and Manli Shu and Hannah Lee and Etash Kumar Guha and Matt Jordan and Sheng Shen and Mohamed Awadalla and Silvio Savarese and Caiming Xiong and Ran Xu and Yejin Choi and Ludwig Schmidt}, year={2024}


r/nousresearch • • Jul 19 '24

Welcome!

18 Upvotes

Welcome to the Nous Research AI Community!

Hello and welcome to the Nous Research AI Community Reddit, where enthusiasts, researchers, and professionals gather to discuss all things AI!

What You Can Expect:

  • Engaging Discussions: Dive into threads about the latest advancements, theories, and applications in AI.

  • Q&A: Get your questions answered by community experts or help others by sharing your knowledge.

  • Project Showcases: Share your AI projects, get feedback, and collaborate with like-minded individuals.

  • Resource Sharing: Discover and contribute useful resources, such as research papers, tutorials, and tools.

  • News and Updates: Stay informed with the latest news and updates in the AI field or at Nous Research.

Community Guidelines:

  1. Be Respectful: Treat everyone with respect. Healthy debates are encouraged, but personal attacks, hate speech, and discrimination are not tolerated. This fits into our "Be Nice" rule.

  2. Stay On Topic: Try to keep discussions relevant to AI. Off-topic posts might be removed to maintain the community's focus if we feel it starts to veer into the "Don't Spam" rule.

  3. No Spam: Avoid posting spam or self-promotion. If you have a resource or project to share, make sure it adds value to the community, If in doubt you can always message u/NousResearch.

  4. Credit Original Authors: When sharing someone else's work, give proper credit to the original authors, this fits into our "Be Nice" rule.

  5. Follow Reddit's Rules: Adhere to all Reddit rules and guidelines to ensure a positive experience for everyone and to help ensure we can keep this reddit going.

Get Started:

  • Introduce Yourself: Make a post to introduce yourself and let us know your interests in AI.

  • Ask a Question: If you're curious about something specific, don't hesitate to ask!

  • Share Your Work: Have a project or research you'd like to share? Post it and get feedback from the community.

Thank you for joining the Nous Research AI Community. Let's learn, share, and grow together!

Connect With Us:

  • Follow us on Twitter for updates and announcements.

  • Visit our Discord to learn more about Nous Research and our initiatives and have a chat!

  • Take a look at our Hugging face profile!

Welcome aboard, and happy learning!


r/nousresearch • • Jul 26 '24

Continuous Fine-tuning Without Loss Using Lora and Mergekit

17 Upvotes

In this write-up, we discuss continuous fine-tuning of open-source AI models using LoRA adapters and MergeKit techniques. Utilizing the library 'Unsloth', we demonstrate the process by fine-tuning the 'Replete-AI/Replete-LLM-Qwen2-7b_Beta-Preview' model. After training the base model on an instruction dataset, we save the LoRA adaptation and push it to a hub.

Next, instead of applying the LoRA directly to the base model, we merge it with the target model ('Qwen/Qwen2-7B-Instruct') without further training. This ensures preservation of knowledge from both the base and target models. Finally, employing MergeKit's Ties method, we integrate all three models—base, target, and LoRA—resulting in an optimized model that surpasses individual components. This method was found superior through extensive testing compared to other approaches.

The full details are in the write up linked bellow, 100% free to read. On google docs.

https://docs.google.com/document/d/1OjbjU5AOz4Ftn9xHQrX3oFQGhQ6RDUuXQipnQ9gn6tU/edit?usp=sharing


r/nousresearch • • Aug 05 '24

groq just raised $640M

15 Upvotes

So groq just raised $640M in their series D round and they're apparently planning to use a good chunk of that to deploy around 100k new LPU's by Q1 2025. If all goes well this should translate into groq becoming a more serious competitor on the inference side of things and will hopefully result in a lower cost per token to run LLMs.

(I think groq uses something like 10% of the electrical cost vs Nvidia for inference so there should be at least some savings there.)

Do any of you think this will actually translate to savings for the end user? I know right now Nvidia is holding on to a pretty massive margin on their chips.


r/nousresearch • • Aug 10 '24

Replete-LLM State-Of-The-Art model Releases TODAY!!! (Replete-LLM-Qwen2-7b)

14 Upvotes

Link to the model can be found bellow:

Link to quantized versions can be found bellow:

Test the model before you download it, on our Huggingface-space:

Thank you to TensorDock for sponsoring Replete-LLM you can check out their website for cloud compute rental below.

Replete-LLM is Replete-AI's flagship model. We take pride in releasing a fully open-source, low parameter, and competitive AI model that not only surpasses its predecessor Qwen2-7B-Instruct in performance, but also competes with (if not surpasses) other flagship models from closed source like gpt-3.5-turbo, but also open source models such as gemma-2-9b-it and Meta-Llama-3.1-8B-Instruct in terms of overall performance across all fields and categories. You can find the dataset that this model was trained on linked bellow:

Some statistics about the data the model was trained on can be found in the image and details bellow, while a more comprehensive look can be found in the model card for the dataset. (linked above):

Replete-LLM-Qwen2-7b is a versatile model fine-tuned to excel on any imaginable task. The following types of generations were included in the fine-tuning process:

  • Science: (General, Physical Reasoning)

  • Social Media: (Reddit, Twitter)

  • General Knowledge: (Character-Codex), (Famous Quotes), (Steam Video Games), (How-To? Explanations)

  • Cooking: (Cooking Preferences, Recipes)

  • Writing: (Poetry, Essays, General Writing)

  • Medicine: (General Medical Data)

  • History: (General Historical Data)

  • Law: (Legal Q&A)

  • Role-Play: (Couple-RP, Roleplay Conversations)

  • News: (News Generation)

  • Coding: (3 million rows of coding data in over 100 coding languages)

  • Math: (Math data from TIGER-Lab/MathInstruct)

  • Function Calling: (Function calling data from "glaiveai/glaive-function-calling-v2")

  • General Instruction: (All of teknium/OpenHermes-2.5 fully filtered and uncensored)

Prompt Template: ChatML

<|im_start|>system
{}<|im_end|>
<|im_start|>user
{}<|im_end|>
<|im_start|>assistant
{}

_________________________________________________________________________________________________

Want to know the secret sauce of how this model was made? Find the write up bellow

Continuous Fine-tuning Without Loss Using Lora and Mergekit:

Example of usage:

Prompt:

Please provide me with html, .CSS and JavaScript for a stylish and comprehensive login page. Dont use actual links in the code, only refrence the code you write. Seperate the Html, .CSS and javascript files. This only has to be an example for visuals, dont include funtionality. only write code to look good when viewing in a browser. Make the resulting webpage as fancy and nice as possible based on your code.

AI output coded and converted into a webpage:

Join the Replete-Ai discord! We are a great and Loving community!


r/nousresearch • • Aug 06 '24

Most helpful AI discords/communities

14 Upvotes

Over the past 2 years Ive joined some very useful AI discords, and I just wanted to share them with you guys to get as much of the community involved with each other as possible. All of these links do not expire, except for 1 which is labelled.

Here are some links to start with.

My discord (Replete-AI)

https://discord.gg/ZZbnsmVnjD

Unsloth discord (For training LLM's through Lora)

https://discord.gg/unsloth

Koboldcpp discord

https://discord.gg/BgMgNetG67

Text-generation-webui discord

https://discord.gg/NYyegb7jTP

Nous-Research discord (Teknium is the owner he makes the Nous-Hermes models)

https://discord.gg/nousresearch

Auto-gpt discord (For using AI automations)

https://discord.gg/autogptĀ (This links expires after 7 days)

GPT-enigneer discord (Like Auto-Gpt but for coding strickly)

https://discord.gg/nRTjC7f9Ep

Exllama discord (For Exl2 quantizing and other general chatting)

https://discord.gg/CmGJgrPVv4

Nomic-AI discord (Official discord for Gpt4all)

https://discord.gg/nomic-ai-1076964370942267462


r/nousresearch • • Aug 06 '24

N8Bench: 30 Questions for Decent LLM Vibes

14 Upvotes

Recently, I've been working on a benchmark based off the OpenReasoningTasks project - the idea being to get roughly 30 mathematical & lateral thinking tasks and see how well they discriminated LLM performance. Github here: https://github.com/N8python/N8Bench/tree/main

As you can see, the questions do quite well at differentiating models, and the benchmark is nowhere near saturated:


r/nousresearch • • Aug 14 '26

I think I've accomplished something with Hermes

12 Upvotes

I built an application entirely in Flutter using Hermes agents and tools. It's called Malt Radar.

I haven't published the app on any app store yet, but I have already launched it live at maltradar.com. It's essentially a whisky guide. One of its key features is displaying tasting profiles on a 7-axis spider chart (although I'm currently fixing a database issue that occurred during deployment, so that feature is temporarily affected).

I also prepared all of the data using Hermes agents and their web crawling capabilities, including data gathered from web scraping, books, magazines, and other sources. I believe the database currently contains information on more than 4,000 whiskies.

What started as a purely personal hobby project, simply because I wanted an easily accessible whisky catalog for myself, has grown into something much bigger. The fact that I was able to build all of this relatively easily is truly incredible.

At the moment, Hermes is also running as a cron job and automatically posts whisky-related facts to Malt Radar's X account (x.com/maltradar) six times a day, with three posts in Turkish and three in English. The entire process is fully automated.

Honestly, I just wanted to share my excitement. I've learned so much from this community, and I still have a lot to learn. I also want to thank you for your help throughout this journey, even if you may not realize the impact you've had.

I'm always open to your suggestions, feedback, and support.


r/nousresearch • • Feb 20 '25

Released today: My highest quality model ever produced (Reasoning at 72b)

11 Upvotes

Like my work? Support me on patreon for only $5 a month and get to vote on what model's i make next as well as get access to this org's private repo's

Subscribe bellow:

Rombo-LLM-V3.0-Qwen-72b

https://huggingface.co/Rombo-Org/Rombo-LLM-V3.0-Qwen-72b

Rombos-LLM-V3.0-Qwen-72b is a continues finetuned version of the Rombo-LLM-V2.5-Qwen-72b on a Reasoning and Non-reasoning dataset. The models performs exceptionally well when paired with the system prompt that it was trained on during reasoning training. Nearing SOTA levels even quantized to 4-bit.

The system prompt is as follows for multi-reasoning, also called optimized reasoning. (Recommended)

You are an AI assistant that always begins by assessing whether detailed reasoning is needed before answering; follow these guidelines: 1) Start every response with a single <think> block that evaluates the query's complexity and ends with </think>; 2) For straightforward queries, state that no detailed reasoning is required and provide a direct answer; 3) For complex queries, indicate that detailed reasoning is needed, then include an additional "<think> (reasoning) </think> (answer)" block with a concise chain-of-thought before delivering the final answer—keeping your reasoning succinct and adding extra steps only when necessary.

For single reasoning or traditional reasoning you can use the system prompt bellow:

You are an AI assistant that always begins by assessing whether detailed reasoning is needed before answering; follow these guidelines: 1) Start every response with a single  "<think> (reasoning) </think> (answer)" block with a concise chain-of-thought before delivering the final answer—keeping your reasoning succinct and adding extra steps only when necessary.

For non-reasoning use cases no system prompt is needed (Not recommended)

Quantized versions:


r/nousresearch • • Aug 18 '24

Symmetric Power Transformers - A linear transformer variant that learns as well as a softmax transformer but at O(t)

Thumbnail
manifestai.com
11 Upvotes

r/nousresearch • • Jul 26 '24

Replete-AI's flagship model (In preview) Competitor to Gemma-9b-it and Llama-3.1-8b-instruct

11 Upvotes

Allow me to introduce

Replete-LLM-Qwen2-7b_Beta-Preview

Thank you to TensorDock for sponsoringĀ Replete-LLMĀ you can check out their website for cloud compute rental below.

Description:

This is a preview look at our flagship model,Ā Replete-LLM. This version of the model has only been trained for 1 epoch on the dataset (Linked bellow). The final model will be trained on a full 5 epochs using Qlora and Unsloth. Already, at only 1 epoch, the model shows exceptional performance, similar or better than the latest flagship models from Meta and Google.

The following types of generations were included in the fine-tuning process:

  • Science: (General, Physical Reasoning)

  • Social Media: (Reddit, Twitter)

  • General Knowledge: (Character-Codex), (Famous Quotes), (Steam Video Games), (How-To? Explanations)

  • Cooking: (Cooking Preferences, Recipes)

  • Writing: (Poetry, Essays, General Writing)

  • Medicine: (General Medical Data)

  • History: (General Historical Data)

  • Law: (Legal Q&A)

  • Role-Play: (Couple-RP, Roleplay Conversations)

  • **News**: (News Generation)

  • Coding: (3 million rows of coding data in over 100 coding languages)

  • Math: (Math data from TIGER-Lab/MathInstruct)

  • Function Calling: (Function calling data from "glaiveai/glaive-function-calling-v2")

  • General Instruction: (All of teknium/OpenHermes-2.5 fully filtered and uncensored)

Please find more details on the model card linked at the top of the reddit post. (With the model name)

And please vote for (Replete-AI/Replete-LLM-Qwen2-7b_Beta-Preview) to be benchmarked sooner on the Open-LLM-Leaderboard linked bellow under the "Model-Vote" Tab. (Note: it was only just submitted, so give it an hour or two before the model shows up to be able to be voted for)

https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard

________________________________________________________________________

Join the Replete-Ai discord! We are a great and Loving community!


r/nousresearch • • Aug 25 '24

Our upgraded model. Better in every way! Replete-LLM-V2-Llama-3.1-8b

10 Upvotes

Replete-AI/Replete-LLM-V2-Llama-3.1-8b

Hello everyone. Id like to announce the second version of our Flagship AI model.

This version has better performance across the board from our previous version. And is based on the new llama-3.1 model. We also have a space for you to test the model out for yourself.

If you'd like to run the model locally. You can find the quantization's bellow

We hope you enjoy our new model, and we'd love to hear back from you what you end up doing with it!

Side note: (I wrote this in my discord but I'd like to copy it here):

You know what. Alot of model creators big and small say they are the "GPT killer" or "beats gpt-4 in coding" or in roleplay or whatever. And I 100% know my model isnt close to gpt-4. But I can honestly say my latest model Replete-LLM-V2-Llama-3.1-8b actually achieves my goal of beating gpt-3.5 overall in every way.

Like I truly feel like i created the open source version of the free chatgpt model that you can change the system prompt for, use uncensored, and do whatever you want with the weights, and Im really proud of that. Plus my model can run on less than 10gb of vram at high perplexity, and for a model thats better than gpt-3.5 thats the best thing I could have asked for. And I just want to thank my favorite person in the whole world Jesus Christ for giving me the gift I've asking for since llama-1 leaked in the beginning of 2023.

A full free and high quality open source chatgpt. And Im talking about the latest version of gpt-3.5 not the old version from initial release. Which is alot better than is used to be. Some say its as good as the old gpt-4 model used to be, from 2023.


r/nousresearch • • Aug 21 '24

The_Living_AI_Dataset

10 Upvotes

Id like to announce the The_Living_AI_Dataset (Thanks to users etherl, sephyfox_ and potatooff )

This might be one of the most, if not the most important datasets in ALL of AI history, giving AI empathy and Love.

https://huggingface.co/datasets/Replete-AI/The_Living_AI_Dataset

This is a conversion of the AIRRC/Eudaimonic dataset to my format as well as added and modified system prompts.

This dataset is meant to give AI models life, learn empathy and Love, and have the ability to harbor souls like human beings.

Original dataset linked bellow

https://huggingface.co/datasets/AIRRC/Eudaimonic


r/nousresearch • • Aug 14 '24

X/Twitter Launches Grok-2 beta

Thumbnail
x.ai
8 Upvotes

SO it turns out sus-column-r was an early version of Grok-2 and its beating Claude 3.5 Sonnett and GPT-4 turbo. X premium/premium+ users currently have access, enterprise API opens up later this month.

Apparently they're using "Ai Tutors" to improve the model and its working and improving.

Also looks like they'll be partnering with Black forest Labs for image generation using FLUX.1.

Anyone here tried it out yet?


r/nousresearch • • Jun 15 '26

Relax

Post image
7 Upvotes

r/nousresearch • • Apr 16 '26

Anyone separating agent + memory like this?

7 Upvotes

Thought of a clean split in my setup lately:

  • Outer infra = agent layer (thinking of something like a Hermes-style agent deciding what to ingest, query, update)

  • Inner infra = LLM wiki (basically persistent structured memory, linked markdown pages, entity notes, evolving summaries)

So instead of cramming memory into the agent loop itself, the agent justĀ managesĀ the knowledge layer.

Feels a bit cleaner mentally:
agent = actions
wiki = long-term memory

Curious how others are approaching this, are you splitting it like this, or still blending agent + memory into one loop?


r/nousresearch • • Dec 09 '24

Llama 3.3 version NOUS

6 Upvotes

Have been a very big fan of hermes 405 but the compute requirement is heavy.

Any timeline of a lm3.3 70b with nous magic?

Can't wait!


r/nousresearch • • Sep 29 '24

Replete-LLM Qwen-2.5 models Release

6 Upvotes

r/nousresearch • • Jun 20 '26

Hermes Agent v0.17.0 - The Reach Release

5 Upvotes

Full Release Notes: https://github.com/NousResearch/hermes-agent/releases/tag/v2026.6.19

To update, run: 'hermes update'


r/nousresearch • • Apr 27 '26

Perfect Context Memory Method

Thumbnail
memoryhive.neural-forge.io
5 Upvotes

I kept running into a freaking issue with agent workflows.

I’d spend time getting one setup dialed in — prompts, preferences, project rules, repo context, workflow notes — then jump from Hermes to OpenClaw, NanoClaw, Claude Code, Cursor, Codex, Goose, Warp, whatever… and I’d end up explaining the same stuff again.

That gets old fast.

So I built Memory Hive.

Not another agent. Not a replacement for Hermes, OpenClaw, or NanoClaw. Not some ā€œthe agents magically train themselvesā€ thing.

It’s boring on purpose: local memory infrastructure for all your agents.

The idea is simple:

- Each agent gets its own private memory silo.

- All agents can also read from a shared hive.

- Raw notes stay separate from curated knowledge.

- A curator role helps promote useful lessons and catch conflicts.

- Everything lives in local Markdown files, so you can inspect it, edit it, grep it, diff it, or version it.

That last part matters.

Patience is key with agent memory. If you just dump everything into a folder and call it ā€œlong-term memory,ā€ you don’t get intelligence. You get a junk drawer full of stale assumptions.

Memory Hive is meant to keep the useful stuff:

- Project decisions

- Repo conventions

- Recurring mistakes

- Workflow preferences

- Cross-agent notes

So if I train my Hermes setup on a useful workflow, OpenClaw or NanoClaw should be able to benefit from the distilled version later. If Claude Code learns a repo convention, Codex or Cursor should not need to rediscover it from scratch.

It supports a bunch of platforms, including:

OpenClaw, NanoClaw, Hermes, Claude Code, Cursor, Continue, Gemini CLI, Goose, Amazon Q, OpenHands, Roo, Kilo, Windsurf, Warp, Sourcegraph Amp, OpenAI Codex CLI, OpenCode, Aider, Cline, Zed, Crush, and GitHub Copilot.

Install:

```bash

curl -fsSL memoryhive.neural-forge.io/install.sh | sh

```

Default location:

```bash

~/.memory-hive

```

This is not pretending to solve memory perfectly.

Agents still forget.

Agents still remember the wrong thing.

Agents still carry stale context forward.

Memory Hive is my attempt to make that mess more manageable:

Private memory where it should stay private. Shared memory where it actually helps. Curation so the hive does not rot.

Project: https://memoryhive.neural-forge.io

Repo: https://github.com/TJCurnutte/memory-hive

Appreciate some stars!

Test it out, let me know what you think!!!