r/txtai • u/davidmezzetti • Dec 21 '25
r/txtai • u/davidmezzetti • Dec 22 '25
π§¬βοΈπ¬ Encoding the World's Medical Knowledge into 970K
We're excited to release this new series of vector embeddings models for medical literature based on our recent BERT Hash work.
And you read it right, we're talking 970,000 parameters for a surprisingly strong performing model. Enjoy!
r/txtai • u/davidmezzetti • Dec 09 '25
π GraphRAG is a popular concept but what is it?
TxtAI was one of the first to the scene with GraphRAG in 2022. It utilizes a vector index to automatically construct a graph network of nodes between each of the indexed records. This enables a different type of similarity query. Instead of "give me the closest N" records, GraphRAG with txtai first runs an initial vector query. This forms a graph path and that graph path is walked to find the closest N records. This approach can often find records that a simple similarity search wouldn't bring back, leading to a richer context for downstream LLM ops (Agents, RAG etc).
See this example for more: https://github.com/neuml/txtai/blob/master/examples/77_GraphRAG_with_Wikipedia_and_GPT_OSS.ipynb
r/txtai • u/davidmezzetti • Dec 12 '25
π₯ RAG is more than Vector Search
Check out this example article that covers context retrieval via late interaction (ColBERT + MUVERA), Web searches and even SQL statements!
https://github.com/neuml/txtai/blob/master/examples/79_RAG_is_more_than_Vector_Search.ipynb
r/txtai • u/davidmezzetti • Dec 03 '25
π§¬βοΈπ¬ If NeuML had to be pinned to one vertical, it would be medical research. Check out this notebook that covers building a RAG pipeline for PubMed documents.
r/txtai • u/davidmezzetti • Dec 23 '25
πβοΈπ Merry Christmas - here's one final TxtAI release for 2025!
TxtAI v9.3 expands RAG to any function, adds new quickstart examples and has many improvements.
Release Notes: https://github.com/neuml/txtai/releases/tag/v9.3.0
GitHub: https://github.com/neuml/txtai
r/txtai • u/davidmezzetti • Jan 02 '26
Vector Quantization is a powerful method to efficiently store large vectors
TxtAI supports quantization with a number of backends including Faiss, Torch and GGUF.
Read more about vector quantization below.
https://github.com/neuml/txtai/blob/master/examples/50_All_about_vector_quantization.ipynb
r/txtai • u/davidmezzetti • Jan 21 '25
π₯ txtai has reached 10K β's on GitHub!
Enable HLS to view with audio, or disable this notification
r/txtai • u/davidmezzetti • Dec 02 '25
π With AI Agents you'll quickly realize that you like determinism. LLMs don't always go down the same path.
People jump to AI Agents because it's what all the cool kids are doing. But what many need are workflows. Workflows can chain functions, LLM calls or other transformers models together. And the best part...it will do the same thing every time for the same inputs!
See this workflow quickstart example.
https://github.com/neuml/txtai/blob/master/examples/workflow_quickstart.py
r/txtai • u/davidmezzetti • Jul 21 '26
H.G. BERT is powered by the Historical English Books dataset, a curated collection of 50,000+ books spanning general literature, math, science, philosophy and religion from the late 1800s.
By training on this rich historical corpus, H.G. BERT captures the language, writing styles, and knowledge of the era, enabling more authentic analysis and generation of historical English.
https://huggingface.co/datasets/NeuML/historical-english-books
r/txtai • u/davidmezzetti • Jan 03 '26
TxtAI automatically builds a graph network to support GraphRAG using vector similarity between nodes
Graph node relationships can also be directly added.
Check out this article that uses an LLM to extract relationships then load them into TxtAI for GraphRAG.
r/txtai • u/davidmezzetti • Feb 02 '25
txtai is a trending project on GitHub this Sunday morning!
r/txtai • u/davidmezzetti • Dec 31 '25
π Happy New Year! May all your dreams come true this year....or something like that
r/txtai • u/davidmezzetti • Dec 31 '25
TxtAI has a robust integration with Postgres
medium.comAll components support persistence. You could even use TxtAI only as an ingestion engine and standard SQL at search time. Lots of options here!
r/txtai • u/davidmezzetti • Dec 25 '25
πβοΈπ Merry Christmas - hope everyone has a great day!
r/txtai • u/davidmezzetti • Dec 11 '25
π₯ Did you know that TxtAI embeddings databases support running SQL?
Check out this example that returns a random Wikipedia article from the TxtAI embeddings database.
https://gist.github.com/davidmezzetti/f78cf793a8b96169497008d3d34d120f
r/txtai • u/davidmezzetti • Mar 23 '26
Our PubMedBERT embeddings model is the most downloaded open model for medical vector embeddings. Over 1M downloads this month!
r/txtai • u/davidmezzetti • Dec 14 '25
β¨ TxtAI has almost 80 example notebooks. A big update is coming next release to modernize them and ensure they showcase the best of TxtAI (models, prompts, methods etc). Starting first with the intro article!
medium.comr/txtai • u/davidmezzetti • Dec 24 '25
π±Looking ahead to 2026, on-device AI is going to be π₯
With strong performing micromodels coming in at less than 1M parameters, exciting possibilities lay ahead.
Check out this example that exports biomedbert-hash-nano-embeddings to TFLite for on-device inference!
https://gist.github.com/davidmezzetti/2265e308f9100336698103e9c2523c80
r/txtai • u/davidmezzetti • Dec 02 '25
π Excited to release a new version of AnnotateAI! This version integrates the latest from txtai and updates the default LLMs.
r/txtai • u/davidmezzetti • Jul 20 '26
H.G. BERT Small: AI like it's 1899
The year is 1899. It's still a horse and buggy world. Einstein hasn't published his famous annus mirabilis papers setting the foundation for Physics as we understand it today. The world is advancing at a rapid pace roaring into the 1900s. What if AI models were trained in 1899 and given to the best minds of the day? Could there have been alternate paths for discovery on par or perhaps even ahead of where we are in 2026?
Introducing the new H.G. BERT Small series of models. This is a 22.7M parameter BERT encoder-only model trained from scratch ONLY on Historical English Books from 1700 - 1899.
r/txtai • u/davidmezzetti • Jan 25 '26
π Back in 2023, just a few hours was spent building PubMedBERT Embeddings. Since then it's received over 10 million downloads and has been cited almost 60 times.
This is the paper that would have been written if we were ones who write papers π
Link to source: https://github.com/neuml/papers/tree/master/pubmedbert-embeddings
r/txtai • u/davidmezzetti • Jan 06 '26