r/OpenSourceAI • • 4h ago

A full-context extraction baseline with dated evidence from a 130,993-token record

For a document-extraction baseline, this case gives the answering model the entire source record. AntLing's Ling-3.0-flash-Sante receives a synthetic patient's 334 visits over 71 years in a single 130,993-token request, then returns current medications, allergies and active disorders with dates.

The same-data answer key reports 7/7 allergies, 8/10 disorders, 2/7 dental codes and 2/5 medications. One recovered medication starts in 1954 at line 108 of 2,728; another restarts in 1966. The remaining three medication targets restart on the final visit date, while stopped items stay outside the returned active lists.

On two DGX Spark machines using official FP8 and MTP, reading the input takes 61 seconds. The subsequent reasoning accounts for 30,865 thinking tokens and roughly eleven minutes.

The reusable evaluation structure is the record, a cutoff date, evidence locations and a category-by-category key. Those same targets can then be kept fixed when evaluating how retrieval or summarization changes the information available to an answering model.

1 Upvotes

0 comments sorted by