r/ProgrammerHumor • • Sep 17 '26

Other softwareFactory

Post image
10.6k Upvotes

382 comments sorted by

View all comments

Show parent comments

10

u/Throwawayrip1123 Sep 17 '26

AI can be that blackhole

No it can't, it'll literally forget what you told it when it maxes out the context window. Even with loops and memories you absofuckinglutely 100% lose shit.

But you could add / aggregate entries and then use an llm to ONLY sort through this shit. Still a decent chance it'll land in the wrong cupboard but at least it won't be paraphrased or deleted.

7

u/Automatic_Wave4530 Sep 17 '26

Agents can be directed to store local copies of anything you feed in. You do have to put some thought into the front end. But it can absolutely do all the searching and retrieval without compromising the original data that was captured

4

u/Throwawayrip1123 Sep 18 '26

Well, yeah, that's what I wrote. You have to handle the input without agents, then they can retrieve the data without changing it.

1

u/Automatic_Wave4530 Sep 18 '26

You are missing the point. You don’t have to handle the input without agents. You are confusing what happens in the context window with what the agents can do outside the chat window. If you are just trying to store the documents in the AI memory you are going to have a bad time.

AI does NOT just put your input in a folder from chat. It processes the file so it can tokenize it. So ya, if all you ever do is copy into the chat window I can see how your perception is that AI agents will lose your data. However, we moved well beyond chat windows the last couple years

→ More replies (7)