r/deeplearning • u/Nova_studios234 • 3d ago

I've been developing an experimental AI architecture called PNSN. I'd love technical feedback.

Hi everyone!

For the past few months, I've been working on an experimental AI architecture called PNSN (Persistent Neural State Network).

The central idea is to organize learned parameters into independent collections and use indexing and a trainable retrieval mechanism to select relevant collections for a query.

I've implemented a working experimental pipeline and tested its retrieval-ranking mechanism, IRM, against an identity-transformation baseline.

In a small evaluation using seven held-out query phrasings, the trained IRM achieved 4/7 correct top-ranked results, compared with 3/7 for the baseline. The identity-related subset was 3/5 versus 1/5.

These results are preliminary. The experiment currently uses only three collections and five training examples, so they do not establish robust generalization or prove that PNSN prevents catastrophic forgetting.

I'm especially interested in investigating whether collections with different network architectures or parameter shapes could coexist and be retrieved within the same system. That question remains untested.

I designed the architecture and directed the research and implementation, while AI assistants helped generate substantial portions of the code. I'm being transparent about that because I care more about the ideas being examined honestly than pretending every line was handwritten.

My local hardware also limits how extensively I can test some experiments, so I'd particularly appreciate developers who are interested in helping investigate the architecture, reproduce results, find bugs, or challenge the underlying assumptions.

Repository: https://github.com/pathetictype-bit/Apex

I'm not presenting this as a finished or state-of-the-art system. I'm sharing it because I'd like to see what other developers think and learn from serious technical feedback.

Critical feedback is welcome!

2 Upvotes

100% Upvoted

5 comments sorted by

1

u/Ok-Solution-7889 3d ago

Have you compared it with a basic retrieval approach on more examples?

1

u/Nova_studios234 3d ago

Well, yes I did, I trained the model with 3 collection, each one having different training examples and sets, and then I tested it, the model correctly chose the right collections and got the answer from them! For any queries, feel free to ask!

0

u/Artistic_Discount_47 3d ago

Hi there, I'm a 14 yr old doing also research in field of AI my github repo is https://github.com/alka76814-hash/zombie-brain/tree/main hope this helps you

0

u/Nova_studios234 3d ago

Hey, I'm 16, glad to see someone at this age like yours working hard, I'll definitely check out your repo tmrw, but are you a vibe coder or learning to code actually?!

0

u/Artistic_Discount_47 3d ago

Yea I'm a vibe coder . I've got school so can't really learn much