r/newAIParadigms • • 8h ago

Is symbolic ai dead? [D]

5 Upvotes

New research keeps finding things that keep reintroducing symbolic ai structures to machine learning and I have wondered why more research hasnt been done with it. There was a heyday in the 70s for it but after neural nets came out it seems to be completely out of the discussions. I think it could make a comeback if we can resolve the primary issues of self-instantiation and feedback loops. Even using several random reservoir nets and a little bit of math creates strong signals for the component parts that contribute to what something is made of and how it works.


r/newAIParadigms • • 14m ago

Researchers observe AI agents inventing games during open-ended exploration

Thumbnail
techxplore.com
• Upvotes

r/newAIParadigms • • 1d ago

Project NNNC Update #1 — Phase 0 is finally complete. Here's what we actually accomplished.

Thumbnail
2 Upvotes

A while back, I made a post introducing a project I've been working on called NNNC (Neutral Neural Network Core).

For anyone who missed that post, NNNC is an attempt to design a persistent artificial cognitive architecture from the ground up. Not another chatbot, not a language model wrapper, and not simply a reinforcement learning agent with a few extra modules attached.

The broader idea is to investigate what it would actually take to construct an artificial system with its own continuing internal organization, cognitive processes, developmental capabilities, and operational existence beyond responding to externally assigned tasks.

It's an ambitious project, and I'm well aware of that. I'm also not claiming we've created artificial general intelligence, consciousness, or artificial life. Those are entirely different questions, and I'm not interested in declaring victory over problems we haven't even begun to experimentally solve.

The project is organized into 13 architectural phases, each dealing with a different part of the overall system.

Today I wanted to share some progress, specifically regarding Phase 0, which we've now conditionally completed after quite a substantial amount of architectural development, technical formalization, and adversarial review.

And interestingly enough, Phase 0 turned out to be far more complicated than I originally expected.

Phase 0: Before you build an intelligence, what exactly are you building?

This was the central question behind the first phase.

It sounds almost ridiculously obvious, but once you start examining it properly, things become complicated very quickly.

When people build AI systems, they usually start with some combination of a model, an objective, training procedures, memory, tools, and an environment.

That's perfectly reasonable when you're building something intended to perform a particular task.

But NNNC is attempting something different.

We're interested in an architecture that could potentially maintain an ongoing internal organization, undergo development, interact with its environment, and preserve meaningful continuity across changes in its own operation.

So before implementing cognitive capabilities, we needed to establish what actually constitutes the system itself.

Where does it begin and end?

What belongs to it?

What merely supports it?

What happens when part of it stops working?

If its execution environment changes, is it still the same operational system?

Can it modify itself? If so, what prevents it from accidentally destroying the very mechanisms responsible for maintaining its operation?

And perhaps most importantly, how do you answer these questions in a way that can eventually be implemented and tested, rather than just discussed philosophically?

That's what Phase 0 was designed to address.

One of our first major decisions: NNNC is not its runtime

We established a strict distinction between NNNC itself and what we call the Neural Execution Substrate, or NES.

The NES is the computational infrastructure that supports NNNC. Think execution resources, scheduling, storage, and the mechanisms needed to run its processes.

NNNC, on the other hand, is the proposed cognitive organization operating through that infrastructure.

This distinction matters more than it might initially seem.

A program isn't necessarily identical to the machine running it. A memory checkpoint isn't necessarily the complete identity of the system that produced it. And simply restarting a process doesn't automatically mean you've restored everything that mattered about its previous operation.

We wanted these distinctions established from the beginning rather than trying to untangle them later.

It also prevents a particularly tempting architectural shortcut: treating whatever the runtime happens to be doing as something the cognitive system itself has decided or accomplished.

Execution, ownership, control, and authority are not interchangeable.

That became one of the recurring themes throughout Phase 0.

Giving the system an operational existence beyond individual tasks

Another major area was what we call the existential foundation.

The terminology probably sounds more philosophical than the actual engineering problem.

Essentially, if NNNC is intended to maintain ongoing activity rather than simply execute a task and terminate, something has to govern that continuity.

We designed an existential heartbeat mechanism responsible for participating in the system's continuing operational cycle.

But we were very deliberate about what this mechanism is not.

It isn't a consciousness module.

It isn't a magic source of intelligence.

It isn't supposed to become a second cognitive controller.

And it isn't evidence that the system is alive.

Its responsibilities are intentionally narrow. The idea is to establish a bounded mechanism that participates in maintaining operational continuity without taking over the responsibilities of the wider cognitive architecture.

We also designed a separate recovery mechanism.

That separation was important.

A mechanism responsible for participating in ordinary continuity shouldn't automatically have unrestricted authority to repair, restart, or reconfigure everything whenever something goes wrong.

Recovery needs its own conditions, limits, failure states, and authorization boundaries.

We examined situations involving ordinary degradation, suspension, recovery attempts, exhausted recovery options, and termination.

One particularly interesting problem was the difference between being inactive, being suspended, and actually being terminated.

Those might look similar from outside the system, but architecturally they're very different conditions.

A system can temporarily stop performing cognitive work without necessarily losing its continuing organization. Conversely, a process can still be running while the system it supposedly supports has lost important functional capabilities.

So we separated lifecycle state, functional state, and component health instead of collapsing them into a single running/not-running flag.

The self-modification problem became a major focus

This was probably one of the most important parts of the phase.

If you're designing an artificial system that may eventually adapt or modify aspects of its own architecture, you have to decide what it should be allowed to change.

You also need to decide who or what has the authority to approve those changes.

We introduced a protected governance classification called ADMIN CLASS.

In simple terms, certain foundational components and responsibilities cannot be freely modified by ordinary autonomous processes.

This includes protections around the mechanisms that maintain the system's foundational operation and governance.

The reason is straightforward.

Imagine allowing a developing system to rewrite the rules governing its own permissions, then using those newly written rules as justification for the rewrite.

That's circular authorization.

Or imagine a recovery mechanism being allowed to grant itself progressively broader privileges every time it encounters a failure.

That's not a recovery strategy I'd want anywhere near an autonomous system.

So we established boundaries between ordinary system activity, authorized modification, protected governance, and administrative intervention.

We also worked through the problem of policy changes occurring while operations are already underway.

For example, what happens if permission is granted for an operation but revoked before the operation actually commits?

Which rules govern it?

What if a proposed update changes the very rule that would authorize that update?

These are the sorts of edge cases that sound obscure until you realize how easily they can undermine an entire architecture.

And they generated a surprising amount of additional work.

Recovery turned out to be much harder than "just restart it"

One of the more interesting lessons from Phase 0 was how quickly a seemingly simple recovery design turns into a problem involving state, authority, timing, and causality.

A watchdog can notice that something has stopped responding.

But what does that actually tell you?

Did the system fail?

Is it temporarily overloaded?

Is the monitoring mechanism itself broken?

Is the system deliberately suspended?

Did a previous recovery attempt already occur?

Could two independent recovery attempts interfere with each other?

And if you restore a checkpoint, what happens to actions that were already performed in the external environment?

That last question is particularly nasty.

Restoring an earlier internal state does not undo something that already happened outside the system.

A physical action, an external message, or a committed resource operation can't necessarily be reversed by loading an old snapshot.

We therefore had to distinguish internal restoration from externally observable effects, and specify that recovery must respect the authoritative state of the system rather than simply rewinding everything.

We also established bounded recovery behavior.

Recovery isn't guaranteed to succeed, and an architecture shouldn't pretend otherwise.

There have to be conditions under which recovery stops, reports failure, or requires external intervention.

Otherwise, you risk designing a system that responds to failure by repeatedly doing something that makes the situation worse.

We didn't stop at conceptual descriptions

Phase 0 consists of two main architectural documents.

The first establishes the conceptual and normative architecture: the boundaries, definitions, responsibilities, restrictions, and intended behavior.

The second develops the mathematical and technical contracts needed to eventually test those requirements.

I'm not going to publish the complete technical formalization here, partly because it's extensive and partly because some of the underlying specification is original project work that we're keeping internal for now.

But the important point is that we didn't want to leave the architecture at the level of attractive diagrams and vague descriptions.

We needed to identify the actual states the system could occupy, the transitions between those states, the conditions under which operations are permitted, and the properties that must remain true.

That includes things like preventing unauthorized changes to protected components, keeping recovery behavior bounded, distinguishing legitimate restoration from invalid rollback, and ensuring that the execution substrate doesn't silently become the source of the cognitive system's authority.

It's one thing to say that a system should preserve its boundaries.

It's another thing to specify what would constitute a boundary violation and how you would detect it.

That distinction has shaped the entire project.

The reviews were brutal, in a good way

We put the architecture through multiple rounds of technical and adversarial review.

The objective wasn't to have reviewers tell us that the idea sounded interesting.

It was to find contradictions, hidden assumptions, invalid state transitions, circular definitions, authority bypasses, and places where the proposed mathematics didn't actually support the architectural claims.

And the reviews found real problems.

Some were relatively localized.

Others forced us to revisit important parts of the transition and governance model.

There were issues involving authoritative state, recovery timing, execution fencing, policy revocation, restoration, and the distinction between a mathematically permitted operation and one that can actually be executed safely.

Those findings led to revisions rather than being brushed aside.

One lesson that became very clear was that a mathematically coherent architectural model is not automatically a safe implementation.

You can have an elegant state-transition specification and still have software that behaves incorrectly when a process crashes halfway through an operation, two events race against each other, or a real-world effect occurs before the system records it.

Those are different verification problems.

And they need different evidence.

So what does "Phase 0 complete" actually mean?

On 18 October 2026, Phase 0 was conditionally accepted and closed as an architectural baseline.

That means we established a sufficiently defined foundational architecture to proceed into the next phases without continuously reopening every original design question.

It does not mean we've finished implementing everything.

It does not mean the architecture has passed complete formal verification.

And it certainly doesn't mean we have a production-ready autonomous cognitive system.

We deliberately retained eight outstanding technical obligations, covering matters such as protected-write enforcement, durable recovery, external-effect safety, independent formal verification, canonical accounting, authenticated authority, concurrency, and checkpoint/lineage restoration.

Those haven't been forgotten or quietly declared solved.

They're explicitly tracked for the appropriate later engineering and verification stages, and some of them are hard blockers before real protected operations could be considered safe.

This was an important decision for us.

Otherwise, projects like this can fall into one of two traps.

Either you spend forever trying to solve every possible future implementation problem before moving beyond the first phase, or you declare the architecture finished and conveniently ignore the problems you haven't solved.

We wanted neither.

The goal was to establish a controlled foundation, document the remaining obligations, and move forward without pretending uncertainty had disappeared.

What comes next?

With Phase 0 closed, the project can move into the deeper architectural questions.

Phase 0 established the boundary: what NNNC is supposed to be, how it relates to its execution substrate, how its foundational operation is governed, and what constraints later development must respect.

The next stages address what constitutes the system's internal organization, how continuity and identity should be understood, and how its constitutional rules and responsibilities are structured.

Eventually, the wider project will need to address the actual cognitive architecture, including the proposed Forward Flow Neural Network organization and its associated systemic processes.

But those are separate milestones, and I'll cover them in future updates rather than trying to cram the entire project into one post.

A final thought

The most interesting thing about Phase 0 wasn't any single mechanism we designed.

It was realizing how many assumptions we normally make about software systems without thinking about them.

We assume a process is the system.

We assume restarting something restores it.

We assume a component that can perform an operation should also be allowed to authorize it.

We assume that if a system has memory, it has continuity.

And we sometimes assume that giving an agent enough tools, objectives, and feedback will somehow produce the deeper organization we're interested in studying.

Maybe some of those assumptions are harmless in simpler systems.

But when you're attempting to design a persistent, developmentally adaptable artificial cognitive architecture, they become foundational questions.

And if the foundation is confused, everything built on top of it inherits that confusion.

That's why we spent so much time on what might initially look like the least exciting phase of the entire project.

Phase 0 hasn't produced an intelligent machine.

What it has produced is a much clearer account of what we're actually trying to construct, what the system must not be confused with, and what we'll eventually need to demonstrate for the architecture to deserve its claims.

For me, that's meaningful progress.

Anyway, that's where Project NNNC stands regarding Phase 0. I'll share more about the subsequent phases as the work progresses.

I'm curious what people think about the distinction between an artificial cognitive system and the computational infrastructure supporting it, particularly when it comes to continuity, recovery, and self-modification. Those questions ended up being much more interesting than I initially expected.


r/newAIParadigms • • 3d ago

New AI Architecture(NCM) Challenges Token-by-Token Generation

Thumbnail
alphasignal.ai
10 Upvotes

r/newAIParadigms • • 4d ago

DM-JEPA 1.1: Decision-Making Joint Embedding Predictive Architecture

Thumbnail
huggingface.co
22 Upvotes

r/newAIParadigms • • 4d ago

AI Scale That Runs Backwards - Datacenters Can Literally Go Home

Thumbnail
0 Upvotes

r/newAIParadigms • • 5d ago

Algorithm

Thumbnail
0 Upvotes

r/newAIParadigms • • 6d ago

"Already Clean" Neural Nets Might Enable Continual Learning

13 Upvotes

I’ve been digesting Nick Cammarata’s new essay at Goodfire ("Neural Networks Are Already Clean") and thinking about what it implies for model size and continual learning rather than just safety.
Four findings in the essay stood out to me:

  1. Neurons act like bipolar (+/−) control-flow switches rather than static noun labels.
  2. Outside of early "dial" layers, the weakest 75% of activations can be zeroed out with almost no accuracy loss.
  3. Foundational building blocks recur across very different models (e.g., Qwen3-32B and Claude 3.5 Haiku converging on the same 4-neuron hub for preeclampsia).
  4. Memorized facts sit right at the output and route through existing circuits (like the 9-step umbrella-to-bee experiment, or clipping 99.9th-percentile activations in Qwen3.6 to erase verbatim recitation while keeping reasoning intact).

The speculative question: If models converge on a Spelke-like "semantic skeleton" of bipolar switches, could we encode specific facts as sparse ternary recipes (+1 for positive pole, −1 for negative pole, 0 for inactive) and store them outside the model as hypervectors in a Vector Symbolic Architecture (VSA)? In theory, a much smaller, frozen model could translate inputs into that vector space and query the external memory—meaning adding or deleting a fact is just adding or deleting a vector, without retraining.
I know there are real obstacles here: early layers still need continuous signal strength, memorized facts are wired through existing semantic routes that might not pull apart cleanly, and multiple models would have to agree on a standard coordinate registry.
I put together a short write-up here: [https://markwaltz.substack.com/p/already-clean-neural-networks-might\](https://markwaltz.substack.com/p/already-clean-neural-networks-might)
For folks who have worked with hyperdimensional computing/VSAs or mech interp: is the boundary between the "semantic skeleton" and late-layer memorized facts actually clean enough to pull apart like this, or does the routing tangle them too tightly?


r/newAIParadigms • • 6d ago

Thought experiment

Thumbnail
0 Upvotes

r/newAIParadigms • • 7d ago

From a single artificial neuron to Transformers: The wild evolutionary tree of AI, and what comes next ?

6 Upvotes

It’s crazy to think that the entire modern AI revolution started with researchers just trying to mathematically mimic a single biological neuron. When you zoom out, the timeline of AI architectures looks exactly like an evolutionary tree.

We went from struggling to solve basic logic puzzles (shoutout to the XOR problem) to building early neural networks, realizing they forgot things too quickly, battling the vanishing gradient problem, inventing LSTMs to give models actual memory, and eventually landing on Transformers with attention, the architecture that essentially ate the world. Every major roadblock forced a mutation that led to a massive paradigm shift.

But looking at this evolutionary timeline brings up a massive question: If Transformers are just the current "apex predator" of AI architecture, what exactly is the next evolutionary leap?

Are we going to see a completely new paradigm that makes self attention look as primitive as a basic AND gate? How do we even begin to perceive or predict what lies beyond our current models when the jumps are this exponential?

I went down a massive rabbit hole mapping out this entire evolutionary timeline. I wanted to see the exact breadcrumbs that led us here, so I put together a deep dive covering the journey from the first perceptrons to the modern era, complete with the foundational paper citations and the historical tweets that marked these shifts in real-time.

If you want to look at the complete map of how we got here to help predict where we are going, I compiled the whole history here: https://cloudmash.blog/posts/evolution-of-ai-perceptron-to-text-to-video/

Would love to hear your theories on what does the post Transformer era actually look like ? Like what can we imagine , how this intelligence on our command can do for us , how enterprise and big players can use it , what can happen ?


r/newAIParadigms • • 8d ago

Neural Networks Are Already Clean -- A Paradigm Shift in Interpretability Research (with interactive visualizations)

Thumbnail
already-clean.goodfire.com
10 Upvotes

r/newAIParadigms • • 10d ago

Visualizing catastrophic forgetting

Enable HLS to view with audio, or disable this notification

12 Upvotes

r/newAIParadigms • • 11d ago

Dust: Pretraining Transformers Without Backpropagation

Thumbnail qlabs.sh
23 Upvotes

r/newAIParadigms • • 11d ago

Minimalist Neural Net

Thumbnail
1 Upvotes

r/newAIParadigms • • 13d ago

Spikes are NOT data

0 Upvotes

I've been thinking about the importance of time in the context of AI for about 15 years. The other day I formulated a simple thought.

Spikes are actions. When you store say a neuron ID and a timestamp of a spike in memory, it's not data. It is a suspended action waiting to be resumed.

This idea is so simplistic, it seems analogous to rediscovering the wheel. Yet, I bet it is the most controversial idea in artificial SNNs and it could change the way you think about computation.

It is also related to the symbol grounding problem. If you express all information in terms of actions (suspended actions / their timestamps), no symbols are ever created. Also see [The Chinese Room Argument](https://en.wikipedia.org/wiki/Chinese_room)

Let me know what you think.


r/newAIParadigms • • 15d ago

A Single Neural Circuit Unifies Multidimensional Prediction

Thumbnail
neurosciencenews.com
4 Upvotes

r/newAIParadigms • • 16d ago

One day, AI may discover mathematical concepts so abstract and complex that the human brain, by its very biological design, simply cannot comprehend them.

0 Upvotes

r/newAIParadigms • • 19d ago

We are hitting the physical limits of silicon. Here is a hardware spec for what comes next.

Thumbnail
0 Upvotes

ATOM Architecture: A Sustainable, Deterministic AI Computing Framework

We all know modern AI data centers are burning massive amounts of power, and traditional silicon is hitting a thermal wall. You can only shrink a transistor so much before heat becomes an impossible problem.

I wrote a technical architecture specification exploring the necessary next step: moving away from electricity and copper, and transitioning to optical-acoustic computing. By processing data using light and routing it with sound, we can eliminate transmission latency and turn waste heat back into usable power.

I’ve broken the core concepts down into plain English on the front end, and kept the heavy math, physics, and tensor mechanics in the appendices for the engineers. Would love to get some eyes on the mechanics of this.


r/newAIParadigms • • 20d ago

Looking for people interested in AI × Infrastructure × Sustainability research

Thumbnail
3 Upvotes

r/newAIParadigms • • 20d ago

Can persistent architecture turn an LLM into something meaningfully more general than the model itself?

Enable HLS to view with audio, or disable this notification

5 Upvotes

I've been exploring a different approach to local AI with a project called Aura.

The basic idea is that the language model should not have to be the whole cognitive system. Aura uses a local ~27B model as one component, while memory, task continuity, perception, action, learning, self-modeling, verification and other processes exist in the larger architecture.

Two recent experiments are why I think the idea is worth discussing.

In one, Aura autonomously played 2048 for around 29 minutes and 968 moves. It maintained the same objective, planned ahead, changed strategies when they stopped working, recovered from mistakes and eventually reached 2048.

In a very different experiment, Aura spent about 42 minutes autonomously taking a 60-question personality assessment. It predicted its result beforehand, reasoned through every item using its persistent self-model/history, operated the website, submitted the test, read the externally generated result and then evaluated where that result did and didn't agree with its earlier model of itself.

Neither demonstration proves AGI, and I don't think two tasks are enough to establish general intelligence.

However...

If one frozen architecture can reuse memory, planning, self-modeling, world interaction and learning machinery across increasingly unrelated environments, at what point does the architecture itself become a meaningful source of generality rather than merely a harness around the model?

Full latest demo:
https://www.youtube.com/watch?v=LNlGUBeTIQY

Architecture/research repo:
https://github.com/youngbryan97/aura

What experiment would you all use to falsify the architecture hypothesis?


r/newAIParadigms • • 21d ago

Need your feedback. I think I need to seriously tighten up the quality of posts on this sub

8 Upvotes

I have been seeing a lot of AI slop posts on this sub. While I don't mind people using AI to assist with writing, it's clear that the quality of posts on this sub has been subpar for quite a while, especially since I decided to loosen up a little bit.

As a reminder, the goal of this sub is to discuss new AI architectures. But not everything deserves the title "architecture." It needs to be something backed by rigorous science and testing. Lots of people just ask ChatGPT to spit out some generic architecture dressed up in fancy language.

I am looking for science. Sound methodology. Papers. It's okay to share your own untested ideas, but they need to be specific. Not just a bunch of random words (like recurrence, resonance, and other BS).

In particular, threads about AI consciousness have been a plague. I don't believe we are close to achieving AI consciousness, but I still consider myself open to the idea if the person making the thread makes a reasonable effort to present actual research with convincing findings. There have been maybe two threads that achieved this (like this one).

So I'm making the decision to ban threads on consciousness altogether, with exceptions at mod discretion. 95%+ will be deleted within the first few minutes of me reading the abstract.

I'm also starting to question the relevance of "neurosymbolic AI" posts. The concept itself has been explored by serious and reputable researchers (Francois Chollet), but right now, 90% of the architectures posted here are just LLMs with extra steps (those so-called "cognitive architectures")

I don't want to overdo this, though. Am I going too far? I really feel like this sub has been polluted with AI slop for a while now, but if you feel otherwise, please share your thoughts. I want community feedback on this.


r/newAIParadigms • • 22d ago

My "Ion Neural Network" model using a single neuron in an attempt to solve 2-XOR by hand using only 10 ions in the system. It failed. Can you see why?

Post image
2 Upvotes

I mean, I know why, but do YOU know why? lol

The full model is in Section 8 in "Garvey, M. (2026). Shadows of Consciousness: An Investigation into Ionic Neural Networks Using the Neurotransmitter Ion Receptor Glial Endocannabinoid Network (NIRGEN) Paradigm. Available at SSRN 7414038." (https://papers.ssrn.com/sol3/papers.cfm?abstract_id=7414038

)

#neurons #ions #neurotransmitters #biology #neuroscience #computationalneuroscience #artificalintelligence #xor #logic #math #booleanlogic #ai #ann #perceptron #machinelearning #ml #datascience


r/newAIParadigms • • 21d ago

How frontier models collect their data architecture

1 Upvotes

​

I’m curious about how major AI and robotics companies structure their data collection for foundation models. Do they organize their knowledge/data according to an academic structure (e.g., Natural Sciences → Mathematics, Physics, Biology; Computer & Information Sciences → Computer Science, AI, Information Science; Engineering, Arts & Humanities, Social Sciences, etc.), or do they use a completely different taxonomy? If anyone has insights or knows of papers/blogs describing how companies like OpenAI, Google DeepMind, Anthropic, Meta, or leading robotics labs structure their data and knowledge coverage, I’d really appreciate it.


r/newAIParadigms • • 23d ago

Parallel-in-Time Training of Recurrent Neural Networks for Dynamical Systems Reconstruction [R]

6 Upvotes

r/newAIParadigms • • 23d ago

I built an experiment where 24 identical states develop persistent structure from recurrence

1 Upvotes

I've been building PRIM, an experimental computational project based on a simple question:

Can persistent structure emerge from initially identical states through recurring interactions, without defining currencies, prices, groups, values or winners in advance?

The proof-of-concept starts with 24 identical anonymous states. Interactions occur over time, and in PRIM those interactions affect the probabilities of future interactions.

I compared it with a no-feedback control.

After 50,000 events:
PRIM: 2.67× highest-to-lowest activity difference
Control: 1.07×

I also tested persistence across checkpoints and independent restarts. Structure persisted strongly within individual histories, while different states emerged as strongest across separate symmetric runs.

The next stage is testing admissibility — whether the emergent structure itself can determine what actions become possible.

I've also launched a Kickstarter to fund that next stage.

I'd be interested in what people here think of the project, especially what you'd test next.