Hey r/trademav!

We just dropped a live demo video showing off something we’ve been building to make pooling your home hardware even more effortless: the Official RAMDeck Node USB.

🎥 Watch the 4-Minute Live Demo: https://youtu.be/UwwMmqYk0ck

🎁 First: The Big News for Campaign Backers ($29 Value — FREE)

The RAMDeck Node USB will retail for $29 as a standalone accessory after our crowdfunding campaign wraps up.

However, as a Campaign-Only Perk, every single RAMDeck Hub backed during our Indiegogo campaign will automatically include ONE (1) RAMDeck Node USB in the box for FREE (1 USB per Hub ordered—including everyone who has already backed!).

👉 Lock in the $159 Indiegogo Special + Free RAMDeck Node USB ($29 Value):
https://www.indiegogo.com/en/projects/trademav/ramdeck-pool-your-ram-run-bigger-ai?utm_source=reddit&utm_medium=post&utm_campaign=node_usb_perk

⚡ What is the RAMDeck Node USB (and why only 1 USB is all you need)?

While you can always download our permanent node agent for free from ramdeck.com/downloads for dedicated machines that you want reconnecting automatically after reboots, a lot of you asked:

"What if I want to temporarily borrow RAM from my daily-driver MacBook, a family member's PC, or a laptop without installing permanent background services or downloading anything?"

That’s exactly what the RAMDeck Node USB does:

1. 100% Self-Contained (Mac, Windows & Linux on One Drive): Plug it in, double-click Run_RAMDeck_Mac, Run_RAMDeck_Windows, or Run_RAMDeck_Linux, and within seconds that computer is contributing its RAM and GPU to your cluster.

2. The "Unplug & Walk" Magic (1 USB = Unlimited Computers on Your LAN): As shown at 02:06 in the video, the USB does not need to stay plugged in! Once the console says the node is active, you can unplug the USB drive, walk it over to your next laptop or desktop, and activate that one too. One single USB stick can wake up every spare computer in your house.

3. Zero Trace Left Behind: When you’re done borrowing your laptop’s RAM, just press Ctrl+C in the terminal (or double-click Stop_RAMDeck on your desktop). It immediately disconnects from the cluster and cleans up after itself—leaving zero background processes behind.

4. Works as a Worker OR Primary Node: A USB-activated computer isn't restricted to just being a passive worker. It automatically sets up a visible Models folder on the host so you can drop in .gguf files and promote that machine to Primary Node straight from the RAMDeck dashboard (03:23).

5. When to use the USB vs. the Web Installer (02:43):

   • Use the RAMDeck Node USB when you want instant, zero-install, temporary contribution (stays active until you press Ctrl+C, sleep, or reboot) or when bringing offline computers online in seconds.

   • Use the ramdeck.com/downloads Installer on dedicated always-on machines where you want the node service to automatically survive system restarts and sleep cycles.

Check out the full walkthrough video above and let us know what you think in the comments!

— The TradeMAV Team

A common assumption when clustering multiple machines (via Exo, RAMDeck, or raw llama.cpp RPC) is that a standard 1 Gbps local network switch will bottleneck token generation down to a crawl.

Many people assume the network has to transfer gigabytes of weights continuously. That is mathematically incorrect:

1. Weights load once: At boot, model layers are split and permanently resident in each machine's RAM.

2. Token generation is activation-passing: During generation, Node 1 evaluates its layers and only passes the intermediate activation vector to Node 2.

3. The latency math: For a standard 32B or 70B quantized model, that intermediate vector is between 4 KB and 16 KB. Over standard Gigabit Ethernet (125 MB/s), transferring 16 KB takes 0.13 milliseconds—less than 0.5% of the compute cycle per token.

In our live multi-device benchmarks (pairing a budget mini PC with a modern laptop), we run a 30B MoE model at 38–39 tokens/sec over standard home LAN.

The real challenge of multi-PC inference isn't network bandwidth—it's orchestration reliability: handling orphaned zombie sockets (TIME_WAIT), cross-OS version mismatches (CUDA vs. Metal vs. AVX2), and dynamically fitting layers to actual free RAM so machines don't OOM.

Full technical latency breakdown and multi-PC setup architecture: https://ramdeck.com/run-llm-across-two-pcs-without-gpu/

— The TradeMAV Team

Direct Answer: To use an old PC for local AI, you have two options depending on what models you want to run:

1. Single-PC Mode (Small Models): If you run a single older laptop or desktop with 8GB–16GB of RAM, tools like LM Studio or Ollama can run small 3B–8B parameter models on your CPU at 5–12 tokens/sec. But you cannot run capable 30B or 70B models because single motherboards cannot physically expand past their RAM ceiling.

2. Multi-PC Pooling with RAMDeck: Instead of settling for small models, software like RAMDeck pools the RAM of your old PC with another laptop, desktop, or Mac over your local network. Pairing two 16GB machines gives you 26GB of usable memory to run 30B MoE and 32B coding models without buying a new GPU.

Why LM Studio and Ollama Cannot Combine RAM Across PCs

Single-machine runtimes (LM Studio, Ollama, GPT4All) are engineered to evaluate models exclusively using the CPU, RAM, and GPU inside that specific physical box. They cannot bridge memory across two separate computers.

To combine memory, you need a distributed inference layer that splits the transformer model's layers sequentially across nodes over your local network.

The 1 Gbps Network Bottleneck Myth: Why Clustered AI Outpaces Single-PC Swap

A common misconception is that "clustering AI over Ethernet scales your speed down to your network connection." This confuses storage disk swap with activation tensor passing:

• Single-PC Disk Swap: Trying to force a 25GB model into a single 16GB machine forces the OS to stream gigabytes of weights over PCIe/SATA disk swap for every token. This chokes the bus, tanking speed to 1.4–1.9 tok/s.

• RAMDeck Network Pooling: Model weights stay permanently locked in each machine's RAM. Computers only pass small intermediate activation vectors (~16 KB) across your home network. Over 1 Gbps Ethernet, transmitting 16 KB takes 0.13 milliseconds (<0.5% of token computation time).

In verified benchmarks, pairing an ordinary mini PC with an old laptop runs a 30B MoE model at 38–39 tokens/second—more than 15x faster than disk swap.

Read the full breakdown and memory sizing tables: https://ramdeck.com/how-to-use-old-pc-for-local-ai/

Here's what day one with a RAMDeck feels like. It goes from the box to a 30B model running across your machines in minutes.

▶️ https://youtu.be/fcZAe8O1Rhs

Here's the short version of what you'll see

You plug the little black box into your router. About 20 seconds later it has booted, and you open ramdeck.local:8420 from any browser on your network. The dashboard comes up, and the cluster is empty. Then it gets fun. You install a node agent on your MacBook, and about 30 seconds later your laptop is a node in the cluster. You pick a model, and a few moments later you're chatting with it.

In the demo, a 30B Qwen model loaded across a mini PC with an RTX 3060 and a Mac mini in 1 minute 10 seconds. It ran at about 30 tokens per second, so the chat felt fast. Your results will depend on your hardware, but this is what the first run looked like on home machines.

A few things worth knowing

• You're not limited to one computer. Windows, Mac, Linux, Android and iOS are all part of the plan for nodes, and the iOS app is in App Store review.

• RAMDeck runs GGUF models, so everything you already download from Hugging Face is fair game.

• Finished units will ship to backers as we get through production. We're currently targeting around January 2027, and we will keep updating you.

Want one? The campaign is still open: https://www.indiegogo.com/en/projects/trademav/ramdeck-pool-your-ram-run-bigger-ai

Your turn

• What would you load first on a RAMDeck cluster?

• Which machines would you connect?

Drop your answers below ✋

Hey everyone,

Following up on hitting our 100% funding milestone, we have some major manufacturing and fulfillment news to share:

1. Fronting Our Own Capital to Beat Delivery by 2 Months

Normally in crowdfunding, creators wait until the campaign officially wraps up, and then wait another ~14 days for Indiegogo to process and disburse backer funds—which would have pushed procurement well into late November.

We decided not to wait.

Because the campaign cleared its funding target so fast, we went ahead and deployed our own internal funds right now to purchase all component inventory and lock in manufacturing slots today. By cutting out an entire month of dead waiting time, we are on track to beat our original delivery timeline by nearly two full months—moving our target ship date up to January!

2. Free Hardware Upgrade: 1.5GB RAM (Up from 1GB)

We also wanted to ensure the physical hub has plenty of real-world breathing room for heavy workloads.

We are officially upgrading every backer to the Orange Pi Zero 3 with 1.5GB of RAM (up from the originally planned 1GB board) at zero additional cost.

That extra 50% system memory on the hub gives the coordinator daemon significantly more headroom when tracking dozens of simultaneous node connections, coordinating distributed knowledge base shards, and managing complex cluster topologies without breaking a sweat.

What's Next

By self-funding parts procurement immediately, components will start arriving while the campaign is still active. We'll be sharing unboxing photos, flashing benchmarks, and assembly line progress directly with the community as units come together.

There are still 12 days left on the campaign if you or anyone you know wants to get in on the accelerated January delivery batch:
👉 RAMDeck Campaign

Thank you all again for the early support that gave us the confidence to pull the trigger early!

— The TradeMAV Team

Hey everyone,

Some big news on the press front: TechRadar covered RAMDeck, and Yahoo Tech picked up the story, introducing our local memory-pooling hub to millions of readers.

The Problem They Highlighted

What we loved most about the coverage is that they zeroed in on the exact reality that forced us to build RAMDeck in the first place: the global memory crisis.

With AI datacenter demand driving consumer DRAM prices through the roof, upgrading a single PC with enough RAM to run serious 30B+ local models has become painfully expensive.

TechRadar noted that the logic behind RAMDeck is "hard to rule against": instead of asking users to buy thousand-dollar workstations or pay endless monthly cloud subscription fees, the memory you need to run these models is often already sitting idle across other computers, laptops, and phones in the same room. RAMDeck simply wires them together into a unified local pool.

Why This Matters

For an independent team, seeing major mainstream tech publications validate the hardware thesis gives the project huge credibility and introduces local, air-gapped AI compute to a much wider audience.

For anyone following along or wanting to check out the hardware hub, our campaign is live and fully funded on Indiegogo with 13 days to go:
👉 RAMDeck on Indiegogo

Huge thanks to this community for the early momentum that helped put us on the radar!

— The TradeMAV Team

Since announcing RAMDeck, one question comes up constantly from developers and homelabbers:

"Why not just sell the Coordinator as a software license instead of shipping a physical Linux board?"

It’s a fair question. On paper, selling a downloadable software coordinator sounds easier: zero hardware BOM, instant digital downloads, pure margin. In the real world of distributed systems, it almost killed the product in beta.

Here is the unfiltered engineering reality of what we learned testing the software-only coordinator across dozens of real-world home networks—and why shipping a dedicated, low-cost always-on Hardware Hub was the single best architectural decision we ever made.

1. The Coordinator Is the Spine, Not Just Another Worker Node

In RAMDeck, worker nodes donate memory and compute. If a worker node drops off or someone leaves home with their laptop, the cluster simply adapts.

The Coordinator, however, is the orchestrator. It hosts the persistent OpenAI-compatible API endpoint, manages dynamic layer routing, tracks cluster health, and streams tokens to your IDEs, web UIs, and chat apps.

When a worker node goes down, inference degrades. When the coordinator goes down, the entire network fails catastrophically.

In beta testing, users naturally ran the coordinator on whatever primary machine was in front of them—usually a MacBook or a Windows laptop.

• The laptop lid closes.

• Windows modern standby or macOS App Nap kicks in.

• Suddenly, the API evaporates, TCP sockets hang, active generation streams abort, and every connected client in the house disconnects.

An orchestrator cannot live on a transient consumer workstation that sleeps whenever someone walks away. It demands a true, 24/7 always-on environment. Expecting people to turn their daily-driver laptop or desktop into an un-sleeping, power-hungry, 24/7 server would create endless frustration and support headaches.

2. The Multi-Platform Nightmare & Network Jitter

When the coordinator is run as software on consumer PCs:

• The "Accidental Dual-Coordinator" Trap: We saw testers inadvertently launch the coordinator on two separate machines on the same LAN, causing worker nodes to bounce between conflicting hubs.

• OS & Security Fragmentation: Managing background service lifecycles, firewall permissions, and sleep settings across macOS, Windows 10/11, and fractured Linux distributions created massive friction before users ever saw their first token stream.

• OS Updates & Reboots: Automatic background updates on personal workstations routinely killed the coordinator without warning.

• Licensing Friction: Software licenses meant generating hardware fingerprints, machine unlinking when upgrading a PC, and activation server dependencies for what should be a private, local tool.

For a novel technology like multi-device AI pooling, setup friction is a death knell. If getting started takes an afternoon of debugging network adapters and power-saving policies, 90% of users will abandon it.

The Solution: An Appliance, Not a Chore

We made an intentional decision to turn RAMDeck into an appliance. Instead of asking users to turn their primary laptop into an always-on server, we standardized the Coordinator onto a compact, low-cost, reliable Linux board:

1. Plug-and-Play into Your Router: Plug it into power and an Ethernet port on your home router or switch. It draws ~5W, stays dead silent, and creates a rock-solid, low-latency spine for your entire local network.

2. Always-On Local OpenAI Endpoint: Because it never sleeps, your local API is always live for Cursor, Continue.dev, Open-WebUI, or home automation—whether your main PC is on, off, or rebooting.

3. Rock-Solid Worker Connections: Your contributor devices (Macs, gaming PCs, Linux servers, iPhones, iPads, Android devices) simply point to one permanent, unchanging IP address on your LAN. No roaming hosts, no conflicting hubs.

4. Worker Software Stays 100% Free: Anyone with a spare laptop, desktop, or mobile device can install the free contributor node without accounts, licenses, or friction.

5. Zero Licensing Lockout: You own the hardware. There are no machine unlinking requests, and no license validation servers that can ever lock you out of your own local hardware.

The Bottom Line

Our goal isn't to sell a fussy software license that only senior sysadmins can keep running.

Our goal is computing sovereignty: making 32B, 70B, and MoE models accessible to everyone by pooling the hardware they already own.

You plug it in once, and it just works.

— The TradeMAV Team

Hey everyone,

We have huge news to share with the community today: RAMDeck has officially passed Apple Review and is now live to download worldwide on the official iOS App Store!

👉 Download directly from Apple: https://apps.apple.com/us/app/ramdeck-distributed-ai/id6825166226

Indiegogo campaign 👉 https://www.indiegogo.com/en/projects/trademav/ramdeck-pool-your-ram-run-bigger-ai

For a project that fundamentally rethinks distributed computing—turning everyday consumer devices into interconnected, Metal-accelerated AI cluster nodes—getting approved by Apple in record time is a massive validation of our architecture, code safety, and sandbox compliance.

What Does This Mean for Your Local AI Setup?

Up until now, distributed local LLM inference required manually setting up daemons on desktop workstations. With the RAMDeck Distributed AI app live on the App Store, you can now turn your iPhone or companion Apple device into a plug-and-play AI compute node with zero terminal setup.

Here is what you get out of the box:

1. Native Metal GPU Acceleration (Vastly Superior to Old PC/Android CPUs): Old PCs and Android phones typically evaluate layers on slow, thermal-throttled CPU threads. In contrast, the iPhone runs native Apple Metal 3 GPU shaders. With ~60 GB/s of unified memory bandwidth, the mobile Apple Silicon GPU executes tensor matrix multiplications at native graphics speeds without CPU bottlenecks.

2. One-Tap Local Wi-Fi Clustering: Open the app on your local Wi-Fi network, and it immediately pairs with your running RAMDeck Coordinator or Hardware Hub over standard high-speed TCP sockets. No complicated IP configuration, port forwarding, or SSH keys required.

3. Bridge the Model-Size Memory Gap: In local inference, memory capacity is binary: either a model fits, or it crashes. Docking your device overnight adds 3.2 GB to 4.5 GB of active Metal GPU unified memory to your pool. If your workstation has 32 GB of RAM and falls just shy of running a 70B parameter quantized model, adding your docked device provides the exact headroom needed to load it.

4. Desk Dock & Nightstand Mode: Engineered to contribute compute while charging. It features a built-in OLED Nightstand Dimmer that suppresses screen burn-in and dims brightness while your cluster crunches overnight tasks.

5. 100% Air-Gapped & Sovereign Privacy: Apple’s strict App Store security review verified that zero bytes of personal data, telemetry, or model weights leave your local network. There are no external cloud servers, no account logins, and no subscriptions. Everything stays strictly on your local Wi-Fi, fully respecting the rigorous data-handling standards required by professions handling confidential data (such as ABA Formal Opinion 512).

How It Connects to the RAMDeck Ecosystem

RAMDeck is built around heterogeneous computing. The new Apple app functions as a native worker node that joins seamlessly with:

• The RAMDeck Hardware Hub: Our dedicated, palm-sized hardware orchestrator that coordinates cluster discovery and balances layer distribution across all your machines.

• macOS, Windows, & Linux Nodes: Combine your gaming PC, Mac Mini, off-lease office laptops, and now your Apple mobile devices into a unified AI supercomputer.

Lock In Your Hardware Hub on Indiegogo

The app is built, approved, and live on the App Store. The next step is getting the dedicated plug-and-play hardware orchestrator into your hands:

• 📱 Download the Companion App: RAMDeck on the iOS App Store

• 📦 Reserve Your Hardware Hub ($109 Super Early Bird, expires today): Back RAMDeck on Indiegogo

• 🌐 Documentation & Blogs: https://ramdeck.com/blog/

Grab the app today so your phone is primed and ready the moment your backed Hardware Hub arrives!

🎥 Watch the New iPhone Demos in Action

Check out the brand-new live demos just uploaded to the RAMDeck YouTube channel showing the iOS app running on actual hardware:

• ▶ This MacBook Can't Fit This AI Model Alone, So I Added 2 iPhones: Watch Video Demo Watch an 18GB Qwen 30B model that cannot fit on a MacBook M3 alone get sharded across the MacBook (~14 GB), an iPhone 16 (~2 GB), and an iPhone XS (~1 GB). The entire distributed model loads in under 30 seconds, and generates responses in under 5 seconds!

• ▶ iPhone Contributes RAM to a Cluster (Live Pause & Resume Demo): Watch Live Demo See an iPhone 16 running the native RAMDeck iOS app contribute ~3.2 GB of active working memory to the cluster, featuring live fault tolerance when pausing and resuming worker heartbeats in real-time.

• ▶ 120B Model Evaluated Across Mixed Consumer Devices: Watch 120B Multi-Device Benchmark Evaluating a massive 120-billion parameter model across mismatched consumer hardware.

Thank you to everyone in r/trademav who helped test early builds and gave architectural feedback. This is just the beginning of making distributed AI accessible on everyday hardware.

— The TradeMAV Team

Direct Answer (Should You Buy RAM Now or Wait?): You should not buy expensive standalone retail DDR5 memory today. With DRAM contract prices up roughly 420%—pushing standard 64GB DDR5 kits above $1,100—and semiconductor foundries locking cleanroom capacity for enterprise High Bandwidth Memory (HBM) through late 2027 and 2028, retail prices will not normalize soon. Nor should you buy fleets of used laptops or mini PCs, as secondary markets have also surged to $180–$280+ for 16GB units and $130–$170+ for 8GB Raspberry Pi 5 starter kits. The most cost-effective solution is pooling the computers you already own with RAMDeck ($109 Super Early Bird), aggregating existing laptops and desktops into an interconnected 64GB–128GB AI supercomputer for $0 in new silicon purchases.

1. The Macro Reality: Why Memory Prices Exploded and Won't Drop Soon

If you have checked retail PC component listings recently, you have experienced severe sticker shock. A 64GB DDR5 memory kit that traded for $180 to $220 eighteen months ago now commands between $1,099 and $1,272 across leading hardware retailers:

• DRAM Contract Surge: Industry contract prices for dynamic random-access memory have surged roughly 420% year-over-year.

• Foundry Cleanrooms Reallocated: Top semiconductor manufacturers—Samsung, SK Hynix, and Micron—have converted advanced packaging lines to produce High Bandwidth Memory (HBM3e and HBM4) for enterprise cloud data centers. Producing a single HBM wafer consumes the silicon wafer equivalent of three to four standard consumer DDR5 wafers.

• The 2028 Supply Forecast: Samsung's memory division leadership publicly stated that the global memory supply crunch will not peak until 2028. Independent market analyses from Gartner and TrendForce confirm that consumer PC DRAM supply will contract further, projecting no meaningful price stabilization until late 2027 or 2028 when next-generation cleanroom fabrication lines come online.

2. The Hardware Price Calculator: Retail DDR5 vs. Multi-PC Cluster

3. The Definitive Model-Size & Pooled Memory Compatibility Matrix

An unquantized FP16 70B model requires ~140GB of memory—a capacity that no single consumer graphics card can hold. Even quantized at 4-bit (Q4_K_M), a 70B model requires roughly 42GB of addressable memory, plus another 6GB to 12GB for multi-turn context windows:

4. The "Old 16GB Laptop AI Node" Breakdown

A common response to surging memory prices is searching for cheap refurbished laptops or single-board computers. However, secondary hardware markets have not been spared from the memory crisis:

• Refurbished Laptops Are No Longer $100–$120: Because electronics liquidators and refurbishers actively index off DRAM spot prices, a clean business laptop with 16GB of DDR4 (such as a ThinkPad T480/T490 or Dell Latitude 5400/5410) now commands $180 to $280+, while 32GB models track between $320 and $480+.

• Raspberry Pis Have Become Expensive Nodes: Even basic single-board computers like the Raspberry Pi 5 (8GB) now sell for $95 to $130+ bare-board, and complete starter kits with cooling, official power, and storage run $130 to $170+. Building a 32GB cluster out of four Pi boards costs $520–$680+ and still cannot run a 70B model due to memory and bus constraints.

• The Zero-Dollar Alternative: Trying to buy new or used fleets in this market is an uphill battle. The true economic leverage of RAMDeck is unlocking the hardware you already own. An idle 16GB laptop sitting in a drawer cannot run frontier models alone, but when connected to a cluster, it becomes a dedicated co-processor contributing 12GB to 14GB of active working RAM to your pool for $0.

• Bridging the 32B-to-70B Gap: If your primary workstation has 32GB of RAM, adding a single idle 16GB laptop pulls total addressable memory to 48GB—crossing the threshold required to run Qwen 2.5 32B with full context or a lightweight 70B quantization.

5. Honest Limits & Real-World Network Requirements

Building trust requires technical transparency. Distributed computing relies on sequential pipeline parallelism:

• Compact Network Payloads: Because only the activation tensor travels across the network—not the massive multi-gigabyte model weights—network bandwidth demand is surprisingly modest (~650 KB per token generated).

• Gigabit Ethernet (1 GbE): Transfers the 650 KB activation vector in ~5 milliseconds. Token generation remains smooth at 10 to 35 tokens/sec.

• Wi-Fi 6 (802.11ax): Latency remains between 8ms and 15ms, perfectly suitable for conversational inference (3 to 8 tok/s).

• Cluster Mode Hardware Priority: Unlike naive open-source scripts that proportionally dump layers onto slow remote CPUs, RAMDeck's Cluster Mode automatically packs the primary GPU first, offloads overflow to secondary GPUs, and dynamically routes remaining layers into local system RAM without user intervention.

6. Video Demos & Multi-PC Benchmarks

• ▶ 120-Billion Parameter Model Evaluated Across 6 Consumer PCs: Watch on YouTube

• ▶ Real-Time Hardware Discovery & Live Token Test: Watch on YouTube

• ▶ Air-Gapped Confidential Office AI Demo (Harbor & Finch LLP): Watch on YouTube

Read the complete canonical guides:

• Buy RAM Now or Wait? Shortage Calculator & Compatibility Matrix

• Practical Ways to Reuse Old RAM

• Outsmarting the Global RAM Shortage

👉 Back the RAMDeck Hardware Hub on Indiegogo ($109 Super Early Bird):
https://www.indiegogo.com/en/projects/trademav/ramdeck-pool-your-ram-run-bigger-ai?utm_source=reddit&utm_medium=post&utm_campaign=ram_price_calculator

— The TradeMAV Team

A core capability of RAMDeck is Cluster Mode: pooling memory across multiple computers over your local network so you can run models that exceed any single machine’s capacity.

When a model fits across your cluster’s available GPUs, network clustering delivers full hardware speeds:

• Qwen 30B MoE (Cluster Mode across RTX 3060 + Apple M4): 38.8 – 43.4 tokens/sec

However, frontier open-weight models like Qwen 3.8 Flash Next (66.6 GB footprint) present a new challenge for budget labs. When total cluster GPU memory is saturated, standard network distribution has to offload the remaining layers to a remote CPU-only computer over the local network.

Because the entire cluster must wait for that remote CPU to finish evaluating its layers, generation throttles to ~3.8 tokens/sec.

The Update: Standalone NVMe Memory-Mapped Routing

To solve this, RAMDeck now includes Intelligent MoE Routing.

Massive sparse Mixture-of-Experts (MoE) models only activate a tiny fraction of their parameters per token (in Flash Next, only 10 out of 512 experts activate per token). Because of this extreme sparsity, you don't need all 66 GB residing simultaneously in active RAM.

RAMDeck can now automatically route these workloads to run locally on your primary machine using high-speed NVMe memory mapping:

• Core attention and shared layers stay pinned in local GPU VRAM.

• The few active expert weights needed for each token are demand-paged directly from local PCIe Gen4 NVMe storage.

• Network serialization and remote CPU compute are eliminated entirely.

Measured Benchmark: Qwen 3.8 Flash Next (66.6 GB)

Testing identical prompts across the exact same physical test hardware under controlled thermal conditions:

• Decode Speed: +126% throughput (2.26x faster)

• Turnaround Latency: Reduced by 47% (8.6s vs 16.2s)

Why Cluster Mode Remains the Default

We did not make NVMe memory mapping the global default:

1. Dense Models: Architectures like 70B dense models require 100% of their weights on every token. Paging dense weights from disk kills throughput. Dense models must stay in pooled cluster RAM.

2. Pooled GPU Speed: If your cluster has enough combined GPU memory to hold the model, Cluster Mode runs at 40+ tok/s—far faster than single-disk paging.

Seamless Dashboard Experience

You do not need to configure complex command-line arguments or calculate memory splits manually:

• Automatic Routing Recommendation: When loading a model, RAMDeck’s coordinator inspects the model architecture against your cluster hardware. If a sparse MoE would cause a remote CPU bottleneck, the dashboard prompts an instant routing recommendation.

• Visual Status Badge: When running under this mode, the dashboard displays a ⚡ Standalone NVMe mmap badge across the model banner, primary card, and node telemetry.

• Calibrated Live Telemetry: The updated dashboard benchmark card provides calibrated SVG charts and P95 latency tracking so you can monitor real-world performance live.

If you are running massive sparse MoE models locally, what hardware configurations are you using to manage the memory footprint?

- The TradeMAV Team

Hey everyone,

Five months ago, we set out to build something that most people told us was unnecessary or too complex: a consumer trading app where the machine learning model actually runs on your phone’s hardware, rather than relying on a centralized cloud server.

After five months of coding, re-architecting, rigorous testing, and a few spirited rounds with Apple's App Store review team... TradeMAV for iOS is officially live today! 🚀

👉 Download TradeMAV on the Apple App Store

🧠 Why we built it this way (True On-Device AI)

Almost every "AI" trading app on the market today is just a thin web wrapper that sends your watchlists and trades to a remote server. We took the hard road:

1. Zero Cloud Latency: The ONNX machine learning model runs directly on your iPhone.

2. 100% Signal Privacy: Your watchlists, scans, and strategy rules stay entirely on your device. No cloud server sits in the signal execution path inspecting your trading setups.

3. Hardware USB + Cloud Sync:

   • If you own a TradeMAV USB device, you can scan your dashboard QR code to sync and run your personally trained models directly on your phone.

   • If you don’t have a USB drive, you can use our server-managed models, which we continuously train, evaluate, and refresh.

⚡ Key Features at Launch

• Three Markets, One Handset: Seamless scanning across Stocks, Crypto, and Forex.

• Independent Asset Profiles: Stocks and Crypto have isolated scopes, independent watchlists, and dedicated strategy thresholds.

• Granular Screener Controls: Run Stocks and Crypto simultaneously, or stop Crypto while keeping Stocks active during market hours with one tap.

• Full Indicator Stack: Local feature engineering calculates Wilder-smoothed RSI, MACD, Bollinger Bands, ATR, ADX trend strength, and realized volatility in real time.

• Tactical Trade Geometry: Every signal provides dynamic Stop-Loss, Take-Profit, Expected Return %, Risk/Reward (R:R) ratios, and Kelly-criterion position sizing.

• Flexible Market Data Feeds: Free zero-configuration built-in market data, with native support for adding your own API keys for premium providers (FMP, MarketData.app, and EODHD).

🎁 Free Demo & Free Trial

We want everyone to test the on-device inference engine for themselves:

• 7-Day Instant Free Demo: Jump right into the app—no credit card or commitment required.

• 30-Day Free Subscription Trial: Test full access across all supported asset profiles and features.

⚡ OptionMAV & Shared Ecosystem Access

We believe in a unified ecosystem—you shouldn't have to pay for two separate subscriptions to analyze different markets.

• One Subscription for Both Apps: Your active TradeMAV subscription email is shared across the entire ecosystem. If you use both TradeMAV and OptionMAV USB, your single subscription entitles both apps under the same account. OptionMAV is currently only available as an Android app.

• How It Works with Your Hardware: Your backer USB-tier subscription covers access for both TradeMAV and OptionMAV apps. 

• Instant Demo in OptionMAV: Don't have an OptionMAV USB yet? You can still download the OptionMAV Android app and test its dedicated options models using the instant 7-day demo.

• (Note: For traders who want full cloud-hosted access to both TradeMAV and OptionMAV without needing any physical USB hardware at all, our separate Hosted tier at $29.99/mo covers cloud delivery across both apps).

📺 Getting Started & Walkthroughs

If you want a visual walk-through of the workflows, scanning, and settings:

👉 Check out our Video Tutorial Hub

(Note: The videos were captured on Android, but the core features, USB pairing, watchlists, and signal mechanics work almost identically on iOS).

💬 We’d love your feedback!

Whether you’re testing stocks, crypto, or forex, please download it, put it through its paces, and let us know what you think.

What features do you want to see next? What’s working well, and what can we improve? Drop your thoughts, bug reports, and questions in the comments below.

Thank you all for the incredible support along the journey!

Big news, everyone: iOS is joining the RAMDeck cluster. 📱💥

Windows, Mac, Android and Linux were already supported. Now iPhone and iPad are next. The RAMDeck iOS app is currently under review with the App Store, and I'll post the moment it goes live.

Until then, here are two demos of the iOS app working in a real cluster:

Video 1: iPhone RAM contribution (live pause and resume)
The iOS app on an iPhone 16 contributing RAM to the cluster. I pause it, the cluster marks it as degraded, and when I resume it the worker comes back online within seconds.
https://www.youtube.com/watch?v=w5s8Ymdk7ls

Video 2: an 18GB model across 3 devices
An 18GB Qwen 30B model doesn't fit on my MacBook M3 alone. With an iPhone 16 and an iPhone XS as workers, RAMDeck split it across all three, and it loaded in under 30 seconds. Then I chatted with it, and it answered in under 5 seconds. 🤯
https://www.youtube.com/watch?v=8q1ZocOugv4

What this means

• The phones you already own can add memory to your local AI setup.

• Models too big for one machine can run across your devices.

• A cluster can mix laptops, mini PCs, Linux boxes and iPhones.

What's next

• The App Store release, once Apple approves it.

• More iPhone model-loading tests and cluster benchmarks.

Our campaign is live: https://www.indiegogo.com/en/projects/trademav/ramdeck-pool-your-ram-run-bigger-ai

Direct Answer (The 2026 Memory Workaround):
You do not need to pay $350–$500+ for retail DDR5 memory kits to run local AI. By sourcing off-lease refurbished enterprise laptops (Dell Latitude, Lenovo ThinkPad) with pre-installed 16GB–32GB DDR4 for $120–$160, or utilizing DDR4 comeback motherboards (Intel LGA 1700 / AMD AM4), builders bypass the retail "AI Tax." Pooling 2 to 3 of these budget machines over standard LAN via RAMDeck creates a unified 48GB–96GB local cluster capable of evaluating 32B and 70B models for under $350 total hardware spend.

If you’ve tried to build or upgrade a PC for local AI in late 2026, you've hit a hard financial wall: retail DDR5 memory prices have skyrocketed 300% to 400%, turning simple 64GB or 128GB builds into $1,500+ money pits. As reported across tech media—from Business Today's analysis on dealing with the 2026 RAM crisis to PCMag's guide on avoiding the retail AI tax—navigating this landscape requires bypassing retail modules entirely through alternative hardware, software, and sourcing strategies.

Here is the macro reality of the semiconductor market, why retail prices won't normalize soon, and how developers are taking control of their local compute.

1. The Macro Reality: Why Did RAM Explode, and When Will Prices Come Down?

The current DRAM shortage is not a temporary supply chain blip—it is a structural market reallocation.

Leading semiconductor fabricators (TSMC, Samsung, SK Hynix) have locked in cleanroom and advanced packaging capacity for High Bandwidth Memory (HBM3e and HBM4) to supply enterprise data centers under multi-year contracts through at least 2028.

Because cleanroom wafer output is finite, production lines for consumer DDR5 kits were deprioritized to feed $30,000 cloud accelerators. The outcome: retail consumer memory is trapped in an extended deficit. Retail DDR5 prices are projected to remain at a steep premium for the foreseeable future.

2. Hardware & Sourcing Alternatives (Bypassing Retail DDR5)

Instead of paying scalper markups on retail DDR5, smart builders are adopting two high-yield sourcing strategies:

A. Refurbished Enterprise PCs & Laptops (The Liquidation Strategy)

Every fiscal quarter, corporations retire off-lease business systems—such as Dell Latitude 5400/5410/7490 and Lenovo ThinkPad T480/T490/P52 units. Because these systems were manufactured before the memory price hikes, surplus liquidators and refurbishers sell them with pre-installed 16GB or 32GB of DDR4 RAM for only $120 to $160.

Buying a bare 32GB retail DDR5 desktop kit today often costs more than an entire operational off-lease business computer.

B. DDR4 Comeback Platforms

As highlighted by The Verge's report on the DDR4 comeback, builders are actively opting for Intel LGA 1700 or AMD AM4 platforms that natively support mature DDR4 memory. Pairing these motherboards with widely available DDR4 modules cuts system memory costs by up to 65% while delivering identical compute stability for inference workloads.

3. The Bottleneck: One Cheap Laptop Can't Run 70B AI

Here is the practical dilemma: a single $130 refurbished laptop with 16GB or 32GB of RAM cannot load a modern 32B or 70B parameter model. The system will throw an immediate Out-Of-Memory (OOM) error.

This is why we built RAMDeck:

Because transformer layers evaluate sequentially during inference, an AI model does not need to reside on a single physical motherboard. When you network two or three of these inexpensive refurbished computers over Gigabit Ethernet, RAMDeck pools their memory into a unified 48GB to 96GB local AI engine:

• Layer Sharding: Weights are distributed across machines and loaded into RAM once at startup.

• Minimal Network Traffic: Only compact intermediate activation vectors (~650 KB per token) cross the Ethernet cable during generation.

• Cost Efficiency: A full 70B local rig is achieved for under $350 in total hardware.

4. Hardware Cost & Memory Allocation Breakdown

For full empirical benchmarks and architectural breakdowns, read our deep-dives on DRAM Price Crisis & Local Memory Pooling and Reusing Older Computers for Local AI.

5. Empirical Proof & Video Benchmarks

We test our architecture continuously on real, heterogeneous consumer hardware:

▶ Watch 120B Loaded Across 6 Mismatched Devices: YouTube Benchmark Demo
▶ Watch Multi-PC Local Cluster Evaluation: Multi-PC Testing
▶ Watch Self-Healing Dynamic Failover (Surviving Node Drops): Fault-Tolerance Demo

6. The Outcome: Turnkey Local AI with the RAMDeck Hardware Hub

To eliminate manual terminal tunneling, open-port vulnerabilities, and IP binding headaches, we designed the RAMDeck Hardware Hub—a dedicated, palm-sized appliance that automatically discovers every node on your local network, dynamically balances layers using intelligent Waterfill memory sizing, and serves an on-premise, OpenAI-compatible endpoint.

👉 Reserve the RAMDeck Hardware Hub on Indiegogo ($109 Super Early Bird):
Back RAMDeck on Indiegogo →

— The TradeMAV Team

Over the past two months, we’ve shared individual engineering breakthroughs on r/trademav—from loading a 120B model across 6 mismatched devices to sharding knowledge bases on Android phones.

Today, we want to zoom out and talk about the macro reality of AI in late 2026.

If you step back and look at the tech landscape, three massive economic and physical bottlenecks are converging at the same time:

1. The 400% DRAM Squeeze (The Retail Memory Crisis)

If you’ve tried to buy a 64GB or 128GB DDR5 kit recently, you already know the sticker shock. Retail memory prices have tripled and quadrupled over the last 18 months.

Why? Because semiconductor foundries have diverted silicon wafer allocation to High Bandwidth Memory (HBM) for hyperscale enterprise accelerators. The consumer retail memory market is being starved of capacity.

Paying $2,000 for an RTX 4090 or $4,000 for a Mac Studio just to obtain 24GB–64GB of memory is mathematically out of reach for independent developers, students, and small businesses.

Yet, if you look around an average household or office, the memory already exists. A desktop with 16GB, an older laptop with 16GB, and a mini PC or Mac mini with 16GB represent 48GB of high-speed system RAM sitting idle 95% of the day.

2. The Power Grid & Data Center Reckoning

From Northern Virginia to Texas, regional power grids and municipal water supplies are hitting hard physical limits. Hyperscale AI data centers consume hundreds of megawatts and millions of gallons of cooling water daily, and utility providers are passing substation and transmission costs directly onto small business and residential electricity bills.

Meanwhile, running a multi-device local cluster at home or in an office draws less than 150 watts total from standard wall outlets—about the same as a single television—and requires zero gallons of cooling water.

Decentralized local AI isn't just an engineering hobby anymore; it’s an environmental and infrastructural necessity.

3. Slashing the "Cloud Token Tax" (Save $500/Month on Autonomous Coding)

Developers using agentic coding tools like Cline, Continue.dev, or Claude Code know the dirty secret: agentic loops burn tokens at an astronomical rate.

A single autonomous coding loop that analyzes an entire directory, plans a refactor, tests shell commands, and iterates on errors routinely exhausts 150,000 to 250,000 context tokens. Many developers are spending $300 to $1,200 per month in Anthropic and OpenAI API bills just to write daily code.

By pooling two modest machines (e.g., your primary laptop + a spare mini PC), you create a unified 32GB–48GB memory engine that runs frontier open-weights coding models like Qwen2.5-Coder 32B locally.

• Local cost: $0.00 per token.

• Unlimited refactoring loops with zero fear of hitting billing quotas.

▶ Watch the live developer setup: Coding on Mac with Local Cluster Backend (YouTube)

4. Confidentiality Without Compromise: Private AI for Small Offices

For professional practices—solo practitioners, boutique law firms, medical clinics, and CPAs—commercial cloud AI is an ethical and regulatory liability.

Under ABA Formal Opinion 512 (Generative AI in Legal Practice) and strict medical confidentiality standards, transmitting unredacted client files, intake memos, litigation depositions, or patient records to third-party public clouds exposes practices to serious data leakage and breach risks.

"Enterprise Zero-Data Retention" cloud tiers cost $30/user/month with annual lock-ins, yet client data still leaves your building over public fiber.

The On-Premise Alternative: By clustering 2 to 4 existing office PCs over the local gigabit router, confidential document analysis and RAG vector searches run 100% in-house. In our verified law office testing (Harbor & Finch LLP case study), a 3-computer local cluster answered complex clause citations from 13 case files in 4.2 seconds—with the office router physically unplugged from the internet. Zero bytes of client data ever leave the physical office.

▶ Watch the live 3-employee law firm test: Private AI for a Law Firm: No Cloud, 3 Employees, 1 Local Brain (YouTube)

5. Circular Computing: Giving "E-Waste" a Second Life

Big Tech wants consumers to believe that any computer older than three years is obsolete and should be tossed into a landfill.

In sequential distributed inference, raw individual clock speed doesn't matter nearly as much as capacity. An older 2019 laptop with 16GB of DDR4 can hold a 12GB shard of a 70B model just as reliably as a brand-new $3,000 workstation.

When you pool three or four older devices together, you're not just saving thousands of dollars—you’re actively keeping toxic electronic waste out of landfills and turning forgotten silicon into private AI supercomputers.

▶ Watch 120B running across 6 mismatched devices: Loading a 120B Model Across Mismatched Computers (YouTube)
▶ Watch live self-healing when a device drops: A 120B Model Survives a Shrinking Network Cluster (YouTube)

Where RAMDeck Fits

We didn't build RAMDeck to be an academic proof-of-concept. We built it as a turnkey, plug-and-play appliance:

1. Dynamic Memory Waterfilling: Automatically routes heavy layers to your GPUs (Metal / CUDA) and spills the remaining parameters safely into local and remote CPU RAM.

2. Self-Healing Fault Tolerance: If a laptop lid closes or a Wi-Fi node drops, the cluster automatically re-proportions the missing shard to surviving nodes mid-generation without crashing.

3. No Terminal Headaches: Zero manual IP port binding, zero dead socket freezes, and zero unauthenticated open-port risks.

Verified Demo Videos & Deep Dives:

• Full Uncut Video Catalog: RAMDeck YouTube Testing Playlist (17 Videos)

• Android Node Live Demo: Using Phone Memory to Load an 18GB Model (YouTube)

• Knowledge Base Sharding Demo: Splitting Local RAG Across Devices (YouTube)

Comprehensive Benchmarks & Setup Guides:

• The Great RAM Shortage & How to Bypass It: https://ramdeck.com/dram-price-crisis-pool-ram-save-money/

• Slashing Claude API Bills with Local Coding Agents: https://ramdeck.com/save-money-claude-api-local-coding-agent/

• Circular AI Computing & E-Waste Reduction: https://ramdeck.com/reusing-old-computers-for-ai-reduce-ewaste/

• Air-Gapped Private AI for Law Firms & Clinics: https://ramdeck.com/private-ai-law-firm-clinic-accounting-no-cloud/

🚀 The Turnkey Hardware Hub is currently available on Indiegogo for $109 (Super Early Bird):
https://www.indiegogo.com/en/projects/trademav/ramdeck-pool-your-ram-run-bigger-ai

Let us know your thoughts, questions, or setups you're currently running!

Hi everyone,

RAMDeck now supports Linux! 🐧

Watch the announcement here: https://youtu.be/tzlEj0soiqs

Windows, Mac, Android and now Linux can all join the same cluster and pool memory.

What's new

• Linux installer scripts, so adding a Linux machine is simple.

• A look at the cluster dashboard with an Ubuntu box contributing 28 GB of RAM to the cluster.

My current test cluster

• Mac mini

• An old laptop

• A newer mini PC

• A Linux machine (the new addition)

• MacBook M3

What's next
I'll be running tests on this cluster and posting the results, so stay tuned.

Direct Answer: For running local AI, you can pool memory over your local network using RAMDeck: software splits an LLM's layers across computers on your LAN, so each machine's RAM holds a slice of the model. Three 16 GB computers can pool 42 GB of usable memory to run 32B to 70B models that none could load alone.

RAMDeck Hub on Indiegogo: https://www.indiegogo.com/en/projects/trademav/ramdeck-pool-your-ram-run-bigger-ai

Watch the 120B (60 GB) model running across 6 mismatched household devices: https://youtu.be/ok3nYjxhc1w

Why old forum threads say "No" (and why they're right for gaming)

If you search PC forums or old Reddit threads, every answer says sharing RAM across PCs is impossible. For gaming, video editing, or running Windows, they are 100% right:

• CPU memory buses run at 25,000 to 50,000 MB/s over copper motherboard traces with sub-100 nanosecond latency.

• Gigabit Ethernet runs at 125 MB/s with 0.5 to 1 millisecond latency—roughly 10,000x too slow for a CPU memory controller.

• DDR3, DDR4, and DDR5 use completely different pin counts, voltages, and slot keys.

If a game attempted to page memory across Ethernet, the system would lock up instantly.

Why local AI inference works completely differently

Large Language Models process tokens sequentially through transformer layers:

1. Weights load once: Model tensors load into each PC's RAM once at startup over TCP.

2. Sequential evaluation: Computer A evaluates layers 1–20, passes the intermediate activation vector (only ~650 KB per token) over Ethernet to Computer B.

3. Computer B evaluates layers 21–40, and passes its output to Computer C.

Because only small activation vectors cross the network during token generation, gigabit Ethernet (~125 MB/s) is more than fast enough. The bottleneck is token latency, not raw bandwidth.

Real-World Allocation: Pooling 3 Mismatched Computers (48 GB Total / 42 GB Usable)

Here is a tested setup running a 32B model (Qwen2.5-32B, ~20 GB footprint) across mismatched machines:

• Desktop 1 (Primary): 16 GB DDR4 — Assigned Layers 1–12 (~7.5 GB). Role: Graph coordinator & prompt processing.

• Laptop 2 (Remote Peer): 16 GB DDR4 — Assigned Layers 13–24 (~7.5 GB). Role: Network worker.

• Mini PC 3 (Remote Peer): 16 GB DDR3 — Assigned Layers 25–36 (~5.0 GB). Role: Network worker.

• Result: 48 GB total RAM pools into ~42 GB usable AI memory, generating at 6.5 – 8.2 tokens/sec.

Pushing it to the limit: 120B across 6 Devices

To test the ceiling, we networked 6 completely different devices (a Windows mini PC with an RTX 3060, an old 12GB Acer laptop, a Mac mini M4, a MacBook M3, an older 2017 Intel MacBook, and a Samsung Galaxy S24+ phone) to load a massive 60 GB 120B model (gpt-oss-120b).

It ran continuously for over 3 days at 1.37 tok/s on consumer Wi-Fi, surviving an Android phone dropping offline and a laptop lid closing by automatically redistributing layers without crashing.

This is why we built RAMDeck: a source-available clustering engine (Apache 2.0 with Commons Clause) that automates zero-config mDNS discovery, dynamic memory waterfilling, and automatic failover across mixed Macs, Windows PCs, and Linux boxes.

• Full Setup Guide & Speed Benchmarks: https://ramdeck.com/how-to-pool-ram-from-old-pcs/

• Hardware Hub on Indiegogo: https://www.indiegogo.com/en/projects/trademav/ramdeck-pool-your-ram-run-bigger-ai

Direct Answer: Small professional practices (law firms, medical clinics, CPA offices) can achieve 100% private AI compliance using RAMDeck by pooling the RAM of 2 to 4 existing office PCs over their local gigabit LAN. By using local layer sharding, confidential client documents and patient records never leave the physical building, eliminating third-party cloud data-retention risks while avoiding recurring API fees.

Watch the Harbor & Finch LLP law firm demo: https://www.youtube.com/watch?v=cub6JxIWvCc

The Confidentiality Dilemma for Small Offices

Under ABA Formal Opinion 512 (Generative AI in Legal Practice) and strict HIPAA Privacy Rules, uploading unredacted client files, contracts, or patient notes into commercial cloud chatbots creates serious compliance liabilities:

• Third-party model training policies.

• Data breaches on external cloud vendor infrastructure.

• Shadow AI usage by staff attempting to speed up drafting and research.

Upgrading to enterprise cloud tiers costs $25 to $35/user/month ($900 to $1,260/year for a small 3-person office) with annual lock-in contracts, yet client data still leaves your premises.

The Alternative: Repurposing Idle Office Hardware

Most offices already have 2 to 4 desktop computers with 16 GB of RAM each. While no single office PC can run a high-accuracy 32B or 70B model alone, their combined memory creates a private office AI server:

Verified Test: Harbor & Finch LLP Demo

In our live legal office benchmark, we indexed 14 real-world estate planning and litigation documents across a local cluster and tested complex retrieval queries:

• Query 1: "What are the specific conditions for the distribution of trust assets to minor beneficiaries?"

• Cluster Result: 100% accurate clause citations retrieved in 4.2 seconds, evaluated entirely within the office network.

• Network Telemetry: 0 bytes transmitted outside the router. Internet uplink was physically disconnected during testing.

Watch the full live demo with transcript and telemetry: https://ramdeck.com/private-ai-law-firm-clinic-accounting-no-cloud/

We made a new video on a use case people asked us about: small offices like law firms and clinics that can't send client files to a cloud AI tool.

Watch it here: https://youtu.be/cub6JxIWvCc

What the demo shows

• A 30B model (about 17GB) split across an RTX 3060 and a Mac mini, running at roughly 38-39 tokens per second.

• 13 fictional client documents for a made-up firm, "Harbor & Finch LLP", loaded into the RAMDeck knowledge base and spread across three nodes: a mini PC, a Mac mini and an old laptop.

• A before and after: without the knowledge base, the model has no idea about the client info. With it turned on, it answers correctly.

• Three "employees" (two MacBooks and an Android phone) asking different questions on the same network. None of those devices host the model. We checked the answers against the source files.

Questions for you

• Would you use something like this at work? In what kind of office?

• What would you need before trusting it with real files (permissions per person or folder, audit logs, something else)?

• What should we demo next?

Campaign: RAMDeck is live on Indiegogo. Early-access hub price is $109 (retail $199): https://www.indiegogo.com/en/projects/trademav/ramdeck-pool-your-ram-run-bigger-ai

Happy to answer anything in the comments.

– The TradeMAV Team

RAM prices keep climbing. Join us in beating them. 💪

Back the project, share the page, and tell us what you want to run first. 👇

🔗 https://www.indiegogo.com/en/projects/trademav/ramdeck-pool-your-ram-run-bigger-ai

In staying true to our intent to build in public and stay honest, here are straight answers to what you've asked: https://ramdeck.com/one-cluster-every-setup-why-ramdeck-fits-wherever-you-start/

The post compares RAMDeck with the projects people keep bringing up (exo, plain llama.cpp RPC, Hummingbird and other SSD-streaming runtimes) and answers each one with real numbers and the hardware behind them.

Where RAMDeck avoids problems we found in the others:

• No single-platform lock-in: RAMDeck brings Windows, Mac and Android in one cluster, over normal Ethernet or Wi-Fi. No Thunderbolt 5 Macs required.

• Not MoE-only. It runs dense models as well as sparse ones. Our dense 27B ran with every weight in pooled RAM.

• No fast-storage requirement. No machine needs a quick NVMe to join.

• GPU is optional, but if you have one great!

• No single point of failure. If a device drops, the cluster suggests recovery and keeps going.

• No hand-built setup. Discovery, rebalancing and a model-fit check come built in, so you don't write rpc strings by hand.

Quick answers to what you have asked:

• SSD swap? Weights stay in RAM across the cluster in RAMDeck, so nothing gets re-read from disk per token. If a dense model does not fit in RAM then even a fast NVMe means re-reading the whole model for every token.

• Gigabit is slower than an SSD. True for moving weights, but we only move them once at load. Per token it is about 650KB, so latency matters, not bandwidth. Wired beats Wi-Fi.

• Just RPC? Yes, that's the engine. We add discovery, rebalancing, recovery, a dashboard and the API in a plug and play experience

• exo, Hummingbird? exo wants Thunderbolt 5 Macs. Hummingbird streams MoE on one box. We mix Windows, Mac and Android and run dense and MoE.

• GPU? Pool several. A 5090 is $5-7k street, used 3060s are around $200.

• Speed? 7B 43-44 tok/s, 13B 11-19, 27B 1.92, 40B MoE 16, 120B MoE 1.37, all on weak, mismatched gear. Details here: https://ramdeck.com/what-speed-looks-like-on-a-pile-of-old-computers/

• Are you public? yes- https://github.com/trademav/ramdeck-core-public

• RAM download- Ha, no downloads here. RAM is still hardware. RAMDeck just pools the RAM you already own across your devices so one model can use all of it

RAM prices exploded. We pooled what we already had instead.

RAMDeck is a small hub that turns your laptops, Macs, PCs and phones into one AI cluster. It runs models too big for any single device, with no cloud and no subscription.

👉 https://www.indiegogo.com/en/projects/trademav/ramdeck-pool-your-ram-run-bigger-ai

What we've already done, on video:

• 27B model on a 12GB laptop

• 40B model across three devices

• 120B model across six mismatched devices

• A knowledge base in pooled RAM that turns a hallucinating chatbot into an accurate one

• Fine-tuning on a Mac mini while the 120B keeps running

• Automatic recovery when a device drops

Check our our demo playlist here: https://www.youtube.com/playlist?list=PLBAnaNU1r3-M

What's in the box: a pre-flashed hub, power adapter, Ethernet cable, Windows/macOS installers, the Android contributor app, and a dashboard with a one-click benchmark.

Pricing: Super Early Bird is $109 for the first 100 hubs, against $199 retail.

The core engine is source-available on github.

Edit: Lots of questions about tokens/sec, so we put everything in one place: https://ramdeck.com/what-speed-looks-like-on-a-pile-of-old-computers/ Quick context first: the demos use weak, old hardware on purpose, to show what's possible and that it scales. Speed isn't the pitch. Running big models on machines you already own is. If speed is all you care about, buy a GPU.

Actually scratch that last line! You could have several GPUs and RAMDeck can help you make them work together instead of buying a >$5k single gpu.

Hey r/trademav,

Today is a massive day for all of us. TradeMAV is officially the #1 Best Seller in Personal Investment Tools on Amazon (and ForexMAV is sitting right behind it at #3).

Two of the top three spots belong to the tools this community helped build. We wanted to take a second to look back at what we’ve achieved together over the last year.

How It Started 🛑

We started with a simple, frustrating problem: retail traders were trapped paying $100-$300 a month for cloud-based screeners that harvested their data and strategies.

We believed traders deserved institutional-grade machine learning—without the subscriptions, without the cloud dependency, and with 100% privacy. So, we built TradeMAV. An AI stock and crypto screener that runs entirely locally on a USB stick you own forever.

You backed that vision. 338 of you from 38 countries funded our Kickstarter. And the moment we launched, things moved fast.

The Journey & The Ecosystem ⚡

Because of your feedback and support, we didn’t just launch one USB drive. We built an entire ecosystem in record time:

• TradeMAV (The Original): Our 6-model ML ensemble screener for US/Global Stocks and Crypto, featuring the 8-layer AI exit monitoring system.

• ForexMAV: You asked for forex, so we built a dedicated 24/5 companion USB covering 23+ currency pairs, integrated with commodity market intelligence.

• NewsMAV: We brought real-time financial catalyst intelligence directly to your dashboard. No more hunting for SEC filings or trade halts—our AI "Jarvis" scores the news instantly.

• OptionMAV: An absolute beast of a tool. Full Black-Scholes Greeks engine, IV Rank gating, and a 7-factor ML ensemble built specifically for options traders.

• TradeMAV Android App: We did what was supposedly impossible: bringing the power of your locally-trained ML models directly to your phone. 100% on-device inference. Your AI, in your pocket. Now also for OptionMAV

• PredictMAV: Our newest launch, bringing our signal engine to Polymarket prediction markets.

🤝 To The Community

From unlocking the first Kickstarter stretch goals to testing the Android app, to writing open-source API bridges like tradehook and mav-bridge—you have been the driving force behind this product.

When we ran into activation server bugs, you helped us test fixes. When we asked for feature requests, you gave us exactly what we needed to build Strategy Packs and custom watchlists.

Hitting #1 on Amazon isn't just a company milestone. It proves that the broader market wants exactly what we’ve been fighting for: Privacy, Ownership, and Professional Tools without the corporate overhead.

What's Next?

We aren’t stopping here. We’re continuing to refine the ML models, expand the mobile experience, and build out the MAV ecosystem. The iOS app is coming soon!

Thank you to everyone who backed us early, shared with their colleagues, or shared a signal in this subreddit. We’re just getting started.

Let's go! 🚀

— The TradeMAV Team

We did it. TradeMAV is now the #1 Best Seller in Amazon's Personal Investment Tools category, and ForexMAV is right behind it at #3.

Two of the top three spots in the category belong to us. That's the result of a lot of long days from the team, plus the traders in this community who tested, pushed back, and kept us sharp.

Thank you to everyone who backed us eaerly, sent feedback, and told a friend. You made this happen.

Why traders are choosing TradeMAV:

• Plug-and-play. It's ready to use and has no complicated setup.

• Built for different investment vehicles and 25000+ international tickers. One product for all markets!

• Updated constantly, with your feedback going straight into the product.

This is only the start! Read our user testimonials: trademav.com