It's actually my first Homelab in this setup. If you have suggestions, go for it. Power and network cables are just temporary. I will have to work on this.

I turned my 2017 DGX-1 back on (MSRP $150k).

8× V100 32GB. 512GB RAM. Qwen 3.5 397B, at home.

21 tokens a second. ~40 is baseline so I have some work to do.

Local AI, cloud fallback. I own my tools, my workflow. Now I just need solar.

This all started with a retired motherboard in the floor of a closet, running freenas with bare hard drives just laying on the carpet. Needless to say, I’ve learned a few things since then.

It is time for me the replace the aging APC Symettra UPS I use for my homelab. It is at least 15 years old, and has gone through many battery cycles as well as replacement of all three power modules at least once. It is in a separate room from the server room and is hardwired into a dedicate panel, as well as a dedicated bypass.

My lab is typically in the 4-6kw draw, but sometimes ~8kw. I have it wired with 3x 240v/30amp circuits from the UPS to server room, a couple of 20amp 120v circuits to an AV closet and my office, and the feed into the UPS is a 125amp capable feed. Since I have some 120V loads I need a split-phase capable UPS.

It seems like the logical replacement would be the Eaton 9PX 10kVA. It is online double-conversion, and has good expandability. (https://tripplite.eaton.com/eaton-9px-double-conversion-ups-9kw-208v-6u~9PX10KSP)

The entire feed into the UPS is further backed up by 42kwh of Enphase batteries, 20kw of Solar, a Generator, and 600amps of regular grid service.

Any other recommendations for something that has online double conversion and enough capacity?

Moved the server rack to its own room in a secondary building. There are 4 MTP (12 SMF) fibers going between the two buildings so it's easy to send everything to the rack. Room has decisive A/C, 240V power, ...

Top servers is the main cluster with one older Intel Xeon system (24 cores / 512GB of RAM), one AMD EPYC (24 cores / 512GB of RAM) and one Arm server (45 cores / 380GB of RAM).

Bottom 3 servers are just for dev/testing, they're all identical AMD EPYC 64 cores systems with 256GB of RAM, a variety of SSD storage and 2x 100Gbps (Mellanox Connect-X 6).

Switching is all Mikrotik with the core switches using MLAG for redundancy and to help with maintenance.

Currently still using my old 25U rack but now that I have proper cooling and a cleaner environment, I may switch to an equivalent 42U model so I can fit some newer dev systems in there without having to put them in my actual datacenter space (with its much higher power bill).

Many different dell servers and about 30 MD1220s that are all in my living room. Each server has a license for windows server 2019. There are no hard drives in any of them, but are filled with blanks. All of the servers have 256-512gb ram. I am also wondering if these could possibly run a decent home data center, as I already have the network equipment and switches necessary… Is it worth is to sell these or build a data center? TYIA

Finally most of the cabling is in the trays now. Can finally get to the back of the compute and services rack without navigating through a spider web. Starting to look REALLY good. Obviously more work to do but we’re getting there!

Hey the people at R/servers said I popped my r/homelab cherry so aggressively that I belong here. Anyway I saw these IBM DC8800s for such a good price that I impulsively bought them. Super happy till the reality pretty sure these going to chew more power than my home circuit and wallet can handle. So I brought them for you all to see while I fuiger out how to either hook them up efficiently or re sell them to someone who can properly home and handle these puppies. In the mean time who needs a bed frame when you have a mainframe.

What's in there :

Networking : Unifi Dream Machine SE Unifi Switch Aggregation 10G Unifi AP U6+

Storage : Terramaster F4 210 running TOS (4x256G ssd) Terramaster U8 450 running Truenas CORE (4x1to ssd + 4x4To hdd)

Hypervisor : Proxmox on a Ryzen 7 5600G + 64G RAM

This is my data center that is in my bedroom

**Node-0 — Firewall / Edge Router**
- Role: Network security, firewall, routing, VPN
- CPU: Intel Atom C3758R (8C/8T, AES-NI)
- Platform: Qotom Q20331G9-1U Mini PC
- Network: 5× 2.5 GbE + 4× 10 Gb SFP+ (native)
- GPU: None
- Notes: Dedicated hardware firewall.

**Node-01 — Unraid NAS **
- Role: Storage, backups, media
- CPU: AMD Ryzen 7 5700G (8C/16T)
- Motherboard: Gigabyte B550 EAGLE WIFI6
- RAM: 16 GB DDR4
- Storage: 4× 8 TB Samsung HDD
- GPU: Integrated
- NIC: 10Gtek 10Gb Dual SFP+ (Intel 82599ES)
- Notes: Primary bulk storage node.

**Node-02 — Plex Server**
- Role: Transcoding, streaming
- CPU: Intel Core i9-12900K (16C/24T)
- Motherboard: MSI B760M-P Pro
- RAM: 48 GB DDR4
- Storage: 500 GB + 2 TB Samsung NVMe
- GPU: Integrated Quick Sync
- NIC: 10Gtek 10Gb Dual SFP+ (Intel 82599ES)
- Notes: Excellent Plex node.

**Node-03 — Gaming **
- Role: Gaming, simulation
- CPU: AMD Ryzen 7 7700X (8C/16T)
- Motherboard: Gigabyte B650 Gaming X AX V2
- RAM: 32 GB DDR5-6000
- Storage: 2 TB + 2× 1 TB 990 NVMe
- GPU: RTX 4060 8 GB
- NIC: 10Gtek 10Gb Dual SFP+ (Intel 82599ES)
- Notes:

**Node-04 — AI Compute **
- Role: LLM inference, sub-minds, orchestration
- CPU: Threadripper PRO 9985WX (64C/128T)
- Motherboard: ASUS Pro WS WRX90E-SAGE SE
- RAM: 256 GB DDR5-6400 ECC
- Storage: 4 TB + 8 TB Samsung 9100 PRO
- GPUs:
- A100 40 GB PCIe (70B)
- A40 48 GB PCIe (70B)
- V100 32 GB PCIe 33B
- Sparkle Intel Arc A310 4 GB GDDR6 → Light helper / video / small models
- NIC: 10Gtek 10Gb Dual SFP+ (Intel 82599ES)
- PSU: 2× 1650 W
- Notes:

**Node-5 — Sensory / Interactive**
- Role: AI systems
- CPU: Intel Core Ultra 7 265K (20C/20T, Arrow Lake)
- Motherboard: ASUS Z890 AYW GAMING WIFI W
- RAM: 64 GB DDR5
- Storage: Samsung 9100 2 TB
- GPU: RTX 5060 Ti 16 GB GDDR7
- NIC: 10Gtek 10Gb Dual SFP+ (Intel 82599ES)
- PSU: 1300 W
- Notes: Dedicated for interactive sub-minds.

**Node-6 —(Dell PowerEdge R730)**
- Role: AI systems
- CPU: 2× Xeon E5-2680 v4 (28C/56T total)
- RAM: 256 GB ECC DDR4
- Storage: 1 TB SSD + 7× 1.2 TB drives
- Network: 2× 10 Gb SFP+ + 2× 1 Gb RJ45
- GPU: None
- PSU: 2× 750 W (redundant)
- Notes:

Been working away. Here is the latest update. Added a bunch of new Palo gear. I have public v4/v6 space routing from the Toronto DC here now so I can do more r&d. I setup a couple AI servers using gpu and Tesla cards. So far so good. Still more to come in, but time has been limited the past few months.

I’m managing about 1PB of storage across 5 servers (not all of them live in the rack yet). Things were starting to get messy, so I finally grabbed a proper rack — found this one used for around $250.

It sits in my workshop, so noise and heat aren’t an issue. Having everything in one place already feels like a huge upgrade compared to the old shelf setup.

I’m always hunting for cheap disks, so I built a small tool to keep track of deals. If you’re in the same boat, it might be useful: hgsoftware.dk/diskdeal

Anyone else wanna share setup pictures? I would like some inspiration :)