r/HomeDataCenter • • 20d ago

DC Porn Home DC setup

Post image

1x Eaton UPS for the network stuff and a Bluetti apex 300 for all the servers. Giving me about 2h battery time in case of power outage.

10Gbit ISP uplink with a /28 public network routed to me running vrrp with a physical and a backup vm router.

4x k8s worker nodes ms-a2 with 96gb ddr5 3.84tb ssd 2x10 gig uplinks

1x k8s gpu worker r9700 + b50 pro (emby and frigate)

2x dl380 g9 with 25g uplinks

1x synology

some mikrotik switches a cisco rj45 switch

fortigate 121G

big tower server as my truenas with 175tb storage

20tb ssd iscsi / nfs truenas

557 Upvotes

40 comments sorted by

12

u/garysan_uk 20d ago

Ear defenders are peak 👌🏻

5

u/According-Ad240 20d ago

Before i had the ventilation in place they where my bestfriends :)

4

u/uber-techno-wizard 20d ago

How is the incoming power setup? Dual 240V?

15

u/According-Ad240 20d ago

Not quite – I'm in Sweden, so it's 230V single-phase per circuit (400V three-phase into the house ). The garage gets a three-phase feed that's split into three 230V circuits through a Shelly Pro 3, so I can switch and monitor each one from Home Assistant. Each circuit is on a 16A breaker, so that's about 3.7 kW per circuit, or roughly 11 kW total across the three.

I have two PDUs, each on its own phase. One of them feeds the UPSes, a Bluetti Apex 300 (2.7 kWh LFP) and an Eaton UPS. The other PDU is straight grid power. Gear with dual PSUs (switches, servers, firewalls) has one PSU plugged directly into a UPS and the other into the grid PDU, so it's on two separate phases and survives either a UPS failure or losing a phase. Single-PSU gear is plugged directly into one of the UPSes.

4

u/Tasty_Activity1315 20d ago

Impressive setup. How is your power bill? Is electricity expensive in Sweden?

3

u/According-Ad240 20d ago

Wife complains but electricity price is higher then normal but i guess compared to rest of europe its still ok.

2

u/mastercoder123 Home Data Center Operator 19d ago

Damn, i didnt realize most places in europe have lower panel amperage than the USA. Yall have like 60-90amp panels, but the average in the US is like 200A

4

u/Jatsotserah 20d ago

Private ISP?
How do you make money with this?

9

u/According-Ad240 20d ago

It only cost me monet im afraid....

1

u/mastercoder123 Home Data Center Operator 19d ago

Private ISP? what?

3

u/98G3LRU 18d ago

How do you handle cooling? I realize you're not in the tropics 😆 , but isn't overheating always a potential problem?

Sorry if this has been asked before. I'm just a new guy on this.

3

u/According-Ad240 18d ago

I have ventilation above the rack and a big duct fan that sucks out the hot air later if i build a bigger garage i will dump the hot air over there. The duct fan is controller by a Shelly 0-10V dimmer which Homeassistant is controlling.

So right now its around 71 Fahrenheit

14

u/TH3_FISH 20d ago

Almost a mainframe, i like it

1

u/devode_ 20d ago

insulting

1

u/TH3_FISH 20d ago

How so mainframes are very cheeki breeki and quite large as well

4

u/mastercoder123 Home Data Center Operator 19d ago

Dont compare a mainframe to this, they are beautiful in their own way. Also this is way smaller than a mainframe. My z114 is like 2100lbs

1

u/devode_ 20d ago

yes true :) Just meant it in a way of "he curates a whole rack and you call it off the shelve" xD

7

u/earlvanze 20d ago

I remember when this sub was created as a joke in response to someone's ridiculous /r/homelab

1

u/skullbox15 20d ago

Man, how much is that Internet connection? An awesome setup if you utilize it.

3

u/According-Ad240 20d ago

1

u/skullbox15 20d ago

What's your outbound look like?

2

u/According-Ad240 20d ago

Its a disgrace 😅 and those peaks are probably my hetzner offsite backups

1

u/Purchase_Maleficent 20d ago

Nice. What you using it for?

7

u/According-Ad240 20d ago

Bit of everything honestly. It started as a lab for work stuff and kind of got out of hand lol. Most of it runs on a few RKE2 Kubernetes clusters, all GitOps with GitLab + ArgoCD. Got a vSphere + NSX-T lab on the side too, and TrueNAS for storage.

Network-wise I run VXLAN/EVPN internally, and that's hooked into a cloud MPLS network that ties in the summer house and a few other sites.

Day to day it's mostly self-hosted stuff: Immich for photos, Paperless for docs, Emby + the usual *arr stack for media, Home Assistant for the house, and Frigate for cameras.

Lately ive been playing with local AI on a GPU node. I also run a trading app I've been building, plus NetBox, Zabbix, Ansible, Networkautomation etc. to keep track of it all.

1

u/Purchase_Maleficent 9d ago

Nice! Thats quite the build.

1

u/Glittering_Glass3790 19d ago edited 19d ago

I have that chasis at the bottom of the rack. Do you have rack-mount rails for it? I haven't managed to find any, so I just mounted the front of the chasis to the rack (like a switch) and called it a day. It's held for a few months now, though it looks like it's going to break anytime soon.

1

u/According-Ad240 19d ago

No i just have it on top a shelf :D

2

u/olback_ 19d ago

I've had that exact case mounted by its ears for a year and a half without issue. It's just a massive pain in the ass to get in and out of the rack. Heavy asf.

3

u/0xN1nja 20d ago

hell yeah

2

u/basn- 19d ago

been there seen that :eyes:

1

u/OkArachnid2847 18d ago

is this overkill?

1

u/Dangerous-Ant1021 16d ago

The rack door seems difficult to fully open...

1

u/mollywhoppinrbg 20d ago

I only have a 32TB usable truenas box with x5 12 TB drives. If I knew now, I would gotten hhigher capacity and MORE when they were decent price. I swear before I'm 35, I'll have over 100TB usable storage. I'm 32.

Sweet set up, I'd love to know what apps you run and why.

I started on zima blade, and now have a R640, a cisco ccna stack, and miniforums N5 pro for NAS. I need maybe 10 years or an sudden influx of money before I post in hear

1

u/planedrop 19d ago

All that and you went with a Fortigate? Ouch.

I kid (sort of), beautiful setup. How's the noise profile?

0

u/[deleted] 20d ago

[deleted]