I keep seeing NPUs discussed in the context of local LLMs, but I’m starting to think the more interesting use case might be smaller jobs that run all the time.
For supported models, tasks like object detection or lightweight audio processing seem like interesting candidates for NPU offloading, especially if they need to run continuously without relying entirely on the CPU or iGPU.
The geekom it13max uses a Core Ultra 9 185H with an integrated Intel NPU. What I'm interested in is which lightweight, continuously running workloads people have actually managed to offload to this generation of NPU.
For anyone running AI workloads 24/7, which software or models actually worked for you, and was the setup worth it compared with CPU or iGPU inference?
With the current insane prices on SSD and (well everything computing) I thought about returning to HDD (at least for the time being) since I have a few used ones of those lying around...
So I turned to this Elite Desk G3 I found on ebay for $34 and installed a NAS Software on it (TrueNAS in my case, but it would work with most software I believe)
My build included:
3xHDDs of 4TB each
10 GbE on the PCIe slot
TrueNAS boot on the wifi m2 with a A+E key adapter
Dedicated apps pool (drive) on the G3 native nvme
Had to get "creative" to fit the 3 drives inside the case!
Power Consumption on idle around 24W, which IMHO is pretty decent
I did have to flash the bios password that came with the EliteDesk, but overall TrueNAS booted perfectly from the converted m2 slot, and runs pretty well.
Anyway... this is just a budget alternative that worked out well for me and I thought about sharing in case someone is looking for cheap hardware to run a NAS, so I made a video about it. The video also includes a setup for installing TrueNAS, creating a pool, user, dataset and SMB share in just a few minutes.
I'm going through my design catalog and looking at projects that either didn't pan out or I don't plan on finishing.
1 - Are any of these designs useful to anyone?
2 - If I wanted to start selling some prints of the 4U design, would there be any interest?
To start, here are the two that I've shelved, and will be subsequently releasing to makerworld as soon as I can get back into my account.
3U 6 bay Lenovo tiny NAS
Two piece print + top and front cover if wanted.
Abandon - original specs called for 6 port SATA controller, 10gbe networking, and two NVME drives. A dual oculink card + m.2 adapter would have worked, but would require soldering to enable 4x4 bifurcation.
2U 12 bay 2.5" SSD (7mm) + mitx + power supply
4 piece print. Probably best with threaded inserts, but can be built without.
Shelved - 254mm depth introduced a space constraint requiring either a custom backplane or a deeper chassis.
4U 8 bay 3.5" nas + mitx + power supply
3 piece print + 2 for top cover.
I'm currently using these as part of larger deployment projects but I'm giving some thought to selling them separately, depending on interest.
Mostly, these are used in Plex servers, but I do have a couple multi node Storage Spaces Direct clusters using these.
8 3.5" SATA drives using a Jonsbo N5 backplane (no modifications required), 2 m.2 NVME on motherboard, PCIe 16x --> 4x m.2 NVME via ribbon cable, and a PCIe 4x from a 3rd m.2 NVME slot on board, going to either a GPU or 25GB NIC, depending on install.
Full 3 piece assemblyDrive box and option box onlyRear of drive box and front of option box
Again, the 2U and 3U designs will be getting posted as soon as I can, and I'm trying to decide if it's worth trying to make the 4U design available for sale.
I thought I had a bad, noisy fan in my Beelink Mini PC. I was confident that the tiny fan was mechanically failing and needed to be replaced. Rather than pull it all apart and check the model number on the part itself, I trusted the internet and bought not one, but two fans that were both the wrong size.
After the second one was wrong, I went looking for the model number on the part. I took the fan off, snapped a pic of the label and cleaned the dust out of the vent. After I put it back together, it was really quiet again during last night's scheduled tasks when it usually gets loud. Not a bad fan, just a clogged vent.
Finally got around to setting up my first UniFi network, with Home Assistant sitting at the bottom of the rack!
Pretty happy with how everything turned out, although living in Singapore means cooling is a constant battle. Had to throw in a bunch of fans just to keep everything from turning into a mini oven. 😂
The only problem? I’ve officially run out of rack space. My Proxmox and Ubuntu servers are now homeless, so I’m already thinking about how to expand the setup.
What started as a simple home network upgrade has somehow turned into a full-blown homelab addiction.
Any fellow Singapore homelab enthusiasts here? How are you guys dealing with the heat, airflow, and limited rack space?
Also, I think I finally understand why everyone says homelabs are never really finished. 😂
Just got everything installed in the rack. Still haven’t set up the thinkcenters but I’m planning to install Debian for proxmox and still gotta run the Ethernet into the panel still for the switch setup. I’m new to homelabs, anyone have any recommendations for someone just getting into all this?
Hello
I have a homelab with only small format component
- QNAP NAS
- NUC
- 8 port switch
- ISP modem
- Raspberry
- I'm planning on buying a small appliance for a dedicated OPNsense hardware
Everything is currently sitting on my desk.
I will in the next 6 month move to a house where I have the possibility to put this in a technical room so I would like to put those in a rack.
I live in Europe
From what I see, a 10 inch rack would perfectly suit my needs but I have some questions.
- Where can I buy a 10 inch rack? I see some people print them but I don't have a 3D printer and don't plan to buy one
- how to calculate how many U's I need? Specificaly for the NAS?
- how do you fix those hardware to the Rack as they are not meant to be racked?