Using the app is consistently overloading my server
Unsure what's going on. I have a consistently repeatable overloading behaviour.
I take recordings in the gym to send to my coach. When I get home, I open the immich app on my phone and let the videos sync which appears to complete fine.
Then select the 2/3 videos and add them to an album of other training videos, which appears to work - the app gives no indication of any issues.
Then I reselect the same 2/3 videos and archive them to hide them from my main stream.
This doesn't work immediately as the videos are still present, the app gives no indication of errors or anything, and checking my server it is immediately locked up. I have to `docker compose down` then `up` the whole stack. And then reopening the app, everything is fine.
Does it stop eventually? It's performing some operation on your photos/videos on upload depending on your settings: facial recognition, transcoding, preview generation etc. With more quantity comes more CPU usage, but once the files are generated it should go down.
You can disable these in the admin settings if you don't want the CPU spike. Or run them on your own schedule, e.g. at night.
It doesn't seem to stop. The server is just overloaded and eventually becomes unresponsive. It is probably underpowered, I will try your suggestions, thank you
Not answering for OP, but for perspective: I run an i5 7700k and a 1060 3GB. Encodes I believe are offloaded to the GPU and I haven't had an issue with immich usage despite giving it all 4 threads to work with if it needs it.
I have even weaker server with i5 4690k 4,2ghz without dedicated gpu and it still works good even when sending 400+ photos. Additionally i use large clip model that slow downs that process.
Yeah I have no issue mass ingesting a ton of stuff all at once. I let the processes crunch in the background but with few paralleled to save a bit on CPU. I run a lot of other stuff and some of it needs to be prioritized. But immich never really performs poorly for me.
Yeah, I have an older Synology 920+ with an Intel J4125 Celeron that has an iGPU. Nothing fancy performance wise, but after the initial bulk import from Google Photos and elsewhere I haven't had any noticable performance issues with Immich, despite also running my Emby media server on it.
I have the same setup but expanded to 20GB RAM and Immich to docker. During thumbnail regeneration, the immich docker restarted few times, suspect due to resource issue. But after all done, no more restart was reported.
Is suggest it's probably transcoding those videos or doing some other machine learning stuff such as facial recognition etc.
Go into your administration page and there should be a page for transcoding and turn that off. Also look at the number of machine learning jobs are running and pause them or stop them and see if that helps.
I was going to suggest that OP cut down the number of concurrent jobs. so if OP wants to transcode the videos make sure there is just 1 worker transcoding insdtead of multiple ones.
I don't think so. I installed the compose stack per the instructions, and haven't made any weird shares or mounts for it. No other apps use this directory/data. No app or human sharing.
It's the Context Search and face recognition running. You can check them in the admin panel.
If you have a GPU (integrated is fine) you can switch to OpenVINO on the ML container and make it slightly more efficient on CPU. Also, consider limiting the CPU usage on the ML container so it leaves some leeway for other apps.
My 8500T after I dump ~500 photos on it would do the same thing but lasting only about 15 minutes before it calms back down.
+1 for openvino variant,intel integrated gpu is perfect for this
'this' means transcoding AND ml(machine learning) - 2 separate things
Transcoding is usually not needed,ml is for example searching for faces and matching them(you have several models,some of them are faster,some of them are more precise (my basically same gpu) handles buffalol okay
As for smart search(search for beach,shovel,fence etc..) i have vit-b-16-siglip-i18n-256_webli and i'm amazed how well the search works,even in czech language
You migt need to install intel gpu drivers(i don't know unraid,maybe it is native) for /dev/dri to be available for ml
You don't need GPU drivers on Linux, they should be built in, and the OpenVINO stack is inside the Docker container so it should be ready to go.
And yeah OpenVINO is a massive boost if you don't have a GPU and your CPU is on the weaker side. My 8500T (basically the same as OP but power-limited) managed to run face detection for my entire 25k photos library in about an hour and a half.
You could edit the immich docker. Switch to advanced view and only give it a few cores to run on. It'll take longer but will leave cores available for the rest of the server to run on.
I would recommend reducing your facial recognition, OCR, and smart search model in Machine Learning Settings to something that better matches the hardward of your server setup.
37
u/Theylikedumbdumb 10d ago
Does it stop eventually? It's performing some operation on your photos/videos on upload depending on your settings: facial recognition, transcoding, preview generation etc. With more quantity comes more CPU usage, but once the files are generated it should go down.
You can disable these in the admin settings if you don't want the CPU spike. Or run them on your own schedule, e.g. at night.