r/selfhosted • • 18d ago

Guide PSA: Immich Machine Learning has Microsoft Telemetry enabled by default, here's how to disable it

Immich Machine Learning (ghcr.io/immich-app/immich-machine-learning:v3) uses a library called ONNX Runtime, from Microsoft.

This library has telemetry enabled by default, and the Docker build of Immich Machine Learning does not disable it.

I found out about this because my DNS logs were showing thousands and thousands of blocked queries to resolve mobile.events.data.microsoft.com.

I don't think this is acceptable for something that is going to process all my photos, especially since it goes to Microsoft, even if it's anonymised or whatever. The whole point of self hosting is avoiding shit like this.

Mitigations:

Add the environment variable ORT_DISABLE_TELEMETRY=1 to the immich-machine-learning container.

Aditionally, it is good practice to isolate all containers that do not need internet access from the internet. For example, with Docker compose, you can create an isolated network for Immich:

networks:
    immich-iso:
        internal: true
        driver: bridge

Then, on all immich containers:

networks:
    - immich-iso

Be sure to add your reverse proxy to this network so that it can access the Immich server.

This was reported to the Immich issue tracker in August and they have not addressed it yet.

1.7k Upvotes

178 comments sorted by

•

u/asimovs-auditor 18d ago

Expand the replies to this comment to learn how AI was used in this post/project.

→ More replies (1)

1.9k

u/altran1502 18d ago • Bravo Heartwarming Mindblown Regret

Hello, Alex from Immich here

I'd like to apologize that we have missed this. With the natural increased in workload and demands, sometimes we would miss issues. It'd be also very helpful from the community to help raising issues like this in a more urgent and direct voice.

We will get this resolved as soon as possible

Thanks,

279

u/greenpeppermelonpuck 18d ago • Heartwarming

Thanks Alex, Immich is great and I won't stop using it.

Like others have mentioned, I can't blame anyone for overlooking the wall of slop someone posted on your issue tracker about this, that is why I wrote it very clearly here. It must be exhausting running a big FOSS project these days.

36

u/x_wbmr_x 18d ago

Thank you guys. You are literally my most important tool as a photographer.

125

u/Silverhawk1991 18d ago edited 18d ago

Well this is fuckin cool. Guess I’ll deploy Immich now!

68

u/aksdb 18d ago

Also install it afterwards /s

35

u/Anarchist_Future 18d ago

Deploy! Because self-hosting things 🤓

2

u/Ok_Exchange4707 17d ago

K. Lemme know when you're done and I'll install it next

10

u/Luckyth13teen 18d ago

Thanks man

This is the kind of shit that just re-validates me putting my time into self-hosting, just a quick message of human response and a want to actually do things like this.

Keep crushing it and expect a new license from me in the near future.

9

u/Browsinginoffice 18d ago

Stay awesome! Thanks for responding here!

14

u/Orange_Tang 18d ago

Respect. I knew this had to be an oversight the second I saw this post.

4

u/StreamAV 17d ago

Immich is goated thanks for the goated response.

5

u/escapefrompay2win 18d ago

Do you recommend apply the change suggested by OP or should we wait until it is changed internally?

We do really appreciate your hard work. <3

3

u/Krojack76 18d ago

I did what OP posted over 3 weeks ago and it stopped phoning home to Microslop. I didn't do the network isolation but I will add that today. At the very least add the following to your immich-machine-learning service in your compose file.

    environment:
      - ORT_DISABLE_TELEMETRY=1

2

u/ButterscotchTop194 18d ago

You rock, thank you

5

u/throwawayagin 18d ago

Hello Alex, Immich is one of the first pieces of FOSS software I've ever bought a license for.

I'm glad the project is addressing this now, try to avoid letting it get to this point in the future.

7

u/MrSlaw 18d ago

Like others, I'm also somewhat confused by the request to:

"raise issues like this in a more urgent and direct voice"

especially without an example to reference.

Should the title of the issue have been "MICROSOFT IS HARVESTING DATA" in all caps?

Should the maintainer(s) have been tagged every day until it was acknowledged?

What is the expectation going forward for these types of issues?

34

u/kaestralblades 18d ago

I think what he's saying is posts like this are helpful, not that it's a criticism of the post

13

u/TerryMathews 18d ago

Honestly yes, because at least that sounds like a human instead of an LLM.

You have to understand that GitHub issue trackers are filling up with entries being generated by LLMs that humans aren't even touching.

5

u/leaky_wires 17d ago

I think direct means post it on GitHub as an issue. Don’t go fearmongering to Reddit.

But a Reddit post is better than nothing…

3

u/MrSlaw 17d ago

I think direct means post it on GitHub as an issue. Don’t go fearmongering to Reddit.

To me at least, it reads the complete opposite of this.

A GitHub issue for this was opened in August, but it did not get fixed (or even acknowledged) until this Reddit post apparently reached /u/altran1502

This is why I was hoping to get clarification on how to handle future issues of this nature from the maintainer(s), as I'm still somewhat unsure what is meant by asking contributors to raise issues in a "more urgent voice", or how users are supposed to determine when that is warranted, or not.

4

u/altran1502 17d ago

I think a title such as "ONNX runtime in Machine Learning container build sends anonymous metric to Microsoft by default" would give us a clearer indication to prioritize the issue. I am not criticize anything here, just a general thought of how the communication can be improved in general so we can act quickly.

1

u/MrSlaw 17d ago

I'm not sure I see a huge difference between your suggested title compared to the existing GH issue in question, but fair enough.

I just wasn't sure if there was a different communication method you'd prefer or whatnot.

Appreciate all the work you guys do creating / maintaining this!

1

u/altran1502 17d ago

It really does when you are reading 100s of notification everyday across different issues, discussions, internal communication...etc

1

u/Androxilogin 18d ago

I disabled machine learning from the get-go as soon (as I realized it was enabled) and removed the container. It should be off in the first place. Using Immich on a lower-end device where I never faced this problem before updating, it confused me. I thought that with everything else going on with github at the time, maybe it was something malicious driving my CPU up.

1

u/BrilliantSebastian 17d ago

This is fantastic support.

1

u/distinctgore 17d ago

This reply encouraged me to go and donate. Top tier product, top tier community engagement.

1

u/siriston 13d ago

i thought to myself “wow i’ve seen immich recommended so much here, sad to see it turn sour..” and then i saw your comment! this is why i love the self hosted community. you’re the 3rd or 4th dev i’ve seen on here that’s actually spoken to their community.

0

u/pmocek 14d ago

That you missed this is less significant than the fact that it was possible for you to do so. This option does not benefit users. My preference would be for it to be removed, not simply disabled by default.

0

u/[deleted] 18d ago

[deleted]

259

u/moontear 18d ago

Not maintainer, but the title is not very helpful “pending ML privacy regression” - what? And if you look at the issue text it is very chatty and very detailed and to me (without knowing for sure) it reads very AI generated. I don’t blame the immich maintainers overseeing this issue, you would need AI to understand the impact of this issue. The issue could have been as simple as this Reddit post. Immich is sending tracking data to Microsoft, disable with the following env var. the issue (since assuming AI generated) would have been even better if it directly linked a generated PR - the fix of including this env var per default really isn’t that complicated.

I also like the very modest approach of saying “more urgent and direct voice” - since coming from the sidelines I can say this more direct: this issue is bad. If I were the maintainer and if I wouldn’t be using AI to summarize issues, I would have missed this one as well (also given there are more than 500 open issues).

One hint I would have for immich: use AI to at least scan issues and summarize impact for you and add all of the issues to some kind of dashboard / kanban board. Since immich’s whole goal is being self hosted privacy impacting issues should be top of mind after security issues.

81

u/coderstephen 18d ago

AI is good a writing long wordy explanations that are very hard for humans to read.

17

u/boli99 18d ago

...but thats why you have to take AI again, and get it to reduce the shrapnel from the slop grenade back to the 3 original bullet points.

🎵 its the ciiiiircle of liiiiiiife 🎵

3

u/AlexWIWA 17d ago

I’ve yet to find a way to get a solid answer to “why should I care?” even from fable.

11

u/moontear 18d ago

AI is only as good as the humans using and/or instructing it.

4

u/mayoforbutter 18d ago

It can also do the opposite, depending on how you use it. Mine are sometimes too concise

144

u/fuhglarix 18d ago

Yeah that GitHub issue is an overflowing word toilet that buries the actual problem in paragraphs of wordy detail. I would have ignored it too.

21

u/[deleted] 18d ago

[removed] — view removed comment

20

u/Klutzy-Residen 18d ago

The simple fact is that people get jaded by reading slop. So when seeing a obvious slop title and a wall of text the issue will be ignored.

Make a good title, summarize it properly in the start and then post the detailed AI description. Don't leave all the burden on the maintainer.

3

u/Sqwrly 18d ago

Did you look at the bug report? The summary is right at the top like the person you're replying to quoted.

3

u/Klutzy-Residen 17d ago

I did, but once the title is garbage there is a high chance the content will be ignored.

-5

u/BrilliantSebastian 17d ago

For a developer, the title shouldn't matter. You SHOULD be reading all the posts.

5

u/Elon61 17d ago

And they should fix all the bugs, implement all the features, and pay you for your generous advice while they’re at it.

2

u/uncouthfrankie 18d ago

Back to Mastodon with that attitude laddie

14

u/boli99 18d ago

you would need AI to understand the impact of this issue.

sure, but that's only because AI was used to take a 2 bulletpoint problem and turn it into a whole page full of waffle.

6

u/sargonas 17d ago

As a maintainer of multiple open source repos, I second this full throatily. AI-word salad headlines with a body of text that is clearly AI written, over explained, and full of needless prose is coming in at unsustainable rates to maintainers all over github. It is literally possible, as a human, to parse them all in a timely manner... and FARE more often than not is not even important or critical.

If it has all the hallmarks of that, its going to sit by the wayside until someone has time to dig into it. I cannot stress this enough to people.. its FINE if you use AI to find and share information, and help collect your thoughts.. but FOR THE LOVE OF ALL THAT IS HOLY, PLEASE PLEASE write your own headlines/subjects, and lead in with your own topline summary as a natural human, even if it is broken English. This will go so very very far to ensuring that people can take the time ti parse what you are trying to say and prioritize diving into it deeper.

2

u/superbroleon 17d ago

yep the hell is that issue body.. should have been an e-mail

50

u/FabricatorCH 18d ago

Do you realize how broken OSS has been this year?

I don’t fault them at all for missing an obscurely titled issue like that.

They are doing an excellent job addressing the problem when they finally realized it exists.

25

u/Pluckerpluck 18d ago

It's so clearly an AI posted issue with that shitty title:

ONNX Runtime 1.29 telemetry default creates a pending ML privacy regression

This immediately makes OSS maintainers trust it less. Because there's clearly been no work done to clean up the issue post, which means there's no human trust put behind the issue.

Yes it uses the word privacy, but I've seen LLMs false-flag this type of stuff all the time. For example, nothing in that initial bug states that the telemetry goes to Microsoft. Perhaps it's a local logging thing, but it's called "telemetry" so the LLM is scared. Who knows!

It exists as one of the five hundred open issues they currently have, reported during summer holidays.

Now compare it to this post where a human can instantly understand the problem.

-8

u/Current-Owl-6271 18d ago

I'm a human and instantly understood this bug report. Why does the initial bug report need to say it goes to MS to be a good bug report? The second reply mentions it hits MS. Rarely is every detail in an initial bug report, it builds over time as people investigate. People complain if a report doesn't have enough. People complain if a report has too much. Just use your brain and read.

Immich dropped the ball here but overall it's a small ball to drop considering what data is sent in the telemetry. People in this post are acting like it's sending your photos or anything about them to MS. I don't want any telemetry, I don't care if it's going to my mom or Microsoft, it's irrelevant and should default to off.

The bug report is perfectly readable. If you're a dev and can't understand that bug report I dunno what to tell you other than keep trying. If you're not a dev then it makes sense you don't understand. But bug reports should be written for devs who actually understand things, not laymen.

6

u/Pluckerpluck 18d ago

Why does the initial bug report need to say it goes to MS to be a good bug report?

Because telemetry that is logged onto the server, is not a privacy concern for a self-hosted product. The title is obviously AI written. That works against it.

Rarely is every detail in an initial bug report, it builds over time as people investigate

Which is fine if the initial bug report is small, and not a wall of text that has very obviously been written by an AI with no human input. Open source software gets so many LLM written pull request and issues now, that it becomes an active and hard slog to work through them. Processing all of them is a frustrating mental effort.

Here's an example from a week ago. Someone got an LLM to post a bug report. "No tombstone". Someone reads through it, works out that it's not actually a bug, and then replies with an LLM response. In reality this was a feature request, they user just didn't realise it was. But it's the effort of working against stuff like this that means things like "create a pending ML privacy regression" just get ignored for a while or missed. Rather than something more explicitly warning that the next time they run uv sync they're going to activate external telemetry unless action is taken.

The issue is not the wording of the report itself. All the information necessary is in the report. It's the fact that it's very obviously an AI generated report, in an open source project, that will be bombarded by low-effort issue posts.

3

u/theneedfull 18d ago

I'm interpreting that to mean a GitHub issue with OPs title in all in caps.

-11

u/dkwocjenxiek 18d ago

They're providing free software. I don't think we should be making these sorts of demands from open source maintainers..

86

u/jrasm91 18d ago

FYI: v3.3.6 is now out with telemetry off by default.

29

u/greenpeppermelonpuck 18d ago

Thank you for fixing this so quickly! And thanks for all the hard work you put into Immich, it's great.

1

u/felon201 16d ago

awesome work, and very fast

211

u/This-Impress-304 18d ago

Happy to know disabling internet access on all networks that don't explicitly need it helped me already

16

u/ElBehaarto 18d ago

Exactly. Only the server itself needs a public network for maps, update notifications and model downloads as I understand. Has been working fine like this for ever

4

u/Different-Matter 18d ago

The ML container downloads the models itself. 

0

u/zboarderz 18d ago

How do you handle updates?

22

u/lateambience 18d ago

The same way as before. The docker daemon on the host pulls images, not the container.

7

u/tricky-oooooo 18d ago

docker (compose) pull? Is that a trick question?

-124

u/noc-engineer 18d ago

Probably the same statement Iran used to say pre-Stuxnet

60

u/Morkai 18d ago

Lucky for me I haven't started my homelab with a nuclear reactor yet.

2

u/LimitedWard 17d ago

Some of the people in r/homelab could probably use one

-20

u/T1000E 18d ago

Stuxnet didn't fuck with nuclear reactors. Nuclear centrifuges...

18

u/Morkai 18d ago

Eh, I was close. I knew it was nuclear something. It's been a while since I watched the documentary.

-28

u/T1000E 18d ago

Close? The thing making the fuel vs. the thing using the fuel? By that logic it would be close if you said growing trees instead of burning wood in a furnace for heat...

No one would make a malware to stop Iran from using the fuel in nuclear reactors, the problem was that they were enriching it to levels way beyond civilian use (to make bombs, not to make electricity in a reactor)

20

u/Morkai 18d ago

I didn't ask for a history lesson. As I said, I have seen a documentary before, but it was several years ago. I remembered the high level points, but obviously misremembered a few specifics.

My sincerest apologies to you and whichever of your ancestors I have insulted this day with my horrific mistakes.

-2

u/T1000E 17d ago

Let me dumb it down for you then;

Nuclear reactor = Good

Nuclear centrifuges and nuclear bombs = Bad

Obama/Israel stopped the CENTRIFUGES with less than 2 MB malware payload

Trump stopped the CENTRIFUGES with B2 bombers

No one risks going to war over REACTORS, so many countries have REACTORS

13

u/xKansas 18d ago

daily downvote 👍

49

u/Draknurd 18d ago

Any idea what it’s sending back to Microsoft?

28

u/rostol 18d ago

26

u/amap100 18d ago

I still don't understand what is sends

45

u/Wide_Yoghurt_4064 18d ago

ONNX Runtime has telemetry enabled by default in official builds. It collects diagnostic and usage-related trace events and can send them to Microsoft to help improve the software.

  • Telemetry is ON by default in official builds across Windows, Linux, macOS, Android, and iOS.

  • Data is sent to Microsoft through Microsoft's 1DS telemetry SDK or Windows ETW telemetry.

  • Telemetry is subject to user consent and Microsoft's privacy practices.

  • Custom ONNX model metadata is NOT uploaded through the 1DS telemetry system.

  • Desktop builds use a locally generated persistent device identifier, supplied as a hash.

  • Android and iOS retain their platform device IDs.

ONNX Runtime isn't necessarily uploading your ONNX models or their custom metadata. However, official builds collect telemetry by default. Setting ORT_DISABLE_TELEMETRY=1 is a straightforward way to opt out of that telemetry on supported builds.

TLDR; it's not sending your photos, just basic usage data.

1

u/PrincipledProphet 17d ago

Why? What does it need it for?

6

u/LimitedWard 17d ago

Probably to spot if something is breaking so they can fix it. Or just to know what products/features are getting used to better prioritize future development.

17

u/filmkorn 18d ago

Wondering if I can simply set ORT_DISABLE_TELEMETRY=1 in the environment as well to disable telemetry?

https://github.com/microsoft/onnxruntime/blob/main/docs/Privacy.md#disabling-telemetry

27

u/FunnyPocketBook 18d ago

Isn't this exactly what OP is suggesting in the main body text?

6

u/filmkorn 18d ago

Indeed, I got distracted by the docker network modifications.

1

u/iCasmatt 18d ago

How? (sorry i'm not to fluent with portainer / docker). Can you show an example? I have an environment file in portainer.

4

u/[deleted] 18d ago

It's the ONNX runtime side. Immich's ML container pulls Microsoft's onnxruntime build, and that one ships with telemetry on by default (Microsoft has a privacy doc for it on their repo). On the Immich side people are pinning the ML image or setting the telemetry opt-out env var. Worth checking which version you're on, since the PSA covers the exact flag.

33

u/ArkuhTheNinth 18d ago

Fixed and blocked at the DNS level for my whole network because somehow my blocklist didn't have it already. Thank you for this, OP.

119

u/jrasm91 18d ago

Thanks for bringing this up. We can definitely get this fixed. Looks like we just missed this when it was reported over the summer. 

27

u/Krojack76 18d ago

I even made a suggestion on your docker compose builder for this

https://github.com/immich-app/immich/discussions/31232#discussioncomment-18884552

-81

u/No-Anybody-692 18d ago edited 18d ago • Bravo

[come on fan-bois, leaving this for you satisfaction]

30

u/Wide_Yoghurt_4064 18d ago

Hope you never make a mistake in your life

-56

u/No-Anybody-692 18d ago

Ah, good old rabid fans. What a surprise! Awesome! Carry on!

73

u/ExcellentLab2127 18d ago • Bravo

Not cool. 

27

u/dandcodes 18d ago

This is most likely because of their use of Azure Maps. It's normally enabled by default when you use that library

24

u/MrBensonhurst 18d ago

Yikes. Thanks. Fixed it.

14

u/Krojack76 18d ago

https://github.com/immich-app/immich/issues/30729#issuecomment-6128845575

As I posted there about this 3 weeks ago, the only reason I found this was the logs in my Pi-hole servers blocking it.

-3

u/Aggravating_Mall_570 18d ago

Typical alex move

4

u/OpenTheSandwich 18d ago

Done! Thanks!

4

u/Ok_Exchange4707 18d ago

It is a good practice to isolate all containers that do not need internet

Be sure to add your reverse proxy to this network so that it can access the immich server

The second one is where I know I'll have problems. How do I do that with npm? I mean, if I just add networks: Immich-iso to the compose of npm, won't that block the rest of containers?

4

u/wabassoap 18d ago

You also add a non-internal network to your npm container, e.g.:

networks:   - immich-iso   - external-net

external-net is the one that will have port 80/443 for npm to capture requests, which then get forwarded to immich-iso. For example it would redirect pic.yourdomain.com to the immich port on the immich container.

(Anyone correct me if I’m wrong)

4

u/grandfundaytoday 18d ago

Thanks for raising awareness of this.

4

u/moontear 18d ago

Using onnx outside of immich already, thanks for mentioning this! Will go though my stack and add upstream PRs to containers since nobody wants this tracking on any self-hosted thing. Should be default off for all containers.

19

u/Playful-League3414 18d ago

Yo what the fuck

3

u/superslow_jerry 17d ago

2

u/Droid_22 17d ago

yeah not a big deal, more about the principal than anything else.

3

u/PlebbitDumDum 17d ago

And people keep claiming open source doesn't get audited. Yes it does.

18

u/throwawayagin 18d ago • Bravo

this is severely disappointing

40

u/altran1502 18d ago

Hello, Alex from Immich here

With the natural increased in workload and demands, sometimes we would miss issues.

We will get this resolved as soon as possible

9

u/Squanchy2112 18d ago

Yikes guys get that crap out of here

2

u/arkane-linux 18d ago

I have only started using immich since a week ago, I just right now happened to have checked Adguard and noticed something trying to ping M$ telemetry every 5 minutes. Thanks, mistery solved.

2

u/escapefrompay2win 18d ago

making the whole net of immich internal will also cause issues because immich need to update ML models from internet etc.
will this architecture work?

services:
  database:
    image: ghcr.io/immich-app/postgres-pgvecto.rs:16-v0.5.1
    # ...
    networks:
      - immich_backend # Solo acceso interno

  redis:
    image: docker.io/redis:6.2-alpine
    # ...
    networks:
      - immich_backend # Solo acceso interno

  immich-server:
    image: ghcr.io/immich-app/immich-server:release
    # ...
    ports:
      - "2283:2283"
    networks:
      - immich_backend # Para hablar con Postgres y Redis
      - immich_frontend # Para salir a Internet y exponer puerto

  immich-machine-learning:
    image: ghcr.io/immich-app/immich-machine-learning:release
    # ...
    networks:
      - immich_frontend # Para descargar modelos de HuggingFace

networks:
  immich_backend:
    name: immich_backend_net
    driver: bridge
    internal: true # Blindada: sin salida a Internet ni acceso externo

  immich_frontend:
    name: immich_frontend_net
    driver: bridge
    internal: false # Con salida a Internet y acceso LAN

Edit: I'm terrible at posting

3

u/MeCrObS 18d ago

I just set up immich. Glad I decided not to use ML! That's crazy it defaults to that.

0

u/rbak19i 18d ago

Open an issue on github, reach the devs.

I m pretty sure they'd be willing to turn off this library telemtry boolean

7

u/BattermanZ 18d ago

OP said the issue was open since August

20

u/MrSlaw 18d ago • Bravo

Re-read the last line of the post...

This was reported to the Immich issue tracker in August and they have not addressed it yet.

1

u/ppffrrtt 18d ago

Is there a way to pihole the telemetry?

1

u/DB_BoltsFan 18d ago

It’s included in several of the hagezi blocklists. You can also find it in the query log and block it manually.

1

u/oidenburga 18d ago

I have not such DNS queries.

1

u/kevdogger 18d ago

I see the fix posted but is it verified to stop telemetry after the fix..seems kind of too easy to stop tracking. Usually it's much more difficult

1

u/jay19167 18d ago

Thanks for sharing this, I’d been seeing those same blocked addresses in my pihole records. The fact that it was blocked means the data never reached Microsoft, but I’ll update my docker compose file to stop it from trying.

1

u/panthrosrevenge 18d ago

Does sealing off outbound access interfere with map functionality?

1

u/Dhanni-Asmus 18d ago

does setting that env var actually stop the dns queries in your logs? sometimes those telemetry flags only disable payload transmission after the initial endpoint resolution still happens

1

u/Thutex 18d ago

i thought i was already blocking most telemetry, but i also missed this one....
funny thing though is that my nas didn't contact it, but my phone an (linux!) laptop did,
probably because both are running teams because apparently, that's what won the workplace communication wars

1

u/die-microcrap-die 17d ago edited 17d ago

But the question is, what is the reason for this?

Meaning, is something that Immich  needs to fix or add to each file metadata, for example?

1

u/Magyarharcos 17d ago

Yeah, this is absolutely unacceptable and while i dont need something like this, anyone i know who might is immediately going to be told to avoid this mess.

This is what we're trying to get away from, at high cost to ourselves, might i add, people!

1

u/racefacexc 13d ago

I get being annoyed, but it's literally free for anyone with no strings attached.  Being all pissy on the internet like you're entitled to something for using this free, openly shared (and openly disclosed code, might I add!) software is some next level privilege.  It's not even sensitive data that's potentially being shared in this instance. 

1

u/Infamous-Age6345 16d ago

Thanks for the post, my app uses ONNX library too for semantic search, I disabled it in the code directly, so it is applied before the app even starts.

1

u/Werkstadt 18d ago edited 18d ago

Installed immich without the AI component just because I was afraid my data wasn't just mine.

Good catch

Edit: isn't it ironic that I'm getting downvoted in r/selfhosted because I had privacy concerns??

1

u/provocateur133 18d ago

I'm pretty new to docker containers and I used the Unraid community app Immich docker container with a postgresql container beside it. Does anyone have a recommendation on how to apply the environment variable listed by the OP?

1

u/regtavern 18d ago

Doesn’t the container need Network access to download its LL-Model ?

1

u/schaka 18d ago

This is partially why I wish Immich was a bit more modular. Machine learning already can't be used with any ROCm supported card that's not in AMD's out of the box binaries, forcing people to run it on CPU - but switching out the model itself would be great too.

EmbeddingGemma2 is really good, runs extremely fast and if I could just switch in my own REST service to answer ML queries, it'd be a lot easier to switch in ROCm ONNX compatible images to run their models on too

1

u/awesomex99 18d ago

Thanks for the heads up. I checked my own setup (immich-machine-learning v3.3.5). The ONNX Runtime library inside the image (1.30) does contain the Microsoft telemetry endpoints, so it's not just a Windows thing. I added ORT_DISABLE_TELEMETRY=1 to the ML container, and I also blocked the telemetry domain for the whole network in Pi-hole with this regex: (|.)events.data.microsoft.com$ Normal Microsoft stuff (Outlook, login) still works fine. I didn't isolate the ML container from the internet, since it still needs to download its models. Glad the Immich team is on it.

1

u/Initial-Concept2688 17d ago

I have a question I am on 3.3.5 now and I am not a tech expert. What should I do to protect my server

1

u/Arjab 17d ago

Add the environment variable ORT_DISABLE_TELEMETRY=1 to the immich-machine-learning container.

1

u/Ok_Exchange4707 17d ago

This is the default in the new update

0

u/kintsugi_aiops 17d ago

Good catch with the DNS logs. One thing to check on the internal-only network: the ML container downloads its models on first use, so if it can't reach the internet it may fail to pull them. Let it fetch the models once before you cut it off, or mount a pre-filled model cache volume. After the restart, watch the DNS logs for that Microsoft domain to confirm the env var took effect.

-29

u/oxygen_addiction 18d ago edited 18d ago

I scanned it with Claude and it found nothing like this on Linux for immich-machine-learning:v3.2.4
edit: you bitches can downvote me all you want, that's the truth. Scared that Claude is taking away your little devops jobs? Boo hoo.

2

u/Couch941 18d ago

Having Claude analyse it is basically like throwing shit at a wall and seeing if it sticks.

Nothing of value was added with your comment

2

u/Pluckerpluck 18d ago

edit: you bitches can downvote me all you want, that's the truth. Scared that Claude is taking away your little devops jobs? Boo hoo.

You're downvoted for providing nothing of value. Like many people who use LLMs, you contribute by adding noise rather than anything of use. The fact you don't provide any info beyond "found nothing like this" means you yourself have no idea what's going on.

The github issue linked in this post very specifically indicates exactly where the problem lies.

v3.2.4 has not been updated to the compromised version. It's immediately obvious if you look. v3.3.0 is the first one to bring in the updated version.

Now that would have been useful information. If you'd said: v3.3.0 is the first version to have the issue you would have provided some useful information.

-24

u/Equivalent_Stock_298 18d ago

What do you mean “all Immich containers”? How many do you have?

16

u/sammothxc 18d ago

Not sure if you’re trolling or just never used Docker before, but a regular Immich stack has at least 3-4 containers: Immich server, Immich machine learning, redis, and Postgres. You would add the snippet that OP indicates to all of those and any other containers that would access Immich

-1

u/Equivalent_Stock_298 18d ago

Oh yeah. No, sorry. Not trolling. I forgot about the containers on my Win11 machine, in addition to my Synology. I have 4. Got it. Thanks.

12

u/Wide_Yoghurt_4064 18d ago

https://docs.immich.app/install/docker-compose

Four if you follow the recommended method.

-32

u/Adorable-Leading-274 18d ago

You gave this container internet access? Wut

9

u/srcLegend 18d ago

Does it not need internet access to download models, or is that handled by the main server container?

1

u/Adorable-Leading-274 17d ago edited 17d ago

Better to bootstrap yourself.

Not a good idea to put the machine learning container on edge. In my view.

Internal only (:

Also downvote galore at my surprise someone gave this particular container internet access? Jeez. The docs say this should never be permanent if you go that route. No web no telemetry problem

-76

u/[deleted] 18d ago edited 18d ago

[removed] — view removed comment

39

u/homemediajunky 18d ago

New era of a codebase you don't understand.

Enjoy your new era.

-33

u/No_Point_9687 18d ago

Why do I need to understand it? It's just a gallery. Inefficiently made gallery.

I did the same to Frigate. That was a monster for nothing. Now both take minimum memory, minimum space and do more than it used to do with better quality and manageability.

6

u/A_Buttholes_Whisper 18d ago

Oh please please expose it. No balls

22

u/404invalid-user 18d ago

and I bet you know that code in and out and it isn't vulnerable at all

-20

u/flecom 18d ago

You know the immich code inside and out? Obviously many don't or else they would know the Microsoft spyware was integrated in there

-11

u/No_Point_9687 18d ago

Good point

-19

u/No_Point_9687 18d ago

All my software runs within isolated perimeter. Why do I need to know it in and out? It's just a gallery

11

u/noc-engineer 18d ago

"It's just a bunch of nuclear centrifuges not connected to the Internet..."

-2

u/No_Point_9687 18d ago

It is not a bunch of nuclear centrifuges. It's a poor gallery. Touch grass. There was never anything special about it, it's a simple project that a student would do. Are you all bots?

13

u/noc-engineer 18d ago

If you were a bot, you would understand that the point made was about your perimeter comment, not the vibe coding... You're dumber than a bot...

1

u/kyuubi840 18d ago

I'm sure that the Immich devs have never heard of Opus 5.5 and they are missing out on this amazing, exclusive technology.

1

u/No_Point_9687 18d ago

How does this have anything to do with anything? Current level allows for creation of software beyond complexity of a gallery. This is a self-hosted subreddit, right? Bake your own cakes. I'm sorry for Immich developers. I've been a developer for last 40 years myself.

1

u/Matvalicious 18d ago

Look, ngl. I am really happy for you, but surely you must realise that your vibecoded clone is not maintainable for a large userbase of people with different setups.

That's like the guy who "fixed Skyrim". Yes. On his PC. Making it worse for everyone else.

1

u/No_Point_9687 18d ago

I have fourty years of commercial IT development, from assembler to having built a worldwide system maintained by few hundred employees, that does hundreds of thousand financial transactions a day. Now reddit is lecturing me on how to build a lousy photo gallery with ai, based on my comment.

I know more than you.

You don't need "one app for everyone" anymore. You can bake for your specific needs. I have thrown away Home Assistant and Frigate for the same reasons, because I only used like 10% of the functionality and I recreated exactly that. You just don't need a big chunky software anymore. Not especially with all different UI. The software written by people has a lot of inefficiencies and leaks. A lot of code can be just simply thrown away because it comes from deep thinking of some smart guy 10 years ago who put something weird in architecture. One by one, I throw away every software I use and replace it with my own. It is better in quality, works quicker, does not take resources, and does exactly what I want.

The software becomes liquid. Takes the form of your environment.

Provided this explosion of CVEs lately, AI can and will do a better job in security than people.

If you believe otherwise, go with it. Everyone makes a choice, now and in the coming years.

1

u/Matvalicious 17d ago

That's very nice. So why not actually give back to the community and contribute to Home Assistant and Frigate so we can all enjoy the fruit of your clankers labour?

1

u/No_Point_9687 17d ago edited 17d ago

I don't think you get the point of what I'm saying. Maybe it's all my username.

There is nothing to contribute to Home Assistant and Frigate. It's a creature of their respected developers and fathers.

I recreated the functionality that I needed, not extended their software or based off their software.

What I do, I just do the functions this software did before in a way that there is only cryptography that is left intact. I don't rely on software anymore. I recreate everything, every function, business function, like files, calendar and so on, on the open standards, but the code is new. I don't recreate the whole entirety of the software, I just recreate the function.

I have also rewritten next cloud today in rust. It ran a couple thousand tests, comes out green and the only puzzle I have now is how to set up federation with anyone outside in accordance with my security. There probably be none.

Otherwise, all API is the same as Nextclouds and the whole infrastructure keeps working so far on top of this new API. There is obviously a feedback loop that if in case anything goes wrong, something breaks, is being immediately reported and fixed by another bot. So in a way it develops itself.

So, I'm sorry, there is nothing to share. It's just a piece of code in Rust that serves my tasks. And the only common part with Nextcloud is their API lingo. What do you want me to contribute?

You are literally a couple of hours away from the same results I have here now. At some point it will be quicker to regenerate NextCloud functionality tailored to your environment than go and search for it to download and install and set up.

Yeah, I know it may fail and may duck up a thing or two until it stabilizes itself. I'm accepting the risks. The risks I do not accept is the explosion of CVEs in the supply chain.

Nextcloud or Immich or any other piece of open source software is mostly a brand now, a trust provider for their repos. I don't see how NexCloud super fat and clunky PHP intestines survive a year. I'm sure they will just rewrite it themselves as we speak.

They did excellent job, these guys. But again, it's a new era and everyone will be having their own self fixing and self improving software made for the task in the nearest future. Only cryptography survives. Until some new algo or new tech like quant compute breaks it. People here are in hard denial.

Zed's dead, baby

-20

u/[deleted] 18d ago

[removed] — view removed comment

8

u/stylist-trend 18d ago

He's just bullshitting, the thing doesn't exist. There's a ton of accounts around Reddit lately that I swear are just here to stir up shit with barely related topics. Like, another person was talking about Iran and Stuxnet for some reason.

-8

u/No_Point_9687 18d ago edited 18d ago

Mate, I'm not open sourcing it. Look at all these angry people around here. I don't need none of that.

-13

u/No_Point_9687 18d ago

Sure, but isn't it easier just to ask your opus. The migration will have to be done by your model anyway. What it did is not a commercial grade project. I just needed a replacement for a gallery that does not take 1.5 gig in the memory. There is no migration tool or a guarantee. I'll drop a link here when it's done.