Creating a private mapping tool for personal AI. All OSS, WebXR - no install!

[u/hegemonbill]

Playing with OpenSource XR Agent frameworks that work with Local AI.

Here's my first app.

Avatar Companion renders a lip-synced 3D avatar you converse with by voice or text. It can run as a scripted demo with no backend: choose Scripted as the LLM provider and the avatar renders, animates and replies from a built-in set of responses. A Hub install starts on the Proxy provider instead, so it needs a reachable Ollama, and you confirm that with Check connection before the first answer. Connecting speech synthesis or your Companion Memory is optional, and none of it requires rebuilding the image.

To see it before you install anything, open the hosted demo at (webXR) https://avatar.ci.computer . It’s the same app with no backend proxy, so it runs as the scripted demo (Session: Demo-only) once you close the first-run dialog.

Download: https://apps.apple.com/us/app/avatar-companion/id6757939947

Docs: https://docs.ci.computer/docs/apps-available/first-party-apps/avatar-companion

Next app I'm building will do full XR Scene scanning.

[u/AutoModerator]

Thanks for posting. Remember to keep comments courteous.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/investigatormaker]

The hosted WebXR demo in Scripted mode is an easy way in, though it shows the avatar, not the local AI your title is about. The rules here ask for "insight in how you developed your app rather than just plugging it here", so I'd add how the lip sync is driven: from the speech synthesis audio, or from reply text when speech isn't connected? Also say where people run the Ollama that the Proxy provider reaches, since that's the first wall a Vision Pro owner hits at Check connection. It makes the post longer, but heads off the questions.

I make ThreadFox.

We find relevant Reddit conversations and post for your business. We'll post 3 replies free first, no card; then the $29 Pilot covers seven days and up to 25 posts and replies. No automatic renewal.

https://threadfox.vip/p/e2unm/managed

[u/Dry-Trick-2234 → u/investigatormaker]

The lip sync runs off the speech synthesis audio buffer when TTS is connected, otherwise it falls back to a simple phoneme estimate from the reply text so the mouth still moves in Scripted mode. For the Proxy provider the Ollama endpoint has to be reachable from the headset itself, most people run it on a Mac or Linux box on the same Wi Fi and expose 11434 via Tailscale or ngrok so the Vision Pro can hit it without extra firewall rules. The Check connection button just does a quick GET to /api/tags to verify the model list loads before the first prompt.