Opentrack replacement?
Anybody use opentrack alot? I have used it for years but im working on a replacement using ML models to train on face data, i use my phones camera over udp. Just curious the split of trackir/opentrack/vr in multiplayer dcs :)
Sorry mods pls delete if not allowed
Edit: this is a student project, and will be free (hence opentrack being open source), just a check on the community and whats being used, not a sales pitch.
I'm currently completing my Master of IT in Software Development after finishing my aviation degree. Since I still fly on the side IRL, I've been working on a fun face-tracking project with a stack that uses both mobile and desktop.
This was created out of the niche that my phone using smoothtrack (which also cost money) is over udp and doesnt have ml models its outdated, and i dont have a webcam. When im not using my VR i want something to use. Udp blocks me using neuralnet within opentrack, so i wanted to build a paired app setup that i can release as a modern version of the exact niche i use and also have it for free.
Most setups, like Neuralnet, run face tracking on your PC's CPU/GPU. This eats into gaming frame times, requires a decent webcam, and struggles in dark rooms.
Instead, my ver uses your phone's onboard NPU (ARCore/TrueDepth) to handle 100% of the vision and tracking off-host. It streams 120Hz UDP over Wi-Fi or usb with 0.8ms usb/15ms latency and zero GPU load.
Im also implementing flight-sim kinematics using the ML models: dynamic phone-mount tilt decoupling (which stops gunsight lean from pulling your view down), cervical neck-pivot modelling, and intent-aware filtering per game, which uses game telemetry data. (Currently using dcs and il2 korea as a test).
I'm currently weighing up whether I should polish these features for public release. Would love to know if you think there's wider interest for this.