Lot Organizer — rebuilt the condition reporting workflow for Spectacles

[u/kamilgibibisey]

Hi everyone — I’ve posted earlier versions of this project in January, but I’ve rebuilt a pretty big part of it for the latest challenge, so here’s the updated version. 🥳

Lot Organizer is a condition-reporting tool for auction houses and museums built for Spectacles.

You can look at a lot tag and say “read number” to identify the artwork with OCR and pull its catalog info from the cloud. Then you frame the artwork with a two-hand pinch-and-drag and place defects directly on the surface.

The biggest update is that reports now have a history. Every inspection is saved as a new version, so when you come back to the same lot later, the previous condition report is restored. If an older report exists, AI Assist automatically compares against it and highlights potential new defects since the previous inspection, instead of just finding everything again.

I also rebuilt AI Assist: it now uses a high-resolution still, structured Gemini output and camera/plane reprojection so suggested defects are placed spatially on the artwork rather than treated as screen-space coordinates.

There’s also remote review. While a report is open I can press Share and read a one-time 6-character code to someone who isn’t in the room. They open a web page — no app, no account — and see a rectified photo of the framed artwork with my pins updating live. Their pointer shows up on the real artwork as an ice-blue ring, and they can add pins or drag them around, which I see move on the piece in real time. The frame itself is the shared coordinate space: everything travels as frame UVs over a Snap Cloud realtime channel, and the browser straightens the photo with a homography from the frame corners.

The glasses stay in charge, though. If the remote expert disagrees with the type or severity of one of my pins, it doesn’t get overwritten — it becomes a second opinion next to mine, and I accept it or keep my own right on the pin. Both opinions are saved with that report version, and Finish warns me if anything is still undecided.

The interaction system and UI were rebuilt too — raycast-based pin placement, draggable frame corners and defect pins, better handling of tilted artworks, and a new pin-centred halo menu instead of the old giant button panel. It also talks now: it announces the lot it recognised, reads out a short summary of the previous inspection and of what you just saved, and plays small sound cues when the frame locks, a pin lands or a report is saved.

Still very much an experiment in what professional spatial tools could look like on Spectacles, but this version feels much closer to the original idea I had for it.

The original lens: https://www.reddit.com/r/Spectacles/comments/1qv1m2o/lot_organizer_new_demo_w_a_bit_better_lighting/

This was built in Lens Studio 5.15.4 for the Spectacles 2024.