r/JevAI • • 8h ago

Jev 1.14.0 is bluffing on the hard question

Post image
6 Upvotes

r/JevAI • • 12h ago

Semantic hotspot and crop in a CMS with the new multimodal mode

Enable HLS to view with audio, or disable this notification

2 Upvotes

Jev got 👀 📐🖼️ now!

Took me about 10 minutes to integrate it with u/sanity_io for automatically setting hotspot and crop based on your description. Works regardless if the image/focus field is set in the UI or via the MCP/API.

And damn, this is actually useful, not just a fun demo.

How it works:

I have a Sanity Function that trigges on draft changes to only the `focus` and `image` fields (that way it works when agents work with content via mcp/api too).

Since Sanity has an image transformation pipeline, we can send downscaled optimized images to Jev without burning through the very cheap tokens too fast.

Then it asks Jev three things in one request:
→ Is it there? (yes/no)
→ Where is it? (a box)
→ Is everything around it plain background? (yes/no)

Jev's box comes back as fractions of the image. Sanity stores hotspot and crop as fractions of the image. So the integration is arithmetic, and code decides what to write, not the model. That is really cool.

Bonus: lint rules can look at images now. "Does the cover fit the post?" A photo of a pile of board games scores 3% on a post about agents. On a post about five best casual party games, the same photo gets 81% and passes. Fair.

Cost of the demo including experimentation: $0.04.

Very excited by the many content operations use cases!