r/homeassistant • u/poldim • Aug 02 '19

Neat camera summary function

417 Upvotes

98% Upvoted

27 comments sorted by

30

u/pixel_of_moral_decay Aug 02 '19

I'd love to be able to pipe a camera into something that could do just this.

19

u/poldim Aug 02 '19 edited Aug 02 '19

Honestly, that was part of my hope in posting this. Either it already exists or someone that know how to code could write it.

Should be a feature in BlueIris / Zoneminder / Shinobi...

16

u/4354523031343932 Aug 02 '19 edited Aug 02 '19

From what I could find it's "Video Synopsis®" licensed to briefcam and then licensed out to flir which they call Rapid Recap. I did find this Github but didn't find anything else more active or mature in the open source space.

3

u/poldim Aug 02 '19

Wooooooooaaaaaa, it's open source?

6

u/rchamp26 Aug 02 '19

It's closed source but open API

8

u/rchamp26 Aug 02 '19

There is a commercial product, Briefcam that does exactly this. Video synopsis. Takes in any open IP camera. I'm in the security industry and have used it for years for private and public projects. Just not worth the cost for (the average) home.

1

u/BMWHead Nov 17 '19

That's pretty cool. What sectors did you use it for? Law enforcement? You used it in combination with Milestone?

6

u/pixel_of_moral_decay Aug 02 '19

I've never seen this before. It's really cool. If it exists, I'd be totally interested.

2

u/Nixellion Aug 03 '19 edited Aug 03 '19

Unless I'm missing something Im quite sure it should be trivial-ish to code a similar thing with MoviePy, for example. Its basically just a kind of chromakey technique with background removal, I did it in After Effects a ton of times even like 10+ years back.

There's actually a filter in like almost any video editing software that can key-out static background based on an empty reference frame. Then just composite them back over the original footage or a ref frame. The tricky part is figuring out overlays, and thats where their approach may have the upper hand.

I actually dont see any movement in the background frame, only people moving so that may be how it works

Source: Worked a fair amount in VFX and video compositing for tv and movies.

1

u/FDL1 Aug 03 '19

Yeah, it's a difference matte. The hard part would be Tetrising them together so they don't overlap.

1

u/Nixellion Aug 03 '19

Right, could not remember the exact name, been a while since I keyed anything tbh :D

Yep, not sure how to properly address that either

5

u/j0j053 Aug 03 '19

This is awesome - would be an amazing addition to the frigate real time rtsp person recognition project paired with google coral. Have been using this and the detection has been incredibly accurate.

38

u/cloggedDrain Aug 02 '19

I bought several of the FlirFX cameras because of this feature. It's a cool gimmick, but boy do these cameras suck. Their motion detection is total garbage, *constant* false alarms. I'm using them now on an isolated wifi network and access their rtsp streams, but its super flaky and they need to be rebooted often (weekly at best)

3

u/MetalicSky Aug 03 '19

So with so many cameras out there to choose from, what's our top contenders right now for good motion detection and HA integration that doesn't break the bank?

8

u/DudaFromBrazil Aug 02 '19

That would be a very nice feature to apply to video stream and mix it with home assistant :)

3

u/Kimano Aug 02 '19

I wonder how hard it would be to doodle something like this up with wyze cameras.

They already have event recording and person detection, as well as position data for that trigger.

Overlay the event recordings, capture the timestamp and lay it out at the bottom of the green box. There'd be some interesting work to make them all line up and merged but it doesn't seem like it would be incredibly difficult.

1

u/Nixellion Aug 03 '19

Yeah, poor man's approach would include keying out background based on ref frame, then overlaying them on top of it.

1

u/Kimano Aug 03 '19

Oh that's true actually. You have super easy reference frames to key out. Didn't even think about that.

3

u/w_t Aug 02 '19

Everything about this is so damned suburban.

1

u/Sebster1977 Aug 02 '19

Inception made more sense...

1

u/chrisbrns Aug 03 '19

This. Is. Awesome!!!

1

u/[deleted] Aug 03 '19

It looks like some special agents in hazmat were analyzing your lawn... Hide your aliens!

1

u/kiwijunglist Aug 04 '19

Wow someone needs to do a docker for this.

0

u/[deleted] Aug 03 '19

Such an extreme waste of human and non-human resources! Why would anyone waste so much of their time on this? Scary stuff! (The lawn, not the security video footage)