This is the stuff I've been dreaming about doing. Frames of video are stacked on top of each other like playing cards. You can then cut into that object any way you want. Patterns in the video then become apparent.

The videos show how this works more effectively than words can. I'd like to see this work on a realtime stream, I'm sure that's coming though.

Volumetric Video from Dox Para Research