Firefly Vision tools + Kangaroo Physics
This is using grasshopper and a physics engine (kangaroo) and firefly (which lets you get data /control other connected devices like camera or arduino). This is a sort of awesome experiment that lets computer vision be used directly in the manipulation of cad objects (spheres in this case). This basic structure could be used to make some pretty cool stuff. I really like the idea of creating a more humane interface for cad modeling. Modeling right now works well but is rather de-humanizing in comparison to clay, wire or pencil and paper. Computers have the tendency to make one feel like the brain is turning into jello. Maybe if one could use hand gestures and computer vision to make 3d models it would be a little less alienating.
https://www.creativeapplications.net/openframeworks/hand-tracking-gesture-experiment-with-iisu-middleware-and-of/