In this OFx sketch I combined ofFacetracker with SimpelSerial to make a sketch.
I track the mood of a person via a webcam and when one looks angry this person gets a shock (or in my prototype a burning LED). When a person looks happy he gets a piece of candy (or a not-buring LED in my prototype). In comparison with my GIF I have used a tremendous amount of internet. Both for debugging and inspiration.

Originally I was planning to do something with a leapmotion. Unfortunately I could not get any of the libraries for this working. My hypotesis is that this has to do with the installation with the SDK. The fact the leapmotion just updated their SDK, but unfortunately I was unable to find a solution. Due to the fact that I already had two libraries working I decided to continue with those.

Further improvements are to be with regard to expressions. I only could accurately track two expressions. More would be preferable. This is probably doable by getting more samples for each expression.

The code can be found on my gitHub:

https://github.com/tlangerak/OpenframeWorks-Expression