Examples for Flash, Processing, and Pure Data are included.
SendMultiTouchesĪ project from IACD 2012, Duncan Boehle’s SendMultiTouches is a small Mac-only app that streams multitouch data from a MacBook trackpad via OSC. See the Reactivision page for the app and plenty of examples and templates for Processing, OF, Max, Pure Data, etc. The markers are then attached to objects and placed facing down on the projection surface. It was developed for the ReacTable project and is 2D only since it’s optimized for use with an IR camera and projector mounted underneath the projection surface. Reactivision is the fiducial marker tracking application that streams the marker info using the TUIO protocol via OSC. You will need to use the markers provided with the libraries. The Augmented Reality toolkit is a library for finding and tracking image markers as well as providing a 3d transform for drawing content to fit over the marker.
#Microsoft kinect sdk for mac windows
ofxMSKinect : uses MS Kinect SDK and provides skeleton tracking, Windows only.ofxOpenNI : uses PrimeSense OpenNI library, more difficult to use, has skeleton tracking, may not work, YMMV.ofxKinect : uses open source freenect library, simple to use, no skeleton tracking, works on Mac/Win/Linux.
There are wrappers around some of these libs for most creative coding environments.
OpenCV is an open source computer vision library used by researchers, artists, robots, game companies, etc all over the world. Here are some libraries/environments that might be useful for this project: OpenCV a gesture processor, a drawing program, a transformative mirror, an audiovisual instrument, or some other system which allows a participant to experience themselves and the world in a new way. A project concerned with augmenting human action and/or perception, this is an exploration of interactive feedback in the context of high-bandwidth, continuous and real-time human signals - whether gesture, speech, body movement, or any other measurable property or behavior.