Full Body Interaction Framework (FUBI) is a framework for recognizing full body gestures and postures in real time from the data of an OpenNI-applicable depth sensor, especially the Microsoft Kinect sensor.
The Framework distinguishes between four gesture categories:
- Static postures: Configuration of several joints, no movement.
- Gestures with linear movement: Linear movement of several joints with specific direction and speed.
- Combination of postures and linear movement: Combination of 1 and 2 with specific time constraints.
- Complex gestures: Detailed observation of one (or more) joints over a certain amount of time.
The current release version supports categories 1 to 3. However, you can already train and recognise category 4 with SSI that also integrates the FUBI framework.
In addition, you can detect the number of fingers users are showing up in front of the sensor (requires an OpenCV installation).
FUBI is written in C++ and currently offers a C++-API.
It has been only tested on Windows 7, but it should contain no platform dependent code.
The download comes with a Visual Studio 2010 solution including a sample application that should be ready to compile. You should only need to set the include and lib paths for OpenNI in Visual Studio and comment out the line “#define USE_OPENCV” at top of the OpenNITracker.cpp if you do not want to use OpenCV.
FUBI requires the installation of OpenNI (OpenNI binaries, latest unstable development version) and a compliant middleware supporting full body tracking (e.g. NITE, available on the same site as compliant middleware binaries, latest unstable development version).