J. Wagner, F. Lingenfelser, T. Baur, I. Damian, F. Kistler, E. André.: The social signal interpretation (ssi) framework – multimodal signal processing and recognition in real-time. In: Proceedings of ACM MULTIMEDIA 2013. Barcelona (2013)

Automatic detection and interpretation of social signals carried
by voice, gestures, mimics, etc. will play a key-role for
next-generation interfaces as it paves the way towards a more
intuitive and natural human-computer interaction. The paper at
hand introduces Social Signal Interpretation (SSI), a framework
for real-time recognition of social signals. SSI supports a large
range of sensor devices, filter and feature algorithms, as well as,
machine learning and pattern recognition tools. It encourages
developers to add new components using SSI’s C++ API, but
also addresses front end users by offering an XML interface to
build pipelines with a text editor. SSI is freely available under
GPL at http://openssi.net.

ssi-acm13-camera.pdf download View | Download
Keywords: SSI
Categories: Related work