[{"authors":"Sebastian Feuerstack","built_at":"2012-11-21T00:00:00.000Z","created_at":"2012-11-21T14:44:32.924Z","description":"Multimodal systems realizing a combination of speech, gesture and graphical-driven interaction are getting part of our everyday life.\n\nExamples are in-car assistance systems or recent game consoles. Future interaction will be embedded into smart environments offering the user to choose and to combine a heterogeneous set of interaction devices and modalities based on his preferences realizing an ubiquitous and multimodal access.\n\nThis framework enables the modeling and execution of multimodal interaction interfaces for the web based on ruby and implements a server-sided synchronisation of all connected modes and media. Currenlty the framework considers gestures, head movements, multi touch and the mouse as principle input modes. The priciple output media is a web application based on a rails frontend as well as sound support based on the SDL libraries.\n\nBuilding this framework is an ongoing effort and it has to be pointed out that it serves to demonstrate scientific research results and is not targeted to we applied to serve productive systems as they are several limitations that need to be solved (maybe with your help?) like for instance multi-user support and authentification.  \n\nThe MINT core gem contains all basic AUI and CUI models as well as the basic infrastructure to create interactors and mappings. For presenting the user interface on a specific platform a \"frontend framework\" is required. For the first MINT version (2010) we used Rails 2.3 (See http://github.com/sfeu/MINT-rails). The current version uses nodeJS and socketstream as the frontend framework (See http://github.com/sfeu/MINT-platform). The MINT-platform project contains installation instructions.\n\nThere is still no further documentation for the framework, but a lot of articles about the concepts and theories of our approach have already been published and can be accessed from our project site http://www.multi-access.de .","downloads_count":4775,"metadata":{"homepage_uri":"http://www.multi-access.de"},"number":"2.0.0","summary":"Multimodal systems realizing a combination of speech, gesture and graphical-driven interaction are getting part of our everyday life","platform":"ruby","rubygems_version":">= 0","ruby_version":null,"prerelease":false,"licenses":[],"requirements":null,"sha":"e6018438646efb9d863b4442d7628e6e6807678a5a480974e5ebaf2970e0aafc","spec_sha":"f19281f377203a7f7480514ce025956f15b14fd4d989395b6567bd7f41aaffa7"},{"authors":"Sebastian Feuerstack","built_at":"2011-11-09T00:00:00.000Z","created_at":"2011-11-09T08:31:55.356Z","description":"Multimodal systems realizing a combination of speech, gesture and graphical-driven interaction are getting part of our everyday life.\n\nExamples are in-car assistance systems or recent game consoles. Future interaction will be embedded into smart environments offering the user to choose and to combine a heterogeneous set of interaction devices and modalities based on his preferences realizing an ubiquitous and multimodal access.\n\nThis framework enables the modeling and execution of multimodal interaction interfaces for the web based on ruby and implements a server-sided synchronisation of all connected modes and media. Currenlty the framework considers gestures, head movements, multi touch and the mouse as principle input modes. The priciple output media is a web application based on a rails frontend as well as sound support based on the SDL libraries.\n\nBuilding this framework is an ongoing effort and it has to be pointed out that it serves to demonstrate scientific research results and is not targeted to we applied to serve productive systems as they are several limitations that need to be solved (maybe with your help?) like for instance multi-user support and authentification.  \n\nThe MINT core gem contains all basic AUI and CUI models as well as the basic infrastructure to create interactors and mappings. Please note that you need at least a CUI adapter gem to be able to actually run a system, e.g. the MINT-rails gem. But for initial experiements ist enough to follow the installation instructions of this document.\n\nThere is still no documentation for the framework, but a lot of articles about the concepts and theories of our approach have already been published and can be accessed from our project site http://www.multi-access.de .","downloads_count":3792,"metadata":{"homepage_uri":"http://www.multi-access.de"},"number":"1.0.1","summary":"Multimodal systems realizing a combination of speech, gesture and graphical-driven interaction are getting part of our everyday life","platform":"ruby","rubygems_version":">= 0","ruby_version":null,"prerelease":false,"licenses":null,"requirements":null,"sha":"91e5934bf566e26394435bedf071b67db5187fb99f6c2fb69d42555bb364f6e3","spec_sha":"b526aeb4f5ba2a71564836626e535277e10056b97a5eeecc538774e00c6bc4f3"},{"authors":"Sebastian Feuerstack","built_at":"2011-11-02T00:00:00.000Z","created_at":"2011-11-02T00:12:45.541Z","description":"Multimodal systems realizing a combination of speech, gesture and\ngraphical-driven interaction are getting part of our everyday life.\n\nExamples are in-car assistance systems or recent game consoles.\nFuture interaction will be embedded into smart environments offering\nthe user to choose and to combine a heterogeneous set of interaction\ndevices and modalities based on his preferences realizing an ubiquitous\nand multimodal access.\n\nThe MINT Framework enables the design, creation, and execution of\nmultimodal interfaces.\n\nThe MINT core gem contains all basic AUI and CUI models as well as\nthe basic  infrastructure to create interactors and mappings. Please\nnot that you need at least a CUI adapter gem to be able to actually\nrun a system, e.g. the MINT-rails gem.","downloads_count":3699,"metadata":{"homepage_uri":"http://www.multi-access.de"},"number":"1.0.0","summary":"Multimodal systems realizing a combination of speech, gesture and graphical-driven interaction are getting part of our everyday life","platform":"ruby","rubygems_version":">= 0","ruby_version":null,"prerelease":false,"licenses":null,"requirements":null,"sha":"fd4380fc975dfda4b3bea6e9285f4d90c75579bab33ef5c1d9d335a102d76a88","spec_sha":"77314fc730e28e78040c137bae8b6edc578644c2ac954d0b5cfa4efe5dca7765"}]