MEMODULES are tiny tagged physical objects containing a link towards information sources. We consider them as tangible hypermarks, i.e. physical object embedding a hyperlink to abstract information.
This project follows two complementary approaches, user centered and technology driven, in order to design, implement and evaluate MEMODULES facilitating the control of devices in the everyday life and also information categorization in order to improve information access and retrieval. For this reason, relevant formats and methods for mining and visualizing multimodal information will be studied and implemented. Within the user centered approach, we will study user’s needs and tasks they need to accomplish in order to provide suitable and usable MEMODULES. With the technology-driven approach, smart sensors will be designed and implemented. Those sensors will improve human/machine physical interaction techniques and multimodal processing capabilities for a new generation of devices and environments.
The proof of concept of MEMODULES will be assessed through two major applications:
- MEMODULES to control our daily life information: the goal is to design, implement and evaluate tangible interfaces allowing access, control, personalization and materialization of personal multimedia information.
- MEMODULES to interact with a Smart Meeting Room (SMR): this application shared with the NCCR of Multimodal Information management (IM2), aims at recording meeting with audio/video devices, and further at analyzing the captured data in order to create indexes to retrieve interesting parts of meeting recordings.
Furthermore, MEMODULES’s usefulness and usability, taking care of humans’ physical and psychological factors, will be evaluated with targeted users along the whole design and implementation process, from the early use-cases towards the realization itself.