Supporting multimodality in service-oriented model-based development environments
Manca M., Paternò F.
Multimodal interfaces Authoring tools Model-based design User Interfaces [ INFO.INFO-DL ] Computer Science [cs]/Digital Libraries [cs.DL]
While multimodal interfaces are becoming more and more used and supported, their development is still difficult and there is a lack of authoring tools for this purpose. The goal of this work is to discuss how multimodality can be specified in model-based languages and apply such solution to the composition of graphical and vocal interactions. In particular, we show how to provide structured support that aims to identify the most suitable solutions for modelling multimodality at various detail levels. This is obtained using, amongst other techniques, the well-known CARE properties in the context of a model-based language able to support service-based applications and modern Web 2.0 interactions. The method is supported by an authoring environment, which provides some specific solutions that can be modified by the designers to better suit their specific needs, and is able to generate implementations of multimodal interfaces in Web environments. An example of modelling a multimodal application and the corresponding, automatically generated, user interfaces is reported as well.
Source: HCSE 2010 - 3rd Conference on Human-Centred Software Engineering, pp. 135–148, Reykjavik, Iceland, 14-15 October 2010
Clark J., Xsl Transformations (XSLT) version 1.0. Technical report,W3C, 1999.
Coutaz J., Nigay L., Salber D.,.Blandford A, May J., Young R., 1995. Four Easy Pieces for Assessing the Usability of Multimodal Interaction: the CARE Properties. Proceedings INTERACT 1995, pp.115-120.
5. Honkala M., Pohja M.: Multimodal interaction with XForms. Proceedings ICWE 2006: 201-208.
6. Lawson J., Al-Akkad A., Vanderdonckt J., Macq B.: An open source workbench for prototyping multimodal interactions based on off-the-shelf heterogeneous components. Proceedings ACM EICS 2009: 245-254
7. Lin, J., Landay, J.A.: Employing Patterns and Layers for Early-Stage Design and Prototyping of Cross-Device User Interfaces. Proc. CHI: 1313-1322 (2008)
8. Myers, B.A., Hudson, S.E., Pausch, R.: Past, Present and Future of User Interface Software tools. ACM Trans. Comput. Hum. Interact. 7, 3-28 (2000)
9. Multimodal Interaction Activity (W3C), http://www.w3.org/2002/mmi/
10. Nichols, J. Myers B. A., Higgins M., Hughes J., Harris T. K., Rosenfeld R., Pignol M., 2002. “Generating remote control interfaces for complex appliances”. Proceedings ACM UIST'02, pp.161-170.
11. Obrenovic, Z., Starcevic D., Selic B., A Model-Driven Approach to Content Repurposing, IEEE Multimedia, January March 2004, pp.62-71.
12. Paternò, F., Giammarino F.: Authoring interfaces with combined use of graphics and voice for both stationary and mobile devices. AVI 2006: 329-335
13. Paternò, Santoro, C., Spano, L.D.: MARIA: A Universal Language for Service-Oriented Applications in Ubiquitous Environment. ACM Transactions on Computer-Human Interaction, Vol.16, N.4, November, pp.19:1-19:30 (2009)
14. Paternò F., Sisti C., Deriving Vocal Interfaces from Logical Descriptions in Multi-Device Authoring Environments, Proceedings ICWE 2010, Wien, July 2010, Springer Verlag, LNCS 6189, pp.204-217.
15. Stanciulescu, A., Limbourg, Q., Vanderdonckt, J., Michotte, B., Montero, F.: A Transformational Approach for Multimodal Web User Interfaces based on UsiXML. Proc. ICMI: 259-266 (2005)
Metrics
Back to previous page
@inproceedings{oai:it.cnr:prodotti:44398,
title = {Supporting multimodality in service-oriented model-based development environments},
author = {Manca M. and Paternò F.},
doi = {10.1007/978-3-642-16488-0_11},
booktitle = {HCSE 2010 - 3rd Conference on Human-Centred Software Engineering, pp. 135–148, Reykjavik, Iceland, 14-15 October 2010},
year = {2010}
}
0000-0003-1029-9934DOIAlso available from
