Authoring Support for Post-WIMP Applications

Abstract

Abstract. Employing post-WIMP interfaces, i.e. user interfaces going beyond the traditional WIMP (Windows, Icons, Menu, Pointer) paradigm, often implies a more complex authoring process for applications. We present a novel authoring method and a corresponding tool that aims to enable developers to cope with the added level of complexity. Regarding the development as a process conducted on different layers, we introduce a specific layer for post-WIMP in addition to layers addressing implementation or traditional GUI elements. We discuss the concept of cross layer authoring that supports different author groups in the collaborative creation of post-WIMP applications permitting them working independently on their respective layer and contributing their specific skills. The concept comprises interactive visualization techniques that highlight connections between code, GUI and post-WIMP functionality. It allows for graphical inspection while transitioning smoothly between layers. A cross layer authoring tool has been implemented and was well received by UI developers during evaluation. Keywords: authoring processes; authoring tools; post-WIMP interfaces; cross layer authoring; collaborative user interface development; combined post-WIMP interactions; visual validation IntroductionAuthoring processes and tools for creating classical GUIs (Graphical User Interfaces) that adhere to the WIMP (Windows, Icons, Menus, Pointer) paradigm have been explored and refined over the years and developers have been honing their skills in creating these types of user interfaces. With post-WIMP [14] becoming more commonplace [11], the authoring process for user interfaces is becoming more complex, as the diversity of interaction methods rises [1,2]. Novel tasks need to be carried out during authoring and new skill sets are required, for example expertise in reality-based interaction [5], in order to develop post-WIMP user interfaces. As single authors seldom possess the whole range of skills required, collaboration of multiple author groups with specific expert knowledge is often needed [4,12]. We identified another factor that distinguishes authoring of post-WIMP user interfaces: many post-WIMP interface elements (e.g. gestures, speech input) have no graphical representation in the user interface and therefore make it more difficult to graphically represent them in authoring tools. In addition, authors may not understand from visually inspecting the user interface which interactions are implemented and how they work together. As a consequence, existing tools for GUI development may not be well suited for post-WIMP. Dedicated authoring tools are necessary to create these types of user interfaces efficiently, to ensure high quality, to facilitate meaningful inspection and tests, to enable authors to contribute their expertise to the development and to reduce overhead due to several authors having to cooperate in the development. This paper presents an authoring process and an authoring tool for post-WIMP user interfaces that take the pe...

Authoring With Virtual Reality Nuggets—Lessons Learned

“…With a view to VR and its authoring, even decades after the first VR research, VR authoring and content creation still involve challenges (Green and Jacob, 1991;Billinghurst et al, 1997;Steed, 2008;Barbosa Dias et al, 2010;Wingrave and LaViola, 2010;Gerken et al, 2013;Dörner et al, 2014;Dörner et al, 2015;Ashtari et al, 2020). Current examples are early prototyping and testing of VR applications, the translation of design guidelines to VR, and the lack of concrete design guidelines Ashtari et al (2020).…”

Content Creation and Authoring Challenges for Virtual Environments: From User Interfaces to Autonomous Virtual Characters

“…The specific requirements of different authoring roles and the need for supporting collaboration between authors are sometimes not addressed at all. CLAY (Cross Layer Authoring Tool) [21] explicitly acknowledges that there are different author roles. It distinguishes several layers where each layer represents the work space of one author role.…”

“…4. Screenshot of the CLAY authoring tool [21] ment back and forth as the slider to switch between layers can be moved in two directions. This is more suitable for user-centered design, where results of an evaluation (e.g.…”

Interacción Tangible en escenarios educativos

“…Desde sus inicios, la generación de aplicaciones basadas en IT se ha visto fuertemente ligada a especialistas informáticos. Sin embargo, la creación de este tipo de aplicaciones, requiere de la colaboración de diferentes profesionales con conocimientos expertos en dominios específicos, además de las habilidades de ingeniería e informática propias del desarrollo de sistemas (Gerken, Frechenhäuser, Dörner, y Luderschmidt, 2013). Cuando los expertos en alguna disciplina desean implementar una aplicación basada en IT específica para mediar contenidos o tareas de su dominio suelen interactuar con profesionales del ámbito de la Informática.…”