Force-Responsive deformable user interfaces
Touch input is the universal approach for communicating intention to interactive computing systems. However, touchscreens are flat, solid surfaces that fail to reproduce the qualities of real-world object interaction (e.g. deformation, stiffness, springiness). Further, their expressivity is fundamentally bounded by a single measurable dimension: contact with a solid, touch-sensitive surface. This project will radically increase the expressivity of touchscreen-based interaction by co-locating three force modalities into a single visual display surface (force input, resistive- and kinetic- force feedback). This will create a new paradigm for Human-Computer Interaction (HCI): Force Responsive Deformable User Interfaces (FRUI). FRUIs will allow users to ‘push through’ a display and for the display to ‘push back’.

To achieve this ambitious goal, I will combine innovative hardware prototyping with experimental computer science and psychophysical study methodologies to complete four key research objectives: (1) Develop novel engineering approaches to construct FRUI; (2) Empirically characterise humans’ capabilities and responses during interaction with FRUI; (3) Construct conceptual models, metaphors, and principles for user interaction with FRUI; (4) Evaluate the expressivity, efficiency, and user satisfaction of FRUIs.

I am considered an international leader in the development of shape-changing interfaces (interfaces whose physical geometry adapts to underlying digital content), as evidenced through my strong research track record (including two recent agenda-setting papers at the premier HCI conference), international community leadership, and external grant success. This background ideally places me to conduct all aspects of this highly ambitious programme of work. FORCE-UI has the potential to revolutionise touch input, and in doing so will have a significant impact on society’s use of interactive systems.