Jeni, Dimitris, Jesper and Mikael have had a full paper accepted for CHI 2017. The paper is the result of the work of two of Jeni’s Master students, Eric and Bjarke, who investigated the use of four different cross-device interaction techniques in the lab in the spring of 2016.
Paay J, Raptis D., Kjeldskov J., Skov M.B., Lauridsen B.M., and Ruder E.V. (2017) Investigating Cross-Device Interaction between a Handheld Device and a Large Display. Proceedings of ACM CHI 2017 Conference on Human Factors in Computing Systems. Denver, CO, USA, 6-11 May 2017. ACM Press.
A video of the techniques is available here: https://youtu.be/MMK3w_0Lmyk
Abstract. There is a growing interest in HCI research to explore cross-device interaction, giving rise to an interest in different approaches facilitating interaction between handheld devices and large displays. Contributing to this, we have investigated the use of four existing approaches combining touch and mid-air gestures, pinching, swiping, swinging and flicking. We look specifically at their relative efficiency, effectiveness and accuracy in bi-directional interaction between a smartphone and large display in a point-click context. We report findings from two user studies, which show that swiping is both most effective, fastest and most accurate, closely followed by swinging. What these two approaches have in common is the ability to keep the pointer steady on the large display, unaffected by concurrent gestures or body movements used to complete the interaction, suggesting that this is an important factor for designing effective cross-device interaction with large displays.