Magnetips: Combining Fingertip Tracking and Haptic Feedback for Around-Device Interaction

Magnetips: Combining Fingertip Tracking and Haptic Feedback for Around-Device Interaction
Jess McIntosh, Paul Strohmeier, Jarrod Knibbe, Sebastian Boring, Kasper Hornbæk

CHI '19: ACM CHI Conference on Human Factors in Computing Systems
Session: Vibrotactile Feedback

Abstract
Around-device interaction methods expand the available interaction space for mobile devices; however, there is currently no way to simultaneously track a user's input and provide haptic feedback at the tracked point away from the device. We present Magnetips, a simple, mobile solution for around-device tracking and mid-air haptic feedback. Magnetips combines magnetic tracking and electromagnetic feedback that works regardless of visual occlusion, through most common materials, and at a size that allows for integration with mobile devices. We demonstrate: (1) high-frequency around-device tracking and haptic feedback; (2) the accuracy and range of our tracking solution which corrects for the effects of geomagnetism, necessary for enabling mobile use; and (3) guidelines for maximising strength of haptic feedback, given a desired tracking frequency. We present technical and usability evaluations of our prototype, and demonstrate four example applications of its use.