Heartefacts

Jo Vermeulen
Lindsay MacDonald
Johannes Schöning
Russell Beale
Sheelagh Carpendale

Abstract

An increasing share of our daily interactions with others is mediated through mobile communication technologies. People communicate via text, emoticons, emojis and rich media such as video. We explore the design of Heartefacts, short video clips composed of highlights determined by heart rate changes while watching videos. Our survey investigated video sharing behaviour, and our feasibility study examined the possibility of detecting highlights in videos by monitoring people’s heart rates measured with off-the-shelf wrist-worn sensors. Our results show that people do indeed have measurable responses with respect to their heartbeat patterns to six different emotions elicited by video clips. We compare video highlights verbally identified by our participants to physiological highlights as indicated by their heart rate data and also discuss and compare the automatically generated Heartefacts with video highlights created by an expert in video art. Finally, we discuss design considerations when integrating Heartefacts in mobile technology.

Video Coming Soon!

Publications

Jo Vermeulen, Lindsay MacDonald, Johannes Schöning, Russell Beale, and Sheelagh Carpendale. Heartefacts: Augmenting Mobile Video Sharing Using Wrist-Worn Heart Rate Sensors. In Proceedings of the 2016 Conference on Designing Interactive Systems, 2016.