Remembering through lifelogging: A survey of human memory augmentation

Abstract

Human memory is unquestionably a vital cognitive ability but one that can often be unreliable. External memory aids such as diaries, photos, alarms and calendars are often employed to assist in remembering important events in our past and future. The recent trend for lifelogging, continuously documenting ones life through wearable sensors and cameras, presents a clear opportunity to augment human memory beyond simple reminders and actually improve its capacity to remember. This article surveys work from the fields of computer science and psychology to understand the potential for such augmentation, the technologies necessary for realising this opportunity and to investigate what the possible benefits and ethical pitfalls of using such technology might be.

Neurocognitive mechanisms of real‐world autobiographical memory retrieval: insights from studies using wearable camera technology

“…However, legal issues and privacy concerns pertaining to the surreptitious recording of conversations may ultimately limit the viability of audio and audiovisual life‐logging technology. Future research efforts should remain mindful of such user‐experience considerations …”

“…Future research efforts should remain mindful of such user-experience considerations. 87,88 Since the literature regarding camera-based investigations of autobiographical memory retrieval is still nascent, the field is ripe with underexplored research questions that could be approached with this technology. For instance, it could be informative to deploy wearable cameras to examine how people's memories may be affected through social interactions with other individuals, including the effects of photo sharing (e.g., through social media applications) on memory accuracy and retention.…”

Image Aesthetics and Content in Selecting Memorable Keyframes from Lifelogs

“…Harvey et al [8] have argued that the increasing interest in and development of lifelogging does present clear possibilities for using technology, specifically technology which generates lifelogs, to augment human memory beyond what is currently done, which is mostly just about reminders and prompts. Their work does note the ethical concerns and dangers with doing this and that we should be aware of moving beyond prompts and reminders and into augmentation.…”

Memory Recall Support System Based on Active Acquisition and Accumulation of Memory Fragments

“…There have also been various investigations on recall support using lifelogs and files [7,8]. Forget-me-not [9] supports the personal memory recall of users by dedicated compact wireless communication equipment, using the information of people in the same room, such as email exchange history, telephone, related files, and so on.…”