Voxento: A Prototype Voice-controlled Interactive Search Engine for Lifelogs

Alateeq, Ahmed; Roantree, Mark; Gurrin, Cathal

doi:10.1145/3379172.3391728

Cited by 20 publications

(12 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A completely different approach in user interaction is taken by Voxento [1]. In Voxento, a user can create, delete and execute queries by speaking.…”

Section: Related Workmentioning

confidence: 99%

Interactive Multimodal Lifelog Retrieval with vitrivr at LSC 2021

Heller

Gasser

Parian-Scherb

et al. 2021

Proceedings of the 4th Annual on Lifelog Search Challenge

View full text Add to dashboard Cite

The Lifelog Search Challenge (LSC) is an annual benchmarking competition for interactive multimedia retrieval systems, where participating systems compete in finding events based on textual descriptions containing hints about structured, semi-structured, and/or unstructured data. In this paper, we present the multimedia retrieval system vitrivr, a long-time participant to LSC, with a focus on new functionality. Specifically, we introduce the image stabilisation module which is added prior to the feature extraction to reduce the image degradation caused by lifelogger movements, and discuss how geodata is used during query formulation, query execution, and result presentation. CCS CONCEPTS• Information systems → Search interfaces; Image search; Users and interactive retrieval; Multimedia databases; Information retrieval; • Human-centered computing → Interactive systems and tools.

show abstract

“…A completely different approach in user interaction is taken by Voxento [1]. In Voxento, a user can create, delete and execute queries by speaking.…”

Section: Related Workmentioning

confidence: 99%

Interactive Multimodal Lifelog Retrieval with vitrivr at LSC 2021

Heller

Gasser

Parian-Scherb

et al. 2021

Proceedings of the 4th Annual on Lifelog Search Challenge

View full text Add to dashboard Cite

show abstract

“…Both applications supported retrieval by implementing a drawing mechanism where users could sketch the general structure of an image need to be searched, and the result can be filtered by the textual annotation which is also the approach of the vitrivr system [16]. The DCU Voxento system [2] with its voice control feature counted the number of matching concepts between an inquiry and the semantic metadata of images as a ranking criterion. Similarly, the THUIR [22], Myscéal [37], and VRLE [7] system followed the document comparison idea in which the annotation of an image and a query are considered as textual documents.…”

Section: Related Workmentioning

confidence: 99%

Myscéal 2.0: A Revised Experimental Interactive Lifelog Retrieval System for LSC'21

Tran

Nguyen

Bình

et al. 2021

Proceedings of the 4th Annual on Lifelog Search Challenge

Self Cite

View full text Add to dashboard Cite

Building an interactive retrieval system for lifelogging contains many challenges due to massive multi-modal personal data besides the requirement of accuracy and rapid response for such a tool. The Lifelog Search Challenge (LSC) is the international lifelog retrieval competition that inspires researchers to develop their systems to cope with the challenges and evaluates the effectiveness of their solutions. In this paper, we upgrade our previous Myscéal and present Myscéal 2.0 system for the LSC'21 with the improved features inspired by the novice users experiments. The experiments show that a novice user achieved more than half of the expert score on average. To mitigate the gap of them, some potential enhancements were identified and integrated to the enhanced version. CCS CONCEPTS• Information systems → Information retrieval; • Humancentered computing → Human computer interaction (HCI); User interface design.

show abstract

“…Besides traditional ways to input query information, new methods for interaction have been developed to assist users, such as voice-controlled interactive search engine in Voxento [3] or natural interaction in virtual reality environment of VRLE system [7].…”

Section: Related Workmentioning

confidence: 99%

Flexible Interactive Retrieval SysTem 2.0 for Visual Lifelog Exploration at LSC 2021

Trang-Trung

Tran

et al. 2021

Proceedings of the 4th Annual on Lifelog Search Challenge

Self Cite

View full text Add to dashboard Cite

With a huge collection of photos and video clips, it is essential to provide an efficient and easy-to-use system for users to retrieve moments of interest with a wide variation of query types. This motivates us to develop and upgrade our flexible interactive retrieval system for visual lifelog exploration. In this paper, we briefly introduce version 2 of our system with the following main features. Our system supports multiple modalities for interaction and query processing, including visual query by meta-data, text query and visual information matching based on a joint embedding model, scene clustering based on visual and location information, flexible temporal event navigation, and query expansion with visual examples. With the flexibility in system architecture, we expect our system can easily integrate new modules to enhance its functionalities. CCS CONCEPTS• Information systems → Search interfaces; Multimedia databases; • Human-centered computing → Interactive systems and tools.

show abstract

Voxento: A Prototype Voice-controlled Interactive Search Engine for Lifelogs

Cited by 20 publications

References 15 publications

Interactive Multimodal Lifelog Retrieval with vitrivr at LSC 2021

Interactive Multimodal Lifelog Retrieval with vitrivr at LSC 2021

Myscéal 2.0: A Revised Experimental Interactive Lifelog Retrieval System for LSC'21

Flexible Interactive Retrieval SysTem 2.0 for Visual Lifelog Exploration at LSC 2021

Contact Info

Product

Resources

About