Exquisitor at the Lifelog Search Challenge 2020

Khan, Omar Shahbaz; Larsen, Mathias Dybkjær; Poulsen, Liam Alex Sonto; Jónsson, Björn Þór; Zahálka, Jan; Rudinac, Stevan; Koelma, D.C.; Worring, Marcel

doi:10.1145/3379172.3391718

Cited by 19 publications

(10 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Several video retrieval systems [18] [17] [15] which did well in the VBS challenge have also participated in previous LSC events (2018,2019,2020) with some modifications/improvements to their original system. The Exquisitor system [16] used relevance feedback to build a model of the user's information needs without using any explicit query mechanism, while SOMHunter [20] and THUIR [19] employed user feedback to iteratively refine the retrieved results. MySceal [24] proposed a temporal query mechanism that allowed to search for up to 3 consecutive events simultaneously and also introduced a concept weighing methodology to determine the importance of visual annotations in the data.…”

Section: Related Workmentioning

confidence: 99%

Memento: A Prototype Lifelog Search Engine for LSC'21

Alam

Graham

Gurrin

2021

Proceedings of the 4th Annual on Lifelog Search Challenge

View full text Add to dashboard Cite

In this paper, we introduce a new lifelog retrieval system called Memento that leverages semantic representations of images and textual queries projected into a common latent space to facilitate effective retrieval. It bridges the semantic gap between complex visual scenes/events and user information needs expressed as textual and faceted queries. The system, developed for the 2021 Lifelog Search Challenge, also has a minimalist user interface that includes primary search, temporal search, and visual data filtering components. CCS CONCEPTS• Information systems → Information retrieval; Search interfaces; Retrieval models and ranking.

show abstract

Section: Related Workmentioning

confidence: 99%

Memento: A Prototype Lifelog Search Engine for LSC'21

Alam

Graham

Gurrin

2021

Proceedings of the 4th Annual on Lifelog Search Challenge

View full text Add to dashboard Cite

show abstract

“…The interesting function of Exquisitor [14] is the capability to use relevance feedback, including positive and negative examples, to learn the needs from users and to refine the results. We inherit this function in our system for query expansion.…”

Section: Related Workmentioning

confidence: 99%

Flexible Interactive Retrieval SysTem 2.0 for Visual Lifelog Exploration at LSC 2021

Trang-Trung

Tran

et al. 2021

Proceedings of the 4th Annual on Lifelog Search Challenge

View full text Add to dashboard Cite

With a huge collection of photos and video clips, it is essential to provide an efficient and easy-to-use system for users to retrieve moments of interest with a wide variation of query types. This motivates us to develop and upgrade our flexible interactive retrieval system for visual lifelog exploration. In this paper, we briefly introduce version 2 of our system with the following main features. Our system supports multiple modalities for interaction and query processing, including visual query by meta-data, text query and visual information matching based on a joint embedding model, scene clustering based on visual and location information, flexible temporal event navigation, and query expansion with visual examples. With the flexibility in system architecture, we expect our system can easily integrate new modules to enhance its functionalities. CCS CONCEPTS• Information systems → Search interfaces; Multimedia databases; • Human-centered computing → Interactive systems and tools.

show abstract

“…A majority of them are query-based systems [12,13,16], while others have originated from video retrieval systems [7,11,14]. Some systems have utilised user relevance feedback, both as the main retrieval mechanism [10] and to refine the presentation of query results [14]. Most systems have used traditional interfaces, with many of them utilising a two-dimensional, grid-like view to visualise search results.…”

Section: Introductionmentioning

confidence: 99%

PhotoCube at the Lifelog Search Challenge 2021

Shin

Waldau

Duane

et al. 2021

Proceedings of the 4th Annual on Lifelog Search Challenge

Self Cite

View full text Add to dashboard Cite

The Lifelog Search Challenge (LSC) is a venue where retrieval system researchers compete in solving tasks to retrieve the correct image from a lifelog collection. At LSC 2021, we introduce the PhotoCube system as a new competitor. PhotoCube is an interactive media retrieval system that considers media items to exist in a hypercube in multidimensional metadata space. To solve tasks, users explore the contents of the hypercube by dynamically (a) applying a variety of filters and (b) projecting the hypercube to a three-dimensional cube that is visualised on screen. CCS CONCEPTS• Information systems → Users and interactive retrieval; Multimedia databases.

show abstract

Exquisitor at the Lifelog Search Challenge 2020

Abstract: You will be contacted as soon as possible.

Cited by 19 publications

References 13 publications

Memento: A Prototype Lifelog Search Engine for LSC'21

Memento: A Prototype Lifelog Search Engine for LSC'21

Flexible Interactive Retrieval SysTem 2.0 for Visual Lifelog Exploration at LSC 2021

PhotoCube at the Lifelog Search Challenge 2021

Contact Info

Product

Resources

About