IAI MovieBot

Habib, Javeria; Zhang, Shuo; Balog, Krisztian

doi:10.1145/3340531.3417433

Cited by 12 publications

(3 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Regarding the implementation of our user simulators and CIA agents, we want to use standard libraries and frameworks like DialogueKit and UserSim-CRS [1] in order to ensure their reusability and extendability. For the experiments, we plan to use existing research platforms and benchmarks, such as IAI MovieBot [9] for CRS and TREC CAsT 1 for CSS, whenever possible.…”

Section: Methodsmentioning

confidence: 99%

Leveraging User Simulation to Develop and Evaluate Conversational Information Access Agents

Bernard

2024

Proceedings of the 17th ACM International Conference on Web Search and Data Mining

View full text Add to dashboard Cite

We observe a change in the way users access information, that is, the rise of conversational information access (CIA) agents. However, the automatic evaluation of these agents remains an open challenge. Moreover, the training of CIA agents is cumbersome as it mostly relies on conversational corpora, expert knowledge, and reinforcement learning. User simulation has been identified as a promising solution to tackle automatic evaluation and has been previously used in reinforcement learning. In this research, we investigate how user simulation can be leveraged in the context of CIA. We organize the work in three parts. We begin with the identification of requirements for user simulators for training and evaluating CIA agents and compare existing types of simulator regarding these. Then, we plan to combine these different types of simulators into a new hybrid simulator. Finally, we aim to extend simulators to handle more complex information seeking scenarios. CCS CONCEPTS• Information systems → Users and interactive retrieval; • Computing methodologies → Modeling and simulation.

show abstract

Section: Methodsmentioning

confidence: 99%

Leveraging User Simulation to Develop and Evaluate Conversational Information Access Agents

Bernard

2024

Proceedings of the 17th ACM International Conference on Web Search and Data Mining

View full text Add to dashboard Cite

show abstract

“…IAI MovieBot [7] is an open source CRS that aims to provide movie recommendations via multi-turn conversations. Its architecture consists of four main components (see Fig.…”

Section: The Existing Iai Moviebotmentioning

confidence: 99%

“…IAI MovieBot [7] is an open-source CRS built on a modular architecture that provides movie recommendations. It has been used to perform research on user utterance reformulation [17] and evaluation of CRSs via user simulation [1].…”

Section: Introductionmentioning

confidence: 99%

IAI MovieBot 2.0: An Enhanced Research Platform with Trainable Neural Components and Transparent User Modeling

Bernard,

Kostric,

Balog

2024

Proceedings of the 17th ACM International Conference on Web Search and Data Mining

Self Cite

View full text Add to dashboard Cite

While interest in conversational recommender systems has been on the rise, operational systems suitable for serving as research platforms for comprehensive studies are currently lacking. This paper introduces an enhanced version of the IAI MovieBot conversational movie recommender system, aiming to evolve it into a robust and adaptable platform for conducting user-facing experiments. The key highlights of this enhancement include the addition of trainable neural components for natural language understanding and dialogue policy, transparent and explainable modeling of user preferences, along with improvements in the user interface and research infrastructure. CCS CONCEPTS• Information systems → Recommender systems.

show abstract

Recommender Systems: A Review

LeBlanc,

Banks,

et al. 2024

Journal of the American Statistical Association

View full text Add to dashboard Cite

IAI MovieBot

Cited by 12 publications

References 9 publications

Leveraging User Simulation to Develop and Evaluate Conversational Information Access Agents

Leveraging User Simulation to Develop and Evaluate Conversational Information Access Agents

IAI MovieBot 2.0: An Enhanced Research Platform with Trainable Neural Components and Transparent User Modeling

Recommender Systems: A Review

Contact Info

Product

Resources

About