FurChat: An Embodied Conversational Agent using LLMs, Combining Open and Closed-Domain Dialogue with Facial Expressions

Cherakara, Neeraj; Varghese, Finny; Shabana, Sheena; Nelson, Nivan; Karukayil, Abhiram; Kulothungan, Rohith; Afil Farhan, Mohammed; Nesset, Birthe; Moujahid, Meriam; Dinkar, Tanvi; Rieser, Verena; Lemon, Oliver

doi:10.18653/v1/2023.sigdial-1.55

Cited by 7 publications

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

A survey on integration of large language models with intelligent robots

Kim,

Choi

et al. 2024

Intel Serv Robotics

View full text Add to dashboard Cite

In recent years, the integration of large language models (LLMs) has revolutionized the field of robotics, enabling robots to communicate, understand, and reason with human-like proficiency. This paper explores the multifaceted impact of LLMs on robotics, addressing key challenges and opportunities for leveraging these models across various domains. By categorizing and analyzing LLM applications within core robotics elements—communication, perception, planning, and control—we aim to provide actionable insights for researchers seeking to integrate LLMs into their robotic systems. Our investigation focuses on LLMs developed post-GPT-3.5, primarily in text-based modalities while also considering multimodal approaches for perception and control. We offer comprehensive guidelines and examples for prompt engineering, facilitating beginners’ access to LLM-based robotics solutions. Through tutorial-level examples and structured prompt construction, we illustrate how LLM-guided enhancements can be seamlessly integrated into robotics applications. This survey serves as a roadmap for researchers navigating the evolving landscape of LLM-driven robotics, offering a comprehensive overview and practical guidance for harnessing the power of language models in robotics development.

show abstract