Recognition of Human Chef’s Intentions for Incremental Learning of Cookbook by Robotic Salad Chef

Abstract

Robotic chefs are a promising technology that can bring sizeable health and economic benefits when deployed ubiquitously. This deployment is hindered by the costly process of programming the robots to cook specific dishes while humans learn from observation or freely available videos. In this paper, we propose an algorithm that incrementally adds recipes to the robot's cookbook based on the visual observation of a human chef, enabling the easier and cheaper deployment of robotic chefs. A new recipe is added only if the current observation is substantially different than all recipes in the cookbook, which is decided by computing the similarity between the vectorizations of these two. The algorithm correctly recognizes known recipes in 93% of the demonstrations and successfully learned new recipes when shown, using off-the-shelf neural networks for computer vision. We show that videos and demonstrations are viable sources of data for robotic chef programming when extended to massive publicly available data sources like YouTube. INDEX TERMSComputer vision, hidden Markov model, learning by demonstration, robotic chef, salad chef.

Improving the practical skills of STEM students at a historically black college and university (HBCU)

“…Sensor technology can be utilized with robotic systems to manage pests and diseases that affect crops. Robotic chefs (Sochacki et al, 2023) can also be used to prepare and cook hundreds of meals in a home kitchen. This robotic chef can be controlled via a smartphone, and once the controller chooses a recipe and arranges pre-packaged containers of cut and prepared ingredients, the robot will be able to cook the predetermined meal quickly and efficiently.…”

İkinci Ev Turizmi: Kırsal İçin Bir Risk mi Yoksa Kırsal Kalkınma İçin Fırsat mı?

“…Yapay zekanın robotik şef ve asistanlara güç sağlamak için kullanılması, hem sağlık hem de ekonomi açısından mutfağa önemli faydalar sağlama potansiyeline sahiptir. Son teknolojik atılımlar, insan şeflerin görsel gözlemlerine dayanarak robotun yemek kitabına tariflerin kademeli olarak eklenmesini destekleyen algoritmaların geliştirilmesine yol açmıştır (Sochacki et al, 2023) Ortamla etkileşim için robotik tutamaklar, manipülatör eller ve son çalışma elemanlarını içeren entegre robotik mutfak sistemleri de geliştirilmiştir. Sensörlerden toplanan verilere dayalı tariflerin yeniden üretimi, bu sistemler tarafından bilgisayar tarafından yürütülebilir sıralı robotize tarif komut dosyaları kullanılarak gerçekleştirilmektedir.…”