An Interactive Cooking Support System for Short Recipe Videos based on User Browsing Behavior

• Published in: 2021 IEEE 4th International Conference on Multimedia Information Processing and Retrieval (MIPR) pp. 21 - 27
• Main Authors: Yonezawa, Takuya, Wang, Yuanyuan, Kawai, Yukiko, Sumiya, Kazutoshi
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01-09-2021
• Subjects: Conferences; cooking recipes; cooking videos; Data mining; Information processing; Streaming media; supplementary information; Tag clouds; user browsing behavior; User interfaces; Visualization
• DOI: 10.1109/MIPR51284.2021.00011

Recently, short recipe videos such as Kurashiru and DELISH KITCHEN have become popular. These short recipe videos can help people learn many cooking skills in a brief time. However, it is difficult for users to understand all cooking operations by viewing these videos only once. These short recipe videos do not consider users' cooking skills (cooking levels) since anyone may view the same video. Therefore, in this work, we propose an interactive cooking support system for short recipe videos by extracting and weighting cooking operations for each cooking genre based on user browsing behavior. The system then recommends various supplementary recipe videos based on the weights of cooking operations and user browsing behavior. Also, the system provides a user interface, called Dynamic Video Tag Cloud for visualizing the supplementary recipe videos, and the supplementary recipe videos can be dynamically changed based on the user browsing behavior. As a result, users can intuitively and easily understand cooking operations suited to their cooking favorites. Finally, we verified the effectiveness of the weighting of cooking operations and discussed the usefulness of our proposed user interface using the SUS score.