AI-Driven Smart Production

• Published in: SMPTE motion imaging journal Vol. 129; no. 2; pp. 27 - 35
• Main Authors: Kaneko, Hiroyuki, Goto, Jun, Kawai, Yoshihiko, Mochizuki, Takahiro, Sato, Shoei, Imai, Atsushi, Yamanouchi, Yuko
• Format: Magazine Article
• Language: English
• Published: SMPTE 01-03-2020
• Subjects: Artificial intelligence (AI); audio description; big data analysis; deep neural network (DNN); image analysis; program production; sign language animation; speech recognition; universal service
• ISSN: 1545-0279; 2160-2492
• DOI: 10.5594/JMI.2019.2959173

Nippon Hoso Kyokai (NHK, Japan Broadcasting Corporation), has developed a new artificial intelligence (AI)-driven broadcasting technology called "Smart Production" designed to quickly and accurately gather and analyze diverse types of social information and deliver information to a wide range of viewers. Smart Production uses AI to analyze information obtained from social media and open data as well as the know-how related to program production possessed by broadcast stations. This approach makes it possible to extract events and incidents in society and present the results of the analysis to producers. In particular, image analysis technology for recognizing objects in video and speech recognition technology for generating transcripts of interviews enable metadata to be automatically generated for video footage. Additionally, research and development are progressing on technology for automatically converting broadcast data into content that can be easily understood by viewers with special needs.