Making recommendations using transfer learning

• Published in: Neural computing & applications Vol. 33; no. 15; pp. 9663 - 9676
• Main Author: Fang, Xing
• Format: Journal Article
• Language: English
• Published: London Springer London 01-08-2021; Springer Nature B.V
• Subjects: Algorithms; Artificial Intelligence; Computational Biology/Bioinformatics; Computational Science and Engineering; Computer Science; Data Mining and Knowledge Discovery; Deep learning; Image Processing and Computer Vision; Machine learning; Natural language processing; Original Article; Probability and Statistics in Computer Science; Process parameters; Recommender systems; Deep learning; Transfer learning; Recommender system; User vector embedding
• ISSN: 0941-0643; 1433-3058
• DOI: 10.1007/s00521-021-05730-3

Deep learning-based recommender systems have gained much attention due to the advantage of encoding content-based information, such as user textual reviews and item descriptions, images, or videos, without the trouble of manually crafting feature vectors. However, those systems are trained from scratch with randomly initialized parameters, where the training process can take a long time to converge. With the most recent breakthroughs in Natural Language Processing using transfer learning, pre-trained transformer-based models now provide a better foundation for textual information encoding. This inspires us to propose a transformer-based recommender system using transfer learning. As the first core contribution in this work, we apply transfer learning to the system, by fine-tuning the pre-trained transformer models for information encoding. The experiment result shows that the proposed system outperforms several other deep learning-based recommender systems on multiple datasets. As the second core contribution, we propose a novel user vector encoding algorithm that assists all the models to achieve a better performance, when the user content information is not available.