Impact of ML in Evolution of Recommender Systems: A Review
Keywords:
Machine Learning (ML), Recurrent Neural Networks (RNNs), Alternating Least Squares (ALS), Singular Value Decomposition (SVD), recommender systems, social mediaAbstract
Recommender systems have become indispensable tools in today's digital era, catering to the overwhelming demand for personalized recommendations in various domains such as e-commerce, content streaming, and social media. The continuous growth of data and user interactions has necessitated the integration of advanced machine learning (ML) techniques to enhance the accuracy and efficiency of these systems. This study provides a thorough analysis of current developments in machine learning methods used in recommender systems. The paper starts by providing an overview of traditional collaborative filtering methods, content-based filtering, and hybrid approaches, highlighting their limitations in handling the challenges posed by sparse data, cold start problem, and scalability issues. It then delves into how modern ML techniques, such as deep learning, matrix factorization, and ensemble methods, have emerged as powerful solutions to address these challenges. Incorporating deep learning architectures, such as neural networks and recurrent neural networks (RNNs), into recommender systems has shown remarkable success in capturing complex patterns in user-item interactions. Additionally, the scalability and interpretability of recommender systems have been enhanced by the incorporation of matrix factorization techniques like Singular Value Decomposition (SVD) and Alternating Least Squares (ALS). Furthermore, the paper explores the application of reinforcement learning for sequential recommendation tasks, enabling systems to learn optimal recommendation policies over time. Reinforcement learning has proven effective in scenarios where user preferences dynamically evolve, such as in news article recommendation and sequential product recommendation. Ensemble methods, which combine multiple individual recommenders, have demonstrated superior performance by leveraging the diverse strengths of different algorithms. The paper presents various ensemble techniques, including stacking, blending, and weighted models, showcasing their ability to achieve state-of-the-art results in accuracy and robustness.
References
He X, Liao L, Zhang H, Nie L, Hu X, Chua TS. Neural collaborative filtering. In Proceedings of the 26th international conference on world wide web 2017 Apr 3 (pp. 173–182).
Zhang W, Du T, Wang J. Deep Learning over Multi-field Categorical Data: –A Case Study on User Response Prediction. In Advances in Information Retrieval: 38th European Conference on IR Research, ECIR 2016, Padua, Italy, March 20–23, 2016. Proceedings 38 2016 (pp. 45–57). Springer International Publishing.
Covington P, Adams J, Sargin E. Deep neural networks for youtube recommendations. In Proceedings of the 10th ACM conference on recommender systems 2016 Sep 7 (pp. 191–198).
Wang R, Fu B, Fu G, Wang M. Deep & cross network for ad click predictions. In Proceedings of the ADKDD'17 2017 Aug 14 (pp. 1–7).
Hidasi B, Karatzoglou A, Baltrunas L, Tikk D. Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939. 2015 Nov 21.
Velankar M, Kulkarni P. Music recommendation systems: overview and challenges. Advances in Speech and Music Technology: Computational Aspects and Applications. 2022 Sep 23: 51–69.
Cao Z, Qin T, Liu TY, Tsai MF, Li H. Learning to rank: from pairwise approach to listwise approach. In Proceedings of the 24th international conference on Machine learning 2007 Jun 20 (pp. 129–136).
Singh RK, Mishra M, Singhal R. Scalable High-Performance Architecture for Evolving Recommender System. In Proceedings of the 3rd Workshop on Machine Learning and Systems 2023 May 8 (pp. 154–162).
Wang S, Hu L, Wang Y, Cao L, Sheng QZ, Orgun M. Sequential recommender systems: challenges, progress and prospects. arXiv preprint arXiv:2001.04830. 2019 Dec 28.
Zhang S, Yao L, Sun A, Tay Y. Deep learning based recommender system: A survey and new perspectives. ACM computing surveys (CSUR). 2019 Feb 25; 52(1): 1–38.