SYSTEM APPROACH TO MULTICRITERIA EVALUATION OF SESSION-BASED AND SEQUENTIAL RECOMMENDATION SYSTEMS

Authors

  • Nadezhda Nedashkovskaya Educational and Research Institute for Applied System Analysis of the National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute", Kyiv, Ukraine, Department of mathematical methods of system analysis, Ukraine http://orcid.org/0000-0002-8277-3095
  • Dmytro Androsov Educational and Research Institute for Applied System Analysis of the National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute", Kyiv, , Ukraine https://orcid.org/0009-0001-1330-1473

DOI:

https://doi.org/10.20535/kpisn.2025.4.343329

Keywords:

sequential recommendation, session-based recommendation, temporal modeling, attention mechanisms, graph neural networks, state-space models, deep learning, system analysis, decision making

Abstract

Background. Recommendation systems have become indispensable components of modern digital platforms, enabling personalized content delivery across diverse domains. Traditional collaborative filtering and content-based approaches often fail to capture temporal dynamics and contextual dependencies inherent in user behavior patterns. Sequential recommendation systems (SRSs) and session-based recommendation systems (SBRSs) have emerged as new paradigms to capture users' short-term but dynamic preferences for enabling more timely and accurate recommendations.

Objective. To propose a system approach for multicriteria evaluation of various SRS and SBRS models – a unified framework for understanding these models, selecting the best recommendation model, and guiding future research directions in temporal-aware recommendation systems. To provide a systematic overview and comprehensive analysis of session-based and sequential recommendation systems, to examine their theoretical foundations, evolution, empirical performance characteristics, and practical deployment considerations.

Methods. A comprehensive analysis of foundational approaches from Markov chain models to modern neural architectures including attention-based methods, graph neural networks, and state-space models is conducted. The approaches are systematically categorized based on architectural principles, temporal modeling strategies, and knowledge integration methods. The Analytic Hierarchy Process is applied for calculation of relative importance of benefits, costs, opportunities and risks in a problem of session-based and sequential recommendation systems synthesis. An experimental study of various SRS and SBRS models was performed on benchmark datasets.

Results. Empirical studies on temporal benchmark datasets show that combining SASRec and ReCODE improves the Recall@K metric by 9% over the baseline SASRec model, and combining GRU4Rec with ReCODE improves the metric by 17% over the baseline GRU4Rec. The SASRec model, which adapts transformer architectures to the sequential recommendation problem, achieved the highest baseline performance in terms of Recall@K and NDCG@K criteria on benchmark datasets compared to the other examined models, demonstrating the effectiveness of self-attention mechanisms for sequence modeling. ReCODE is a model-independent neural ordinary differential equation framework for recommender systems and an effective framework for studying consumer demand dynamics, has improved the metrics of existing baseline approaches, and has acceptable computational complexity for practical recommender system deployment scenarios.

Conclusions. Session-based and sequential recommendation systems have evolved through several paradigmatic shifts with significant scientific achievements including establishment of session-based recommendation model as distinct from traditional collaborative filtering, development of attention mechanisms for sequence modeling, and introduction of continuous-time formulations. Future research directions include unified architectures, scalability solutions, improved evaluation methodologies, and extensions to multi-stakeholder scenarios.

References

F. Ricci, L. Rokach, and B. Shapira, "Introduction to recommender systems handbook," in Recommender Systems Handbook, New York, NY, USA: Springer, 2011, pp. 1-35. Retrieved from doi: 10.1007/978-0-387-85820-3_1.

J. Lu, D. Wu, M. Mao, W. Wang, and G. Zhang, "Recommender system application developments: a survey," Decision Support Systems, vol. 74, pp. 12-32, 2015. Retrieved from doi: 10.1016/j.dss.2015.03.008.

S. Zhang, L. Yao, A. Sun, and Y. Tay, "Deep learning based recommender system: A survey and new perspectives," ACM Computing Surveys, vol. 52, no. 1, pp. 1-38, 2019. Retrieved from doi: 10.1145/3285029.

Y. Koren, "Collaborative filtering with temporal dynamics," in Proc. 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Paris, France, 2009, pp. 447-456. Retrieved from doi: 10.1145/1557019.1557072.

Y. Ding and X. Li, "Time weight collaborative filtering," in Proc. 14th ACM International Conference on Information and Knowledge Management, Bremen, Germany, 2005, pp. 485-492. Retrieved from doi: 10.1145/1099554.1099689.

S. Rendle, C. Freudenthaler, and L. Schmidt-Thieme, "Factorizing personalized markov chains for next-basket recommendation," in Proc. 19th International Conference on World Wide Web, Raleigh, NC, USA, 2010, pp. 811-820. Retrieved from doi: 10.1145/1772690.1772773.

R. He and J. McAuley, "Fusing similarity models with markov chains for sparse sequential recommendation," in Proc. IEEE 16th International Conference on Data Mining, Barcelona, Spain, 2016, pp. 191-200. Retrieved from doi: 10.1109/ICDM.2016.0030.

S. Wang, Q. Zhang, L. Hu, X. Zhang, Y. Wang, and C. Aggarwal, "Sequential/session-based recommendations: Challenges, approaches, applications and opportunities," in Proc. 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, 2022, pp. 3425-3428. Retrieved from doi: 10.1145/3477495.3532685.

S. Wang, L. Cao, Y. Wang, Q. Z. Sheng, M. A. Orgun, and D. Lian, "A survey on session-based recommender systems," ACM Computing Surveys, vol. 54, no. 7, pp. 1-38, 2022. Retrieved from doi: 10.1145/3465401.

A. Zimdars, D. M. Chickering, and C. Meek, "Using temporal data for making recommendations," in Proc. 17th Conference on Uncertainty in Artificial Intelligence, Seattle, WA, USA, 2001, pp. 580-588.

B. Hidasi, A. Karatzoglou, L. Baltrunas, and D. Tikk, "Session-based recommendations with recurrent neural networks," in Proc. 4th International Conference on Learning Representations, San Juan, Puerto Rico, 2016. Retrieved from arXiv: 1511.06939.

W.C. Kang and J. McAuley, "Self-attentive sequential recommendation," in Proc. IEEE International Conference on Data Mining, Singapore, 2018, pp. 197-206. Retrieved from doi: 10.1109/ICDM.2018.00035.

F. Sun, J. Liu, J. Wu, C. Pei, X. Lin, W. Ou, and P. Jiang, "BERT4Rec: Sequential recommendation with bidirectional encoder representations from transformer," in Proc. 28th ACM International Conference on Information and Knowledge Management, Beijing, China, 2019, pp. 1441-1450. Retrieved from doi: 10.1145/3357384.3357895.

S. Wu, Y. Tang, Y. Zhu, L. Wang, X. Xie, and T. Tan, "Session-based recommendation with graph neural networks," in Proc. AAAI Conference on Artificial Intelligence, Honolulu, HI, USA, 2019, vol. 33, pp. 346-353. Retrieved from doi: 10.1609/aaai.v33i01.3301346.

X. Wang, X. He, Y. Cao, M. Liu, and T. S. Chua, "KGAT: Knowledge graph attention network for recommendation," in Proc. 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Anchorage, AK, USA, 2019, pp. 950-958. Retrieved from doi: 10.1145/3292500.3330989.

R. T. Q. Chen, Y. Rubanova, J. Bettencourt, and D. Duvenaud, "Neural ordinary differential equations," in Advances in Neural Information Processing Systems 31, Montréal, Canada, 2018, pp. 6571-6583. Retrieved from arXiv: 1806.07366.

S. Dai, C. Qu, S. Chen, X. Zhang, and J. Xu, "ReCODE: Modeling repeat consumption with neural ODE," in Proc. 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, Washington, DC, USA, 2024, pp. 1742-1752. Retrieved from doi: 10.1145/3626772.3657936.

M. Ludewig and D. Jannach, "Are we really making much progress? A worrying analysis of recent neural recommendation approaches," in Proc. 12th ACM Conference on Recommender Systems, Vancouver, BC, Canada, 2018, pp. 101-109. Retrieved from doi: 10.1145/3298689.3347058.

N.I. Nedashkovskaya, "Method for weights calculation based on interval multiplicative pairwise comparison matrix in decision-making models," Radio Electronics, Computer Science, Control, no. 3, pp. 155-167, 2022. Retrieved from doi: 10.15588/1607-3274-2022-3-15.

N.I. Nedashkovskaya, "Investigation of methods for improving consistency of a pairwise comparison matrix," Journal of the Operational Research Society, vol.69, no.12, pp. 1947-1956, 2018. Retrieved from doi: 10.1080/01605682.2017.1415640.

Music Technology Group, "LastFM Music Recommendation Dataset," Zenodo Repository, 2022. Retrieved from doi: 10.5281/zenodo.6090214

University of Innsbruck, "#nowplaying Dataset," Zenodo Repository, 2020. Available: https://zenodo.org/records/2594483.

Downloads

Published

2025-12-29