SYSTEM APPROACH TO MULTICRITERIA EVALUATION OF SESSION-BASED AND SEQUENTIAL RECOMMENDATION SYSTEMS
DOI:
https://doi.org/10.20535/kpisn.2025.4.343329Keywords:
sequential recommendation, session-based recommendation, temporal modeling, attention mechanisms, graph neural networks, state-space models, deep learning, system analysis, decision makingAbstract
Background. Recommendation systems have become indispensable components of modern digital platforms, enabling personalized content delivery across diverse domains. Traditional collaborative filtering and content-based approaches often fail to capture temporal dynamics and contextual dependencies inherent in user behavior patterns. Sequential recommendation systems (SRSs) and session-based recommendation systems (SBRSs) have emerged as new paradigms to capture users' short-term but dynamic preferences for enabling more timely and accurate recommendations.
Objective. To propose a system approach for multicriteria evaluation of various SRS and SBRS models – a unified framework for understanding these models, selecting the best recommendation model, and guiding future research directions in temporal-aware recommendation systems. To provide a systematic overview and comprehensive analysis of session-based and sequential recommendation systems, to examine their theoretical foundations, evolution, empirical performance characteristics, and practical deployment considerations.
Methods. A comprehensive analysis of foundational approaches from Markov chain models to modern neural architectures including attention-based methods, graph neural networks, and state-space models is conducted. The approaches are systematically categorized based on architectural principles, temporal modeling strategies, and knowledge integration methods. The Analytic Hierarchy Process is applied for calculation of relative importance of benefits, costs, opportunities and risks in a problem of session-based and sequential recommendation systems synthesis. An experimental study of various SRS and SBRS models was performed on benchmark datasets.
Results. Empirical studies on temporal benchmark datasets show that combining SASRec and ReCODE improves the Recall@K metric by 9% over the baseline SASRec model, and combining GRU4Rec with ReCODE improves the metric by 17% over the baseline GRU4Rec. The SASRec model, which adapts transformer architectures to the sequential recommendation problem, achieved the highest baseline performance in terms of Recall@K and NDCG@K criteria on benchmark datasets compared to the other examined models, demonstrating the effectiveness of self-attention mechanisms for sequence modeling. ReCODE is a model-independent neural ordinary differential equation framework for recommender systems and an effective framework for studying consumer demand dynamics, has improved the metrics of existing baseline approaches, and has acceptable computational complexity for practical recommender system deployment scenarios.
Conclusions. Session-based and sequential recommendation systems have evolved through several paradigmatic shifts with significant scientific achievements including establishment of session-based recommendation model as distinct from traditional collaborative filtering, development of attention mechanisms for sequence modeling, and introduction of continuous-time formulations. Future research directions include unified architectures, scalability solutions, improved evaluation methodologies, and extensions to multi-stakeholder scenarios.
References
F. Ricci, L. Rokach, and B. Shapira, "Introduction to recommender systems handbook," in Recommender Systems Handbook, New York, NY, USA: Springer, 2011, pp. 1-35. Retrieved from doi: 10.1007/978-0-387-85820-3_1.
J. Lu, D. Wu, M. Mao, W. Wang, and G. Zhang, "Recommender system application developments: a survey," Decision Support Systems, vol. 74, pp. 12-32, 2015. Retrieved from doi: 10.1016/j.dss.2015.03.008.
S. Zhang, L. Yao, A. Sun, and Y. Tay, "Deep learning based recommender system: A survey and new perspectives," ACM Computing Surveys, vol. 52, no. 1, pp. 1-38, 2019. Retrieved from doi: 10.1145/3285029.
Y. Koren, "Collaborative filtering with temporal dynamics," in Proc. 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Paris, France, 2009, pp. 447-456. Retrieved from doi: 10.1145/1557019.1557072.
Y. Ding and X. Li, "Time weight collaborative filtering," in Proc. 14th ACM International Conference on Information and Knowledge Management, Bremen, Germany, 2005, pp. 485-492. Retrieved from doi: 10.1145/1099554.1099689.
S. Rendle, C. Freudenthaler, and L. Schmidt-Thieme, "Factorizing personalized markov chains for next-basket recommendation," in Proc. 19th International Conference on World Wide Web, Raleigh, NC, USA, 2010, pp. 811-820. Retrieved from doi: 10.1145/1772690.1772773.
R. He and J. McAuley, "Fusing similarity models with markov chains for sparse sequential recommendation," in Proc. IEEE 16th International Conference on Data Mining, Barcelona, Spain, 2016, pp. 191-200. Retrieved from doi: 10.1109/ICDM.2016.0030.
S. Wang, Q. Zhang, L. Hu, X. Zhang, Y. Wang, and C. Aggarwal, "Sequential/session-based recommendations: Challenges, approaches, applications and opportunities," in Proc. 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, 2022, pp. 3425-3428. Retrieved from doi: 10.1145/3477495.3532685.
S. Wang, L. Cao, Y. Wang, Q. Z. Sheng, M. A. Orgun, and D. Lian, "A survey on session-based recommender systems," ACM Computing Surveys, vol. 54, no. 7, pp. 1-38, 2022. Retrieved from doi: 10.1145/3465401.
A. Zimdars, D. M. Chickering, and C. Meek, "Using temporal data for making recommendations," in Proc. 17th Conference on Uncertainty in Artificial Intelligence, Seattle, WA, USA, 2001, pp. 580-588.
B. Hidasi, A. Karatzoglou, L. Baltrunas, and D. Tikk, "Session-based recommendations with recurrent neural networks," in Proc. 4th International Conference on Learning Representations, San Juan, Puerto Rico, 2016. Retrieved from arXiv: 1511.06939.
W.C. Kang and J. McAuley, "Self-attentive sequential recommendation," in Proc. IEEE International Conference on Data Mining, Singapore, 2018, pp. 197-206. Retrieved from doi: 10.1109/ICDM.2018.00035.
F. Sun, J. Liu, J. Wu, C. Pei, X. Lin, W. Ou, and P. Jiang, "BERT4Rec: Sequential recommendation with bidirectional encoder representations from transformer," in Proc. 28th ACM International Conference on Information and Knowledge Management, Beijing, China, 2019, pp. 1441-1450. Retrieved from doi: 10.1145/3357384.3357895.
S. Wu, Y. Tang, Y. Zhu, L. Wang, X. Xie, and T. Tan, "Session-based recommendation with graph neural networks," in Proc. AAAI Conference on Artificial Intelligence, Honolulu, HI, USA, 2019, vol. 33, pp. 346-353. Retrieved from doi: 10.1609/aaai.v33i01.3301346.
X. Wang, X. He, Y. Cao, M. Liu, and T. S. Chua, "KGAT: Knowledge graph attention network for recommendation," in Proc. 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Anchorage, AK, USA, 2019, pp. 950-958. Retrieved from doi: 10.1145/3292500.3330989.
R. T. Q. Chen, Y. Rubanova, J. Bettencourt, and D. Duvenaud, "Neural ordinary differential equations," in Advances in Neural Information Processing Systems 31, Montréal, Canada, 2018, pp. 6571-6583. Retrieved from arXiv: 1806.07366.
S. Dai, C. Qu, S. Chen, X. Zhang, and J. Xu, "ReCODE: Modeling repeat consumption with neural ODE," in Proc. 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, Washington, DC, USA, 2024, pp. 1742-1752. Retrieved from doi: 10.1145/3626772.3657936.
M. Ludewig and D. Jannach, "Are we really making much progress? A worrying analysis of recent neural recommendation approaches," in Proc. 12th ACM Conference on Recommender Systems, Vancouver, BC, Canada, 2018, pp. 101-109. Retrieved from doi: 10.1145/3298689.3347058.
N.I. Nedashkovskaya, "Method for weights calculation based on interval multiplicative pairwise comparison matrix in decision-making models," Radio Electronics, Computer Science, Control, no. 3, pp. 155-167, 2022. Retrieved from doi: 10.15588/1607-3274-2022-3-15.
N.I. Nedashkovskaya, "Investigation of methods for improving consistency of a pairwise comparison matrix," Journal of the Operational Research Society, vol.69, no.12, pp. 1947-1956, 2018. Retrieved from doi: 10.1080/01605682.2017.1415640.
Music Technology Group, "LastFM Music Recommendation Dataset," Zenodo Repository, 2022. Retrieved from doi: 10.5281/zenodo.6090214
University of Innsbruck, "#nowplaying Dataset," Zenodo Repository, 2020. Available: https://zenodo.org/records/2594483.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Nadezhda Nedashkovskaya, Dmytro Androsov

This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under CC BY 4.0 that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work