Personalized Recommendation Systems Powered By Large Language Models: Integrating Semantic Understanding and User Preferences
Keywords:
Personalized Recommendation Systems, Large Language Models, Semantic Understanding, User Preference ModelingAbstract
This study proposes a novel personalized recommendation system leveraging Large Language Models (LLMs) to integrate semantic understanding with user preferences[1]. The system addresses critical challenges in traditional recommendation approaches by harnessing LLMs' advanced natural language processing capabilities. We introduce a framework combining a fine-tuned Roberta semantic analysis model with a multi-modal user preference extraction mechanism.The LLM component undergoes domain adaptation using Masked Language Modeling on a corpus of 112,000 user reviews from the MyAnimeList dataset, followed by task-specific fine-tuning using contrastive learning. User preferences are modeled through a weighted combination of explicit ratings, review sentiment, and implicit feedback, incorporating temporal dynamics through a time-decay function. Experimental results demonstrate significant improvements over state-of-the-art baselines, including Matrix Factorization, Neural Collaborative Filtering, BERT4Rec, and LightGCN. Our LLM-powered system achieves an 8.6%increase in NDCG@10 and a 10.5% improvement in Mean Reciprocal Rank compared to the best-performing baseline. Ablation studies reveal the synergistic effect of integrating LLM-based semantic understanding with user preference modeling.
References
D. E. O'Leary, "Do Large Language Models Bias Human Evaluations?," IEEE Intelligent Systems, vol. 39, no. 4, pp. 83-87, Jul.-Aug. 2024. Available from: https://doi.org/10.1109/MIS.2024.3415208
A. Agarwal and S. Sharma, "LLANIME: Large Language Models for Anime Recommendations," in Proc. 2023 16th Int. Conf. Developments in eSystems Engineering (DeSE), 2023, pp. 870-875. Available from: https://doi.org/10.1109/DeSE60595.2023.10468757
A. S. Alsayed, H. K. Dam, and C. Nguyen, "MicroRec: Leveraging Large Language Models for Microservice Recommendation," in Proc. 21st Int. Conf. Mining Software Repositories (MSR '24), 2024, pp. 419-430. Available from: https://dl.acm.org/doi/pdf/10.1145/3643991.3644916
M. Z. Katlariwala and A. Gupta, "Product Recommendation System Using Large Language Model: Llama-2," in 2024 IEEE World AI IoT Congress (AIIoT), 2024, pp. 491-495. Available from: https://doi.org/10.1109/AIIoT61789.2024.10579009
R. Wu, "RecBERT: A semantic recommendation engine with a large language model enhanced query segmentation for k-nearest neighbors' ranking retrieval," Intelligent and Converged Networks, vol. 5, no. 1, pp. 42-52, Mar. 2024. Available from: http://dx.doi.org/10.23919/ICN.2024.0004
H. Lei, B. Wang, Z. Shui, P. Yang, and P. Liang, "Automated Lane Change Behavior Prediction and Environmental Perception Based on SLAM Technology," arXiv preprint arXiv:2404.04492, Apr. 2024. Available from: http://dx.doi.org/10.54254/2755-2721/67/2024MA0054
B. Wang, Y. He, Z. Shui, Q. Xin, and H. Lei, "Predictive Optimization of DDoS Attack Mitigation in Distributed Systems using Machine Learning," Applied and Computational Engineering, vol. 64, pp. 95-100, Apr. 2024. Available from: http://dx.doi.org/10.13140/RG.2.2.15938.39369
B. Wang, H. Zheng, K. Qian, X. Zhan, and J. Wang, "Edge computing and AI-driven intelligent traffic monitoring and optimization," Applied and Computational Engineering, vol. 77, pp. 225-230, Jul. 2024. Available from: http://dx.doi.org/10.54254/2755-2721/67/2024MA0062
Y. Xu, Y. Liu, H. Xu, and H. Tan, "AI-Driven UX/UI Design: Empirical Research and Applications in FinTech," International Journal of Innovative Research in Computer Science & Technology, vol. 12, no. 4, pp. 99-109, Dec. 2024. Available from: http://dx.doi.org/10.55524/ijircst.2024.12.4.16
Y. Liu, Y. Xu, and R. Song, "Transforming User Experience (UX) through Artificial Intelligence (AI) in interactive media design," Engineering Science & Technology Journal, vol. 5, no. 7, pp. 2273-2283, Nov. 2024. Available from: http://dx.doi.org/10.51594/estj.v5i7.1325
P. Zhang, "A STUDY ON THE LOCATION SELECTION OF LOGISTICS DISTRIBUTION CENTERS BASED ON E-COMMERCE," Journal of Knowledge Learning and Science Technology, vol. 3, no. 3, pp. 103-107, 2024. ISSN: 2959-6386 (online). Available from: http://dx.doi.org/10.60087/jklst.vol3.n3.p103-107
P. Zhang and L. I. U. Gan, "Optimization of Vehicle Scheduling for Joint Distribution in the Logistics Park based on Priority," Journal of Industrial Engineering and Applied Science, vol. 2, no. 4, pp. 116-121, 2024. Available from: http://dx.doi.org/10.5281/zenodo.13120171
H. Li, S. X. Wang, F. Shang, K. Niu, and R. Song, "Applications of Large Language Models in Cloud Computing: An Empirical Study Using Real-world Data," International Journal of Innovative Research in Computer Science & Technology, vol. 12, no. 4, pp. 59-69, 2024. Available from: http://dx.doi.org/10.1007/s10115-024-02120-8
H. Xu, K. Niu, T. Lu, and S. Li, "Leveraging artificial intelligence for enhanced risk management in financial services: Current applications and prospects," Engineering Science & Technology Journal, vol. 5, no. 8, pp. 2402-2426, 2024. Available from: http://dx.doi.org/10.51594/estj.v5i8.1363
Y. Shi, F. Shang, Z. Xu, and S. Zhou, "Emotion-Driven Deep Learning Recommendation Systems: Mining Preferences from User Reviews and Predicting Scores," Journal of Artificial Intelligence and Development, vol. 3, no. 1, pp. 40-46, 2024. Available from: https://edujavare.com/index.php/JAI/article/view/472
S. Wang, K. Xu, and Z. Ling, "Deep Learning-Based Chip Power Prediction and Optimization: An Intelligent EDA Approach," International Journal of Innovative Research in Computer Science & Technology, vol. 12, no. 4, pp. 77-87, 2024. Available from: https://doi.org/10.55524/ijircst.2024.12.4.13
M. Zhang, B. Yuan, H. Li, and K. Xu, "LLM-Cloud Complete: Leveraging Cloud Computing for Efficient Large Language Model-based Code Completion," Journal of Artificial Intelligence General Science (JAIGS), vol. 5, no. 1, pp. 295-326, 2024. ISSN: 3006-4023. Available from: http://dx.doi.org/10.60087/jaigs.v5i1.200
B. Liu, X. Zhao, H. Hu, Q. Lin, and J. Huang, "Detection of Esophageal Cancer Lesions Based on CBAM Faster R-CNN," Journal of Theory and Practice of Engineering Science, vol. 3, no. 12, pp. 36-42, 2023. Available from: http://dx.doi.org/10.53469/jtpes.2023.03(12).06
B. Liu, L. Yu, C. Che, Q. Lin, H. Hu, and X. Zhao, "Integration and performance analysis of artificial intelligence and computer vision based on deep learning algorithms," Applied and Computational Engineering, vol. 64, pp. 36-41, 2024. Available from: http://dx.doi.org/10.54254/2755-2721/64/20241374
P. Liang, B. Song, X. Zhan, Z. Chen, and J. Yuan, "Automating the training and deployment of models in MLOps by integrating systems with machine learning," Applied and Computational Engineering, vol. 67, pp. 1-7, 2024. Available from: http://dx.doi.org/10.54254/2755-2721/67/20240690
B. Wu, Y. Gong, H. Zheng, Y. Zhang, J. Huang, and J. Xu, "Enterprise cloud resource optimization and management based on cloud operations," Applied and Computational Engineering, vol. 67, pp. 8-14, 2024. Available from: http://dx.doi.org/10.54254/2755-2721/67/20240667
H. Zheng, K. Xu, H. Zhou, Y. Wang, and G. Su, "Medication Recommendation System Based on Natural Language Processing for Patient Emotion Analysis," Academic Journal of Science and Technology, vol. 10, no. 1, pp. 62-68, 2024. Available from: https://arxiv.org/pdf/2104.01113
S. Wang, K. Xu, and Z. Ling, "Deep Learning-Based Chip Power Prediction and Optimization: An Intelligent EDA Approach," International Journal of Innovative Research in Computer Science & Technology, vol. 12, no. 4, pp. 77-87, 2024. Available from: https://doi.org/10.55524/ijircst.2024.12.4.13
L. Guo, Z. Li, K. Qian, W. Ding, and Z. Chen, "Bank Credit Risk Early Warning Model Based on Machine Learning Decision Trees," Journal of Economic Theory and Business Management, vol. 1, no. 3, pp. 24-30, 2024. Available from: https://doi.org/10.1155/2022/9754428
Z. Xu, L. Guo, S. Zhou, R. Song, and K. Niu, "Enterprise Supply Chain Risk Management and Decision Support Driven by Large Language Models," Applied Science and Engineering Journal for Advanced Research, vol. 3, no. 4, pp. 1-7, 2024. Available from: http://dx.doi.org/10.4018/JGIM.335125
R. Song, Z. Wang, L. Guo, F. Zhao, and Z. Xu, "Deep Belief Networks (DBN) for Financial Time Series Analysis and Market Trends Prediction," World Journal of Innovative Medical Technologies, vol. 5, no. 3, pp. 27-34, 2024. Available from: https://doi.org/10.53469/wjimt.2024.07(04).01
H. Zheng, J. Wu, R. Song, L. Guo, and Z. Xu, "Predicting Financial Enterprise Stocks, and Economic Data Trends Using Machine Learning Time Series Analysis," Applied and Computational Engineering, vol. 87, pp. 26-32, 2024. Available from: http://dx.doi.org/10.20944/preprints202407.0895.v1
K. Xu, H. Zhou, H. Zheng, M. Zhu, and Q. Xin, "Intelligent Classification and Personalized Recommendation of E-commerce Products Based on Machine Learning," arXiv preprint arXiv:2403.19345, 2024. Available from: https://doi.org/10.48550/arXiv.2403.19345
K. Xu, H. Zheng, X. Zhan, S. Zhou, and K. Niu, "Evaluation and Optimization of Intelligent Recommendation System Performance with Cloud Resource Automation Compatibility," unpublished, 2024. Available from: http://dx.doi.org/10.54254/2755-2721/87/20241620
L. Guo, R. Song, J. Wu, Z. Xu, and F. Zhao, "Integrating a Machine Learning-Driven Fraud Detection System Based on a Risk Management Framework," Preprints, 2024, doi: 2024061756. Available from: http://dx.doi.org/10.54254/2755-2721/87/20241541
T. Yang, Q. Xin, X. Zhan, S. Zhuang, and H. Li, "Enhancing Financial Services Through Big Data and AI-Driven Customer Insights and Risk Analysis," Journal of Knowledge Learning and Science Technology, vol. 3, no. 3, pp. 53-62, 2024. ISSN: 2959-6386 (online). Available from: http://dx.doi.org/10.60087/jklst.vol3.n3.p53-62
X. Zhan, Z. Ling, Z. Xu, L. Guo, and S. Zhuang, "Driving Efficiency and Risk Management in Finance through AI and RPA," Unique Endeavor in Business & Social Sciences, vol. 3, no. 1, pp. 189-197, 2024. Available from: https://unbss.com/index.php/unbss/article/view/50/49
W. Jiang, K. Qian, C. Fan, W. Ding, and Z. Li, "Applications of Generative AI-Based Financial Robot Advisors as Investment Consultants," Applied and Computational Engineering, vol. 67, pp. 28-33, 2024. Available from: http://dx.doi.org/10.54254/2755-2721/67/2024MA0057
C. Fan, Z. Li, W. Ding, H. Zhou, and K. Qian, "Integrating Artificial Intelligence with SLAM Technology for Robotic Navigation and Localization in Unknown Environments," International Journal of Robotics and Automation, vol. 29, no. 4, pp. 215-230, 2024. Available from: 4-Social-Entrepreneurship-a-Channel-of-social-development-in-Manipur-with-a-special-focus-on-Tribal-communities-of-Chandel-district.docx
C. Fan, W. Ding, K. Qian, H. Tan, and Z. Li, "Cueing Flight Object Trajectory and Safety Prediction Based on SLAM Technology," Journal of Theory and Practice of Engineering Science, vol. 4, no. 05, pp. 1-8, 2024. Available from: http://dx.doi.org/10.53469/jtpes.2024.04(05).01
W. Ding, H. Tan, H. Zhou, Z. Li, and C. Fan, "Immediate Traffic Flow Monitoring and Management Based on Multimodal Data in Cloud Computing," Journal of Transportation Systems, vol. 18, no. 3, pp. 102-118, 2024. Available from: http://dx.doi.org/10.54254/2755-2721/71/2024MA0052
W. Jiang, T. Yang, A. Li, Y. Lin, and X. Bai, "The Application of Generative Artificial Intelligence in Virtual Financial Advisor and Capital Market Analysis," Academic Journal of Sociology and Management, vol. 2, no. 3, pp. 40-46, 2024. Available from: http://dx.doi.org/10.54097/y17mrj84
A. Li, S. Zhuang, T. Yang, W. Lu, and J. Xu, "Optimization of Logistics Cargo Tracking and Transportation Efficiency Based on Data Science Deep Learning Models," Applied and Computational Engineering, vol. 69, pp. 71-77, Jul. 2024. Available from: http://dx.doi.org/10.20944/preprints202407.1428.v1
Y. Feng, H. Li, X. Wang, J. Tian, and Y. Qi, "Application of Machine Learning Decision Tree Algorithm Based on Big Data in Intelligent Procurement," unpublished, 2024. Available from: http://dx.doi.org/10.1155/2022/6469054
F. Zhao, H. Li, K. Niu, J. Shi, and R. Song, "Application of Deep Learning-Based Intrusion Detection System (IDS) in Network Anomaly Traffic Detection," unpublished, 2024. Available from: http://dx.doi.org/10.54254/2755-2721/86/20241604
