Towards comprehensive approaches for the rating prediction phase in memory-based collaborative filtering recommender systems

Collaborative filtering (CF) technique in recommender systems (RS) is a well-known and popular technique that exploits relationships between users or items to make product recommendations to an active user. The effectiveness of existing memory based algorithms depend on the similarity measure that is used to identify nearest neighbours. However, similarity measures utilize only the ratings of co-rated items while computing the similarity between a pair of users or items. In most of the e-commerce applications, the rating matrix is too sparse since even active users of an online system tend to rate only a few items of the entire set of items. Therefore, co-rated items among users are even sparser. Moreover, the ratings a user gives an individual item tells us nothing about his comprehensive interest without which the generated recommendations may not be satisfactory to a user. In order to be able to address these issues, a comprehensive study is made of the various existing measures of similarity in a collaborative filtering recommender system (CFRS) and a hierarchical categorization of products has been proposed to understand the interest of a user in a wider scope so as to provide better recommendations as well as to alleviate data sparsity.

Collaborative filtering (CF), the most successful information filtering technique for recommender systems, is either memory-based or model-based. While the former is more accurate, its scalability compared to model-based is poor. Moreover, the similarity functions used by most recommender systems are compensatory and allow very high (pros) and very low (cons) scores to compensate each other. This paper presents a hybrid movie recommender system that retains memory-based CF accuracy, model-based CF scalability, and alleviates the compensation problem of similarity functions. The proposed recommender system relies on a compact user model and fuzzy concordance/discordance principle. The user model speeds up the online process of generating a set of like-minded users within which a memory-based CF is carried out. The inter users comparison is done by using fuzzy concordance/discordance principle to alleviate the similarity compensation problem. The pros and cons between users are measured separately and then the overall statement about them is obtained by balancing the pros and cons within the set of criteria. Besides our approach is fast and compact, computational results reveal that it outperforms the classical one.

Memory-based collaborative filtering (CF) techniques have been widely implemented for predicting ratings to unseen items by aggregating ratings of similar users or items in recommender systems (RS). Usually, sufficient ratings from similar users or similar items are not available in the rating matrix, due to the data sparsity problem. Further, these techniques suffer from correlation based problems inherent in used similarity measures. Consequently, higher prediction accuracy cannot be achieved. In this paper, we propose the use of fuzzy Naive Bayesian (FNB) classifier for user based CF and item based CF for implicitly computing similarity between users as well as items on the basis of conditional probabilities and develop fuzzy Naive Bayesian classifier to user based CF (FNB-UB-CF) and item based CF (FNB-IB-CF). We further develop a hybrid RS (FNB-UB-IB-CF) by combining the proposed FNB-UB-CF and FNB-IB-CF. Their combinations would be helpful in alleviating the sparsity because both user ratings and item ratings are employed. Experimental results demonstrate that the proposed methods are indeed more robust against data sparsity and give better recommendation quality using a popular MovieLens dataset.

Collaborative filtering is one of the most widely used methods for user rating prediction in recommender systems. To evaluate a collaborative filtering system, rating datasets are typically used, which comprise thousands to millions of records consisting of user–item–rating tuples. Initially, a similarity metric is used to quantify the closeness between each user and every other user in the dataset, typically based on the ratings that each pair of users has given to the same items. Subsequently, the K users having the largest similarity to the target user are used to produce rating predictions, which lead to recommendations. A particularly challenging case arises when the rating dataset is very sparse. In this scenario, it is difficult not only to find users with commonly rated items but also to determine the optimal similarity metric and suitable values for variable K. Setting a small value for K results in extremely low prediction coverage, leading to unsuccessful recommendations, while setting a very large K value increases memory requirements and prediction/recommendation generation time. Through a multiparameter experiment, this work aims to determine the optimal settings for rating predictions when very sparse datasets are used in collaborative filtering recommender systems.

Recommender Systems (RS) have been implemented in the Technology enhanced Learning (TeL) field for facilitating, among others, Learning Object (LO) selection by teachers to support their daily teaching practice. In particular, memory-based collaborative filtering (CF) approaches have demonstrated promising results for real-life implementations of web-based Learning Object Repositories (LOR). Building on this, the contribution of this paper is an enhancement to existing memory-based CF RS methods, by adaptively selecting the teacher neighbors based on their co-rated LOs and the attribute similarity of the latter to the LO to be recommended. The evaluation results show a significant increase in the predictive accuracy of the adaptive RS approaches compared to their traditional benchmarks, signifying the proposed approach's capacity to enhance the accuracy of existing memory-based CF approaches.

The viewing set-based method has difficulties ensuring that a user will enjoy recommended programs, and the model-based collaborative filtering method contains system-side real-time recommendation problems because most recent ratings cannot be applied in the recommendations and it has increased calculating costs due to the training process. In this paper, we propose a personalized program recommender for smart TVs using memory-based collaborative filtering with a novel similarity method that is robust to cold-start conditions and faster than the often-used, existing similarity method. The proposed method can improve the recommendation performance of electronic program guides and recommender applications for smart TVs. We determined the prediction accuracy of the ratings under various conditions in order to evaluate the proposed method. As a result, we confirmed that the proposed method is effective for cold-start conditions.

Recommender systems provide users with product information and suggestions, which has gradually become an important research tool in e-commerce IT technology, which has attracted a lot of attention of researchers. Collaborative filtering recommendation technology has been the most successful recommendation technology so far, but there are two major problems—recommendation quality and scalability. At present, research at home and abroad mainly focuses on recommendation quality, and there is less discussion on scalability. The scalability problem is that as the size of the system increases, the response time of the system increases to a point where users cannot afford it. Existing solutions often result in a significant drop in recommendation quality while reducing recommendation response time. In this paper, the clustering analysis subsystem based on the genetic algorithm is innovatively introduced into the traditional collaborative filtering recommendation system, and its design and implementation are given. In addition, when obtaining the nearest neighbors, only the clustered users of the target user are searched, making it a collaborative filtering recommender system based on genetic clustering. The experimental results show that the response time of the traditional collaborative filtering recommender system increases linearly with the increase in the number of users while the response time of the collaborative filtering recommender system based on genetic clustering remains unchanged with the increase in the number of users. On the other hand, the recommendation quality of the collaborative filtering recommender system based on genetic clustering is basically not degraded compared with that of the traditional collaborative filtering recommender system. Therefore, the collaborative filtering recommender system based on genetic clustering can effectively solve the scalability problem of the collaborative filtering recommender system.

Recommender systems are widely used in online business to satisfy user personalization demands. The most successful technique of such systems is collaborative filtering, which utilizes users' known preference to generate predictions of the unknown preferences. A key challenge for collaborative filtering recommender systems is providing high quality recommendations to new users that have not enough known preferences. In this paper, we propose a hybrid algorithm by using both the ratings and content information to tackle user-side cold-start problem. We first cluster users based on their interests and then utilize the clustering results and users' demographic information to build a decision tree to associate the novel users with the existing ones. Considering the novel user's ratings constantly increasing, we make predictions for novel users by combining our method with the collaborative filtering algorithm. Experiments on real data set show the improvement of our approach in overcoming the user-side cold-start problem.

Los sistemas de recomendación han tenido un rápido crecimiento tanto en investigación académica como en aplicaciones industriales en los últimos años. Las recomendaciones se nos proporcionan cuando elegimos elementos como música, películas, restaurantes, noticias, etc. Como parte de las técnicas de recomendación más prometedoras, los sistemas basados en recomendación de filtros colaborativos desempeñan un papel importante en las aplicaciones actuales. La aparición de nuevas fuentes de información requiere la combinación de sistemas de recomendación con técnicas avanzadas de otros campos, como el análisis de redes sociales, el procesamiento del lenguaje natural, el aprendizaje en profundidad, etc. Esta combinación mejora la calidad de las recomendaciones. Los sistemas de recomendación anteriores se centran principalmente en las mejoras de la precisión de la recomendación. Recientemente, surge una tendencia para la evaluación del rendimiento de los sistemas de recomendación que toma muchas propiedades nuevas en consideración. La fiabilidad es uno de los aspectos más notables y será profundamente estudiado en esta tesis. Se han propuesto algunas medidas para medir la fiabilidad de los sistemas de recomendación de filtrado colaborativo basados en la memoria. Sin embargo, observamos un área sin cubrir en el diseño de las medidas de fiabilidad adecuadas para los sistemas de recomendación de filtros colaborativos basados en modelos, especialmente aquellos basados en la factorización matricial. También encontramos que hay una falta de medidas de calidad de fiabilidad adecuadas. Esta tesis se concentra en proporcionar soluciones a ambas ausencias. Después de un estudio exhaustivo de trabajos de investigación del estado del arte, proponemos una nueva medida de fiabilidad que supera los desafíos de generalización y abstracción causados por los factores latentes de los métodos de factorización matricial. La medida propuesta se compara con con métodos y algoritmos representativos, usando bases de datos publicas, tanto académicas como comerciales. Los resultados experimentales muestran que nuestra nueva medida logra mejoras en la calidad de la recomendación. Además, la medida de fiabilidad propuesta también tiene un impacto muy positivo contra los "Shilling Attacks". Para obtener una mejora respecto a las medidas existentes de calidad de la fiabilidad, también proponemos, hasta donde sabemos, la primera medida de calidad de fiabilidad universal que es capaz de proporcionar valores numéricos para cualquier tipo de sistema de recomendación. Esta medida también se ha probado usando conjuntos de datos públicos reales y ha sido comparada con los métodos de calidad de la fiabilidad existentes. Basándonos en los resultados de los experimentos, concluimos que nuestra medida supera los últimos trabajos de investigación, proporcionando valores de calidad de fiabilidad más precisos e informativos. ----------ABSTRACT---------- Recommender systems have experienced a rapid growth in both academical research and industrial applications in latest years. Recommendations are provided to us when we choose items such as music, movies, restaurants, news, etc. As the most promising recommendation techniques, collaborative filtering recommender systems play an important role in current applications. The emergence of novel information sources requires to combine recommender systems with several advanced techniques coming from other fields like social network analysis, natural language processing, deep learning etc. This combination improves the quality of recommendations. Previous recommender systems research mainly focuses on the improvements of recommendation accuracy. Recently a new trend arises for the performance evaluation of recommender systems that takes many novel properties into consideration. Reliability is one of the most remarkable aspects, which will be deeply studied in this thesis. Some measures have been proposed for measuring reliability of memory based collaborative filtering recommender systems. However, we observe a gap in the design of proper reliability measures for model based collaborative filtering recommender systems, especially those based on matrix factorization. We also found that there is a lack in proper reliability quality measures. This thesis concentrates on providing solutions to both lacks. After a comprehensive study of state-of-the-art research works, we propose a novel reliability measure that overcomes the challenges of generality and abstraction caused by latent factors of matrix factorization methods. The proposed measure is tested against current baselines on public academic and commercial datasets; experiment results show that our novel measure achieves better improvements on recommendation quality. What’s more, the proposed reliability measure also has a very positive impact against shilling attacks. In order to fill in the blank of reliability quality measures, we also propose, as far as we know, the first universal reliability quality measure that is able to provide numerical values for any type of recommender systems. This measure has also been tested on public academic and commercial datasets using current methods. Based on the experiment results we conclude that our quality measure outperforms state-of-the-art research works by providing more accurate and informative reliability quality values.

Memory-based collaborative filtering (CF) aims at predicting the rating of a certain item for a particular user based on the previous ratings from similar users and/or similar items. Previous studies in finding similar users and items have several drawbacks. First, they are based on user-defined similarity measurements, such as Pearson Correlation Coefficient (PCC) or Vector Space Similarity (VSS), which are, for the most part, not adaptive and optimized for specific applications and data. Second, these similarity measures are restricted to symmetric ones such that the similarity between A and B is the same as that for B and A, although symmetry may not always hold in many real world applications. Third, they typically treat the similarity functions between users and functions between items separately. However, in reality, the similarities between users and between items are inter-related. In this paper, we propose a novel unified model for users and items, known as Similarity Learning based Collaborative Filtering (SLCF) , based on a novel adaptive bidirectional asymmetric similarity measurement. Our proposed model automatically learns asymmetric similarities between users and items at the same time through matrix factorization. Theoretical analysis shows that our model is a novel generalization of singular value decomposition (SVD). We show that, once the similarity relation is learned, it can be used flexibly in many ways for rating prediction. To take full advantage of the model, we propose several strategies to make the best use of the proposed similarity function for rating prediction. The similarity can be used either to improve the memory-based approaches or directly in a model based CF approaches. In addition, we also propose an online version of the rating prediction method to incorporate new users and new items. We evaluate SLCF using three benchmark datasets, including MovieLens, EachMovie and Netflix, through which we show that our methods can outperform many state-of-the-art baselines.

Nowadays, collaborative filtering recommender systems have been widely deployed in many commercial companies to make profit. Neighborhood‐based collaborative filtering (CF) is common and effective. To date, despite its effectiveness, there has been little effort to explore their robustness and the impact of data poisoning attacks on their performance. Can the neighborhood‐based recommender systems be easily fooled? To this end, we shed light on the robustness of neighborhood‐based recommender systems and propose a novel data poisoning attack framework, encoding the purpose of attack and constraint against them. We first illustrate how to calculate the optimal data poisoning attack, namely, UNAttack. We inject a few well‐designed fake users into the recommender systems such that target items will be recommended to as many normal users as possible. Extensive experiments are conducted on three real‐world datasets to validate the effectiveness and the transferability of our proposed method. In addition, some interesting phenomena can be found. For example, (i) neighborhood‐based recommender systems with Euclidean distance‐based similarity have strong robustness and (ii) the fake users can be transferred to attack the state‐of‐the‐art CF recommender systems such as neural CF and Bayesian personalized ranking matrix factorization.

With the rapid development of e-commerce, collaborative filtering recommendation system has been widely used in various network platforms. Using recommendation system to accurately predict customers’ preferences for goods can solve the problem of information overload faced by users and improve users’ dependence on the network platform. Because the recommendation system based on collaborative filtering technology has the ability to recommend more abstract or difficult to describe goods in words, the research related to collaborative filtering technology has attracted more and more attention. According to the past research, in collaborative filtering algorithm, if Pearson correlation coefficient is used, errors will occur under special circumstances. In this study, the normal recovery similarity measure is used to modify the similarity value to correct the error value of a collaborative filtering recommendation algorithm. Based on this, a big data analysis method based on a modified collaborative filtering recommendation algorithm is proposed. This research implemented it in the cloud Hadoop environment, and measure the execution time with 2, 5 and 8 nodes. Then the research compared it with the execution time of a single machine, and analyze its speedup ratio and efficiency. The experimental results show that the execution time increases with the number of neighbors. When the number of nodes is 5 and 8, the execution time is greatly improved, which improves the efficiency of collaborative filtering algorithm and can cope with massive data in the future.

Collaborative filtering recommender systems primarily focus on short-term prediction accuracy but exhibit limitations concerning long-term user satisfaction and content diversity. In this paper, we reinterpret user-item interaction data as reinforcement learning with verifiable rewards and introduce the Group Relative Policy Optimization (GRPO) reinforcement learning algorithm, originally proposed in the large language model domain, to collaborative filtering model fine-tuning for the first time. GRPO directly updates policies without separate critic networks, balancing exploration and exploitation while optimizing long-term user engagement. In experiments conducted on Amazon review datasets covering baby products, video games, and industrial & scientific categories, the GRPO-optimized model achieved up to 15.16% improvement in Recall@10 compared to baseline models. Additionally, we revealed that user embeddings from graph-based collaborative filtering architectures positively contribute to GRPO algorithm optimization, whereas positional embeddings from sequential collaborative filtering architectures impede optimization performance. These findings empirically validate the effectiveness of the GRPO algorithm as a robust approach for recommender system model optimization.

The available data on the Internet can be utilized to obtain valuable information on any given subject. But the data is massive and intricate, which produces many problems for users in finding information of their interests. Recommender Systems (RSs) are successful software techniques designed to solve this issue. The RSs have a broad range of uses, such as providing consumers with a suggested list of products for online shopping, recommending articles or books for reading online, film or music recommendations, media recommendations, and so on. The traditional Collaborative Filtering (CF) recommender systems use different item ratings as a foundation to recommend new items to various users. The sparsity of this user-item matrix affects the performance of RS. Also, most consumers on today's e-commerce websites would not purchase a product that they do not find appealing, even though it has especially favorable feedback. As a result, we can say that consumers give equal importance to product images and the item's ratings. This paper aims to research to improve the traditional collaborative filtering recommender system by imbibing visual characteristics with explicit feedback (ratings). The visual features are extracted using transfer learning with the convolutional neural network (CNN). The amazon product dataset for clothing, shoes, and jewelry is used to validate the proposed approach. The results are compared using standard evaluation measures like MAE and RMSE.KeywordsCollaborative filteringRecommender systemConvolutional neural networkTransfer learning

Currently the use of web recommendation techniques is growing worldwide with aim of providing the custom-made required data to end users. Most of the web users complain about finding useful information on web sites. Web recommender systems predict the information needs of users and provide them with recommendations to facilitate their navigation. Recommender systems have been extensively explored in web mining. The web recommendation systems are split into two main categories such as collaborative recommendation system and content based recommendation system. However, the quality of recommendations and the user satisfaction with such systems are still not optimal. In adaptive association recommender systems based on web mining techniques have strengths and weaknesses. One of these weaknesses is lack of consideration of an appropriate measure to calculate the user’s interest degree of pages. Applying Fuzzy Association Rule Mining (FARM) algorithm to a recommender system leads to calculate user’s interest of pages more accurately. Consequently generated recommendations will be more desirable when compared to other association rule mining techniques.