- Research Article
1
- 10.2139/ssrn.3791837
Evaluation Of Recommendation System On A Movie Dataset
- Jan 01, 2020
- SSRN Electronic Journal
- Ronit Malik
Evaluation Of Recommendation System On A Movie Dataset
Purpose – Project ATHENA aims to develop an application to address information overload, primarily focused on Recommendation Systems (RSs) with the personalization and user experience design of a modern system. Method – Two machine learning (ML) algorithms were used: (1) TF-IDF for Content-based filtering (CBF); (2) Classification with Matrix Factorization- Singular Value Decomposition (SVD) applied with Collaborative filtering (CF) and mean (normalization) for prediction accuracy of the CF. Data sampling in academic Research and Development (R&D) of Philippine Council for Agriculture, Aquatic, and Natural Resources Research and Development (PCAARRD) e-Library and Project SARAI publications plus simulated data used as training sets to generate a recommendation of items that uses the three RS filtering (CF, CBF, and personalized version of item recommendations). Series of Testing and TAM performed and discussed. Results – Findings allow users to engage in online information and quickly evaluate retrieved items produced by the application. Compatibility-testing (CoT) shows the application is compatible with all major browsers and mobile-friendly. Performance-testing (PT) recommended v-parameter specs and TAM evaluations results indicate strongly associated with overall positive feedback, thoroughly enough to address the information-overload problem as the core of the paper. Conclusion – A modular architecture presented addressing the information overload, primarily focused on RSs with the personalization and design of modern systems. Developers utilized Two ML algorithms and prototyped a simplified version of the architecture. Series of testing (CoT and PT) and evaluations with TAM were performed and discussed. Project ATHENA added a UX feature design of a modern system. Recommendations – High-end hardware specs of v-Parameter are recommended, at least 8-cores of vCPU with 16GiB of memory and sufficient driver-type size to run the model and End-to-end jobs execution for continuously maintaining the application. Research Implications – Future Developers must use/integrate a large dataset. Other ML approaches can expand Hybrid-RS better. Implicit data and additional filtering methods may enhance the application in the future.
Evaluation Of Recommendation System On A Movie Dataset
Evaluation Of Recommendation System On A Movie Dataset
A novel hybrid approach towards movie recommender systems
Collaborative and content-based filtering are the majorly used approaches towards implementing recommender systems which can successfully predict the item(s) to be recommended to users based upon their preferences. Each of the methods has its own advantages and disadvantages that are specific to the situation they are used in. The hybrid approach aims to combine both techniques in multiple ways to optimize results and overcome shortcomings. In this paper, we propose a hybrid approach based recommendation engine to improve accuracy. While content based recommendations are made on the similarity of items’ attributes, collaborative recommendations are based on similarity of users. Collaborative filtering is achieved by matrix factorization technique. One of the most effective algorithms for matrix factorization: Singular Value Decomposition (SVD) has been used to perform collaborative filtering and combined with content based model to predict the item ratings per user. The paper aims to achieve the final result with minimum possible errors as per user preferences and recommended items.
Read moreAvailability of Evidence for Predictive Machine Learning Algorithms in Primary Care
The aging and multimorbid population and health personnel shortages pose a substantial burden on primary health care. While predictive machine learning (ML) algorithms have the potential to address these challenges, concerns include transparency and insufficient reporting of model validation and effectiveness of the implementation in the clinical workflow. To systematically identify predictive ML algorithms implemented in primary care from peer-reviewed literature and US Food and Drug Administration (FDA) and Conformité Européene (CE) registration databases and to ascertain the public availability of evidence, including peer-reviewed literature, gray literature, and technical reports across the artificial intelligence (AI) life cycle. PubMed, Embase, Web of Science, Cochrane Library, Emcare, Academic Search Premier, IEEE Xplore, ACM Digital Library, MathSciNet, AAAI.org (Association for the Advancement of Artificial Intelligence), arXiv, Epistemonikos, PsycINFO, and Google Scholar were searched for studies published between January 2000 and July 2023, with search terms that were related to AI, primary care, and implementation. The search extended to CE-marked or FDA-approved predictive ML algorithms obtained from relevant registration databases. Three reviewers gathered subsequent evidence involving strategies such as product searches, exploration of references, manufacturer website visits, and direct inquiries to authors and product owners. The extent to which the evidence for each predictive ML algorithm aligned with the Dutch AI predictive algorithm (AIPA) guideline requirements was assessed per AI life cycle phase, producing evidence availability scores. The systematic search identified 43 predictive ML algorithms, of which 25 were commercially available and CE-marked or FDA-approved. The predictive ML algorithms spanned multiple clinical domains, but most (27 [63%]) focused on cardiovascular diseases and diabetes. Most (35 [81%]) were published within the past 5 years. The availability of evidence varied across different phases of the predictive ML algorithm life cycle, with evidence being reported the least for phase 1 (preparation) and phase 5 (impact assessment) (19% and 30%, respectively). Twelve (28%) predictive ML algorithms achieved approximately half of their maximum individual evidence availability score. Overall, predictive ML algorithms from peer-reviewed literature showed higher evidence availability compared with those from FDA-approved or CE-marked databases (45% vs 29%). The findings indicate an urgent need to improve the availability of evidence regarding the predictive ML algorithms' quality criteria. Adopting the Dutch AIPA guideline could facilitate transparent and consistent reporting of the quality criteria that could foster trust among end users and facilitating large-scale implementation.
Read moreAn Evaluation of Machine Learning Algorithms Used for Recommender Systems in Streaming Services
With the exponential growth of streaming services, the demand for effective recommender systems has become paramount. Recommender systems, powered by machine learning algorithms, play a critical role in analyzing user behavior and preferences to deliver personalized content recommendations. However, the abundance of available algorithms poses a challenge for streaming platforms in determining the most suitable approach for their recommender systems. This research paper presents an evaluation of various machine learning algorithms used in recommender systems for streaming services. Through a comparative analysis of collaborative filtering, content-based filtering, matrix factorization techniques, deep learning algorithms, and emerging approaches such as reinforcement learning and hybrid models, this study aims to provide insights into the strengths, limitations, and performance of each approach. By assessing the effectiveness of these algorithms, exploring their applications, and discussing recent advancements, this research contributes to the advancement of recommendation technology in streaming services, ultimately enhancing user satisfaction and engagement.
Read moreA Comparative Analysis of Matrix Factorization Models for Collaborative Filtering: From Basic SVD to SVD++
Recommendation systems have permeated society and everyones daily life with the expanding use of applications. It plays an important role in providing recommendations to active users based on either their historical interests or interests shown by similar users. This paper aims to introduce several components of a recommendation system, such as Collaborative Filtering (CF) and Matrix Factorization, and combining the dominant approach and main technique: Singular Value Decomposition (SVD). Additionally, with the advances in technology, various recently established SVD-based models are mentioned in this paper, attempting to give an answer to the question that though studies have shown the coexistence of advantages and disadvantages for each mode, the trade-offs between their predictive accuracy, computational cost, and robustness to data sparsity have still not been fully answered. Furthermore, this paper concentrates on the comparison and analysis of diverse matrix factorization variants, meanwhile evaluating their performances. For instance, basic SVD, BiasSVD, and SVD++. Finding indicates that SVD shows more efficiency in small-scale datasets, BiasSVD is suitable for cases with noticeable biases, and SVD++ gives high-quality results when handling both explicit and implicit feedback data. This study provides practical guidelines for practitioners to select the most desirable model based on their existing database.
Read moreThe State of Machine Learning in Outcomes Prediction of Transsphenoidal Surgery: A Systematic Review
The purpose of this analysis is to assess the use of machine learning (ML) algorithms in the prediction of postoperative outcomes, including complications, recurrence, and death in transsphenoidal surgery. Following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, we systematically reviewed all papers that used at least one ML algorithm to predict outcomes after transsphenoidal surgery. We searched Scopus, PubMed, and Web of Science databases for studies published prior to May 12, 2021. We identified 13 studies enrolling 5,048 patients. We extracted the general characteristics of each study; the sensitivity, specificity, area under the curve (AUC) of the ML models developed as well as the features identified as important by the ML models. We identified 12 studies with 5,048 patients that included ML algorithms for adenomas, three with 1807 patients specifically for acromegaly, and five with 2105 patients specifically for Cushing's disease. Nearly all were single-institution studies. The studies used a heterogeneous mix of ML algorithms and features to build predictive models. All papers reported an AUC greater than 0.7, which indicates clinical utility. ML algorithms have the potential to predict postoperative outcomes of transsphenoidal surgery and can improve patient care. Ensemble algorithms and neural networks were often top performers when compared with other ML algorithms. Biochemical and preoperative features were most likely to be selected as important by ML models. Inexplicability remains a challenge, but algorithms such as local interpretable model–agnostic explanation or Shapley value can increase explainability of ML algorithms. Our analysis shows that ML algorithms have the potential to greatly assist surgeons in clinical decision making.
Read moreSustainable Development: A Semantics-aware Trends for Movies Recommendation System using Modern NLP
Recommendation systems are an important feature in the proposed virtual life, where users are often stuck with choices most of the time and need help to be able to find what they are looking for. In this work, contentbased techniques have been employed in the proposed recommender system in two ways, a deep review for content and features contents such as (cast, crew, keywords, and genres) has been conducted. A preprocessing stage using TF-IDF and CountVectorizer methods have been employed efficiently to prepare the dataset for any similarity measurements. Cosine similarity algorithm has been employed as well with and without sigmoid and linear kernals. The achieved result proves that similarities between movies using TF-IDF with - Cosine similarity (sigmoid kernel) overcomes the TF-IDF with - Cosine similarity (linear_kernel) and Cosine similarity with CountVectorizer in collaborative filtering. The accuracy values of different machine learning models are validated with K-fold Cross Validator techniques. The performance evaluation has been measured using ROOT Mean Square Error and Mean Absolute Error. Five Machine learning algorithms (NormalPredictor, SVD, KNNBasic (with k=20 and K=10), KNNBasic (with sim_options), and NMF (in several rating scales)). Accuracies are finally been validated with 3 folds from each validator. The best achieved RMSE and MAE scores are using SVD (RMSE = 90%) and (MAE = 69%), followed by KNNBasic (with sim_options, K= 20), NMF, KNNBasic (K=20), KNNBasic (K=10), ending with KNNBasic(sim_options, K= 10). Keywords: Recommendation System, Sustainable Development, Artificial Intelligence, Collaborative Filtering, Content-Based, Cosine Similarity, Movies Recommendation, NLP, Machine Learning Application.
Read moreCollaborative Filtering Based Food Recommendation System Using Matrix Factorization
A recommendation system is a method that provides suggestions of items that might users like. There are many domains that can be recommended, one of the most demanded domains by users today is food. In the era of big data, food choices from the large amount of data make it difficult for users to choose the right food for them. The collaborative filtering (CF) approach is considered capable of providing accurate and high quality item suggestions. One of the algorithms that can provide good performance results from the CF approach is Matrix Factorization (MF). This study aims to test a dataset that contains product ratings of food items using three MF algorithms, which are Singular Value Decomposition (SVD), SVD with Implicit Ratings (SVD++), and Non-Negative Matrix Factorization (NMF). Different latent factors are also used for the purpose of improving the performance of the proposed recommendation system algorithm. The dataset used is Amazon Fine Food Reviews. The study shows NMF and SVD++ as the best algorithm for generating user rating predictions for items. NMF has the smallest average prediction error as measured by MAE which is 0.7311. While SVD++ obtains the smallest prediction error value of 1.0607 as measured using RMSE. In addition to these results, the top-n evaluation also shows that the proposed algorithm performs quite well. The hit ratio value for each different n-item always increases proportionally to the number of recommended n-items. The highest hit ratio value is generated from the SVD++ algorithm of 0.0025 on n-item recommendations of 25 items. Overall it can be said that the proposed algorithm has good performance in providing item recommendations.
Read moreApplication of machine learning in predicting survival outcomes involving real-world data: a scoping review
BackgroundDespite the interest in machine learning (ML) algorithms for analyzing real-world data (RWD) in healthcare, the use of ML in predicting time-to-event data, a common scenario in clinical practice, is less explored. ML models are capable of algorithmically learning from large, complex datasets and can offer advantages in predicting time-to-event data. We reviewed the recent applications of ML for survival analysis using RWD in healthcare.MethodsPUBMED and EMBASE were searched from database inception through March 2023 to identify peer-reviewed English-language studies of ML models for predicting time-to-event outcomes using the RWD. Two reviewers extracted information on the data source, patient population, survival outcome, ML algorithms, and the Area Under the Curve (AUC).ResultsOf 257 citations, 28 publications were included. Random survival forests (N = 16, 57%) and neural networks (N = 11, 39%) were the most popular ML algorithms. There was variability across AUC for these ML models (median 0.789, range 0.6–0.950). ML algorithms were predominately considered for predicting overall survival in oncology (N = 12, 43%). ML survival models were often used to predict disease prognosis or clinical events (N = 27, 96%) in the oncology, while less were used for treatment outcomes (N = 1, 4%).ConclusionsThe ML algorithms, random survival forests and neural networks, are mainly used for RWD to predict survival outcomes such as disease prognosis or clinical events in the oncology. This review shows that more opportunities remain to apply these ML algorithms to inform treatment decision-making in clinical practice. More methodological work is also needed to ensure the utility and applicability of ML models in survival outcomes.
Read morePredicting pairwise relations with neural similarity encoders
Matrix factorization is at the heart of many machine learning algorithms, for example, dimensionality reduction (e.g. kernel PCA) or recommender systems relying on collaborative filtering. Understanding a singular value decomposition (SVD) of a matrix as a neural network optimization problem enables us to decompose large matrices efficiently while dealing naturally with missing values in the given matrix. But most importantly, it allows us to learn the connection between data points' feature vectors and the matrix containing information about their pairwise relations. In this paper we introduce a novel neural network architecture termed Similarity Encoder (SimEc), which is designed to simultaneously factorize a given target matrix while also learning the mapping to project the data points' feature vectors into a similarity preserving embedding space. This makes it possible to, for example, easily compute out-of-sample solutions for new data points. Additionally, we demonstrate that SimEc can preserve non-metric similarities and even predict multiple pairwise relations between data points at once.
Read moreFood Recipe Recommendation System with Content-Based Filtering and Collaborative Filtering Methods
Cooking your own food at home is a good step toward reducing fast food consumption. Fast food increases the risk of dangerous diseases. The diversity of recipe information available on the internet makes it difficult to choose recipes that match user preferences. Mobile technology can help with this by recommending recipes that better suit users' eating habits. This makes the transition to a healthier diet easier. Therefore, in this study, a recommendation system was developed that can recommend recipes based on the preferences of Android users. Two main recommendation methods are used in this study: content-based filtering and collaborative filtering. Using cosine similarity, a content-based recommendation system identifies the proximity between a recipe for food and its related context. The history of user comments on recipes serves as implicit feedback for the collaborative recommendation algorithm. This eliminates the need for explicit evaluations, such as ratings. This recommendation system generates recommendations in the form of the top ten food recipes with an evaluation matrix, referred to as NDCG@k and Hit-Ratio@k. The tests revealed that a content-based filtering technique may produce helpful recommendations, with the highest similarity score of 0.41 for the entry "chocolate cake that you can easily make at home." Meanwhile, in the collaborative filtering method using the Neural Collaborative Filtering (NCF) approach, the system shows consistent performance improvements, with the MAP@10 value increasing from 0.705 to 0.767 and the NDCG@10 from 0.78 to 0.83 after 10 training epochs. Keywords: Recommendation systems; content-based filtering; neural collaborative filtering; cosine similarity; implicit feedback
Read moreA Hybrid Matrix Factorization Framework for Balancing Personalization, Diversity, and Coverage in Ad Recommendation Systems
This paper presents a comprehensive framework for addressing the inherent trade-offs among personalization, diversity, and coverage in hybrid advertisement recommendation systems. In response to the growing complexity of online advertising, the proposed system integrates collaborative filtering via Singular Value Decomposition (SVD) with content-based filtering using Non-negative Matrix Factorization (NMF), enhanced by a re-ranking mechanism based on coverage profiles. This hybrid design aims to deliver relevant, diverse, and widely distributed ads, thereby improving user engagement and fairness among content providers. To quantitatively evaluate these objectives, three novel metrics—Ad User Profile (AUP), Ad Candidate Set (ACS), and Ad Matching Degree (AMD)—are introduced. Through empirical analysis, including visualization and comparative experiments, the study demonstrates that the proposed system outperforms traditional models in achieving a more balanced recommendation outcome. Additionally, real-world case studies and optimization formulations are explored to support scalable deployment. This work contributes to the evolving landscape of recommender systems by proposing a scalable, user-centric approach that harmonizes personalization with fairness and discovery in digital advertising.
Read moreIntegrating machine learning algorithms into audit processes: Benefits and challenges
The integration of machine learning (ML) algorithms into audit processes represents a significant advancement in the field of auditing, offering substantial benefits in terms of efficiency, accuracy, and risk management. This review examines the transformative potential of ML in auditing, highlighting its key benefits and the challenges that must be addressed to fully leverage its capabilities. Machine learning algorithms, with their ability to analyze large datasets and identify patterns, enhance the accuracy and thoroughness of audits. Traditional auditing methods often rely on sampling and manual checks, which can miss anomalies and fraudulent activities. In contrast, ML algorithms can process entire datasets, uncovering subtle patterns and irregularities that may indicate fraud or errors. This comprehensive analysis reduces the risk of oversight and improves the reliability of audit findings. One of the primary benefits of ML in auditing is its capacity for anomaly detection. ML models can be trained on historical data to understand normal financial behavior and flag deviations that might signify irregularities. This ability to detect anomalies in real-time enables auditors to identify potential issues promptly, reducing the time lag between occurrence and detection of fraud. Predictive analytics, powered by ML, further enhances audit processes by forecasting future risks based on historical data. This proactive approach allows auditors to anticipate and mitigate risks before they materialize, contributing to more robust risk management strategies. Despite these advantages, integrating ML into audit processes presents several challenges. Ensuring data quality and integrity is crucial, as ML algorithms are only as good as the data they analyze. Poor-quality data can lead to inaccurate predictions and conclusions. Additionally, the "black box" nature of some ML algorithms can pose transparency issues, making it difficult for auditors to explain how specific conclusions were reached, which is critical for stakeholder trust and regulatory compliance. Another significant challenge is the potential for algorithmic bias. ML models can inadvertently perpetuate existing biases in the data, leading to unfair or skewed audit outcomes. Continuous monitoring and validation of ML algorithms are necessary to detect and mitigate such biases. In conclusion, while integrating machine learning algorithms into audit processes offers substantial benefits in terms of accuracy, efficiency, and risk management, it also necessitates careful attention to data quality, transparency, and bias mitigation. Addressing these challenges is essential to fully realize the potential of ML in enhancing audit practices. Keywords: Benefits, Challenges, Audit Processes, Algorithms, ML.
Read more가중 윈도우를 통한 사용자 이력 기반 추천 시스템
When we buy items in online stores, it is common to face recommended items that meet our interest. These recommendation system help users not only to find out related items, but also find new things that may interest users. Recommendation system has been widely studied and various models has been suggested such as, collaborative filtering and content-based filtering. Though collaborative filtering shows good performance for predicting users preference, there are some conditions where collaborative filtering cannot be applied. Sparsity in user data causes problems in comparing users. Systems which are newly starting or companies having small number of users are also hard to apply collaborative filtering. Content-based filtering should be used to support this conditions, but content-based filtering has some drawbacks and weakness which are tendency of recommending similar items, and keeping history of a user makes recommendation simple and not able to follow up users preference changes. To overcome this drawbacks and limitations, we suggest weighted window assisted user history based recommendation system, which captures user’s purchase patterns and applies them to window weight adjustment. The system is capable of following current preference of a user, removing useless recommendation and suggesting items which cannot be simply found by users. To examine the performance under user and data sparsity environment, we applied data from start-up trading company. Through the experiments, we evaluate the operation of the proposed recommendation system.
Read moreEffects of Expression Recognition with Machine and Deep Learning Algorithms on Psychotherapy
This study presents a comparative analysis of the classification performance of facial and emotion recognition systems using Machine Learning (ML) and Deep Learning (DL) algorithms. The primary objective of this work is to evaluate the applicability of emotion recognition in fields such as psychotherapy and crime analysis, using the FER-2013 dataset.The study was conducted with ML algorithms such as Support Vector Machines (SVM), Random Forest (RF), K-Nearest Neighbor (KNN), Decision Trees, and Gradient Boosting, as well as the DL algorithm, Convolutional Neural Network (CNN). Supported by the application of feature selection, preprocessing, and feature extraction techniques, the model’s performance was measured using standard metrics such as accuracy, precision, F1-score, and AUC-ROC.The experimental results showed that the highest classification accuracy (46.61%) was achieved with the CNN model. While the ML models generally offered lower accuracy, they provided advantages in terms of computational efficiency in specific scenarios.This study aims to contribute to the literature by providing a comparative analysis of ML and DL algorithms and by highlighting the effect of data preprocessing on performance. The findings set targets for future work, such as real-time system integration and hybrid model development.
Read more