• Home
  • Search
  • Efficient Incremental Cooccurrence Analysis for Item-Based Collaborative Filtering
  • Cite Icon2
  • https://doi.org/10.1145/3335783.3335784Copy DOI Icon

Efficient Incremental Cooccurrence Analysis for Item-Based Collaborative Filtering

  • Jul 23, 2019
  • Sebastian Schelter +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Recommender systems are ubiquitous in the modern internet, where they help users find items they might like. A widely deployed recommendation approach is item-based collaborative filtering. This approach relies on analyzing large item cooccurrence matrices that denote how many users interacted with a pair of items. The potentially quadratic number of items to compare poses a scalability bottleneck in analyzing such item cooccurrences. Additionally, this problem intensifies in real world use cases with incrementally growing datasets, especially when the recommendation model is regularly recomputed from scratch. We highlight the connection between the growing cost of item-based recommendation and densification processes in common interaction datasets. Based on our findings, we propose an efficient incremental algorithm for item-based collaborative filtering based on cooccurrence analysis. This approach restricts the number of interactions to consider from 'power users' and 'ubiquitous items' to guarantee a provably constant amount of work per user-item interaction to process. We discuss efficient implementations of our algorithm on a single machine as well as on a distributed stream processing engine, and present an extensive experimental evaluation. Our results confirm the asymptotic benefits of the incremental approach. Furthermore, we find that our implementation is an order of magnitude faster than existing open source recommender libraries on many datasets, and at the same time scales to high dimensional datasets which these existing recommenders fail to process.

Similar Papers
  • Research Article
  • Citations2

Distributed and parallel processing for real-time and dynamic spatio-temporal graph

  • Nov 18, 2019
  • World Wide Web
  • Junhua Fang +5
  • Conference Article
  • Citations2

Recommender Systems for Sustainable Development through Responsible Nudging

  • Nov 08, 2025
  • Mehrdad Rostami +6
  • Research Article
  • Citations1

Real world use of sutimlimab in patients with cold agglutinin disease: An international study

  • Nov 03, 2025
  • Blood
  • Bruno Fattizzo +35
  • Research Article
  • Citations1

Real-time state management techniques using RocksDB: A high-performance approach to scalable stream processing

  • Jun 30, 2024
  • International Journal of Science and Research Archive
  • Sandeep Pamarthi
  • Research Article
  • Citations4

Intra- and Inter-group Optimal Transport for User-Oriented Fairness in Recommender Systems

  • Mar 24, 2024
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Zhongxuan Han +7
  • Abstract

295 - Real world use of treatments in interstitial cystitis/painful bladder syndrome: Outcome of an online survey

  • Jul 01, 2020
  • European Urology Open Science
  • K Garba +5
  • Research Article
  • Citations1

A field evaluation of the Italian “Automated reverse directory assistance” service

  • Mar 01, 1997
  • International Journal of Speech Technology
  • Cristina Delogu +3
  • Research Article

Abstract P1-08-28: Real world use of OncotypeDx testing in the management of breast cancer. The North East England experience

  • Feb 15, 2022
  • Cancer Research
  • Abigail Gault +2
  • Research Article

Real world outcomes in patients with acquired thrombotic thrombocytopenic purpura (TTP) treated with caplacizumab

  • Nov 03, 2025
  • Blood
  • Jawria Tufail +2
  • Research Article
  • Citations35

Nicotine levels, withdrawal symptoms, and smoking reduction success in real world use: A comparison of cigarette smokers and dual users of both cigarettes and E-cigarettes

  • Nov 09, 2016
  • Drug and Alcohol Dependence
  • Douglas E Jorenby +3
  • Research Article
  • Citations8

Continuous Glucose Monitoring in the Real World Using Photosurveillance of #Dexcom on Instagram: Exploratory Mixed Methods Study.

  • May 24, 2019
  • JMIR public health and surveillance
  • Michelle L Litchman +5
  • Research Article
  • Citations2

Cyber Physical Recommender Systems for IoT Based Applications

  • Jan 01, 2020
  • American Journal of Science, Engineering and Technology
  • Anagha Neelkanth Chaudhari
  • Research Article
  • Citations29

A Personalized Recommender System from Probabilistic Relational Model and Users’ Preferences

  • Jan 01, 2014
  • Procedia Computer Science
  • Rajani Chulyadyo +1
  • Research Article

Interpretable Recommendation System Based on Knowledge Map Features

  • Mar 01, 2020
  • IOP Conference Series: Materials Science and Engineering
  • Hongyu Chen +2
  • Conference Article
  • Citations52

Data Poisoning Attack against Recommender System Using Incomplete and Perturbed Data

  • Aug 14, 2021
  • Hengtong Zhang +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.