• Home
  • Search
  • Discrete Semantic Tokenization for Deep CTR Prediction
  • Cite Icon6
  • https://doi.org/10.1145/3589335.3651558Copy DOI Icon

Discrete Semantic Tokenization for Deep CTR Prediction

  • May 13, 2024
  • Qijiong Liu +5 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Incorporating item content information into click-through rate (CTR) prediction models remains a challenge, especially with the time and space constraints of industrial scenarios. The content-encoding paradigm, which integrates user and item encoders directly into CTR models, prioritizes space over time. In contrast, the embedding-based paradigm transforms item and user semantics into latent embeddings, subsequently caching them to optimize processing time at the expense of space. In this paper, we introduce a new semantic-token paradigm and propose a discrete semantic tokenization approach, namely UIST, for user and item representation. UIST facilitates swift training and inference while maintaining a conservative memory footprint. Specifically, UIST quantizes dense embedding vectors into discrete tokens with shorter lengths and employs a hierarchical mixture inference module to weigh the contribution of each user-item token pair. Our experimental results on news recommendation showcase the effectiveness and efficiency (about 200-fold space compression) of UIST for CTR prediction.

Similar Papers
  • Conference Article
  • Citations26

ClickPrompt: CTR Models are Strong Prompt Generators for Adapting Language Models to CTR Prediction

  • May 13, 2024
  • Jianghao Lin +9
  • Conference Article
  • Citations1

ELEC: Efficient Large Language Model-Empowered Click-Through Rate Prediction

  • Jul 13, 2025
  • Rui Dong +2
  • Conference Article
  • Citations79

Improving Ad Click Prediction by Considering Non-displayed Events

  • Nov 03, 2019
  • Bowen Yuan +6
  • Conference Article
  • Citations93

An Embedding Learning Framework for Numerical Features in CTR Prediction

  • Aug 14, 2021
  • Huifeng Guo +5
  • Conference Article
  • Citations1

STEC: See-Through Transformer-based Encoder for CTR Prediction

  • Apr 05, 2025
  • Serdarcan Dilbaz +1
  • Research Article

Beyond KAN: Introducing KarSein for Adaptive High-Order Feature Interaction Modeling in CTR Prediction

  • Feb 28, 2026
  • ACM Transactions on Information Systems
  • Yunxiao Shi +4
  • PDF
  • Research Article
  • Citations4

A Dual Adaptive Interaction Click-Through Rate Prediction Based on Attention Logarithmic Interaction Network

  • Dec 15, 2022
  • Entropy
  • Shiqi Li +2
  • Conference Article
  • Citations4

AIE: Auction Information Enhanced Framework for CTR Prediction in Online Advertising

  • Oct 08, 2024
  • Yang Yang +8
  • Conference Article
  • Citations8

Position Awareness Modeling with Knowledge Distillation for CTR Prediction

  • Sep 13, 2022
  • Congcong Liu +7
  • PDF
  • Conference Article
  • Citations240

Field-weighted Factorization Machines for Click-Through Rate Prediction in Display Advertising

  • Jan 01, 2018
  • Junwei Pan +6
  • Conference Article
  • Citations3

PaddleBox: Communication-Efficient TeraByte-Scale Model Training Framework for Online Advertising

  • Dec 17, 2022
  • Weijie Zhao +5
  • Conference Article
  • Citations59

Deep Spatio-Temporal Neural Networks for Click-Through Rate Prediction

  • Jul 25, 2019
  • Wentao Ouyang +6
  • Conference Article
  • Citations1

Graph Isomorphism Network-Based Cohort Modeling In Click-Through Rate Prediction

  • Jul 13, 2025
  • Xuan Ma +8
  • Research Article
  • Citations12

Deep Time-Stream Framework for Click-through Rate Prediction by Tracking Interest Evolution

  • Apr 03, 2020
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Shu-Ting Shi +6
  • Research Article
  • Citations1073

Deep Interest Evolution Network for Click-Through Rate Prediction

  • Jul 17, 2019
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Guorui Zhou +7
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.