• Home
  • Search
  • ELEC: Efficient Large Language Model-Empowered Click-Through Rate Prediction
  • Cite Icon1
  • https://doi.org/10.1145/3726302.3730188Copy DOI Icon

ELEC: Efficient Large Language Model-Empowered Click-Through Rate Prediction

  • Jul 13, 2025
  • Rui Dong +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Click-through rate (CTR) prediction plays an important role in online advertising systems. On the one hand, traditional CTR prediction models capture the collaborative signals in tabular data via feature interaction modeling, but they lose semantics in text. On the other hand, Large Language Models (LLMs) excel in understanding the context and meaning behind text, but they face challenges in capturing collaborative signals and they have long inference latency. In this paper, we aim to leverage the benefits of both types of models and pursue collaboration, semantics and efficiency. We present ELEC, which is an Efficient LLM-Empowered CTR prediction framework. We first adapt an LLM for the CTR prediction task. In order to leverage the ability of the LLM but simultaneously keep efficiency, we utilize the pseudo-siamese network which contains a gain network and a vanilla network. We inject the high-level representation vector generated by the LLM into a collaborative CTR model to form the gain network such that it can take advantage of both tabular modeling and textual modeling. However, its reliance on the LLM limits its efficiency. We then distill the knowledge from the gain network to the vanilla network on both the score level and the representation level, such that the vanilla network takes only tabular data as input, but can still generate comparable performance as the gain network. Our approach is model-agnostic. It allows for the integration with various existing LLMs and collaborative CTR models. Experiments on real-world datasets demonstrate the effectiveness and efficiency of ELEC for CTR prediction.

Similar Papers
  • Conference Article
  • Citations59

Deep Spatio-Temporal Neural Networks for Click-Through Rate Prediction

  • Jul 25, 2019
  • Wentao Ouyang +6
  • Research Article
  • Citations7

Decision-Making Context Interaction Network for Click-Through Rate Prediction

  • Jun 26, 2023
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Xiang Li +6
  • Conference Article
  • Citations1

STEC: See-Through Transformer-based Encoder for CTR Prediction

  • Apr 05, 2025
  • Serdarcan Dilbaz +1
  • PDF
  • Research Article
  • Citations4

A Dual Adaptive Interaction Click-Through Rate Prediction Based on Attention Logarithmic Interaction Network

  • Dec 15, 2022
  • Entropy
  • Shiqi Li +2
  • Conference Article
  • Citations79

Improving Ad Click Prediction by Considering Non-displayed Events

  • Nov 03, 2019
  • Bowen Yuan +6
  • Conference Article
  • Citations4

AIE: Auction Information Enhanced Framework for CTR Prediction in Online Advertising

  • Oct 08, 2024
  • Yang Yang +8
  • Conference Article
  • Citations93

An Embedding Learning Framework for Numerical Features in CTR Prediction

  • Aug 14, 2021
  • Huifeng Guo +5
  • Research Article

Beyond KAN: Introducing KarSein for Adaptive High-Order Feature Interaction Modeling in CTR Prediction

  • Feb 28, 2026
  • ACM Transactions on Information Systems
  • Yunxiao Shi +4
  • PDF
  • Conference Article
  • Citations240

Field-weighted Factorization Machines for Click-Through Rate Prediction in Display Advertising

  • Jan 01, 2018
  • Junwei Pan +6
  • Conference Article
  • Citations26

ClickPrompt: CTR Models are Strong Prompt Generators for Adapting Language Models to CTR Prediction

  • May 13, 2024
  • Jianghao Lin +9
  • Conference Article
  • Citations8

Position Awareness Modeling with Knowledge Distillation for CTR Prediction

  • Sep 13, 2022
  • Congcong Liu +7
  • Conference Article
  • Citations1

Graph Isomorphism Network-Based Cohort Modeling In Click-Through Rate Prediction

  • Jul 13, 2025
  • Xuan Ma +8
  • Conference Article
  • Citations6

Discrete Semantic Tokenization for Deep CTR Prediction

  • May 13, 2024
  • Qijiong Liu +5
  • Research Article
  • Citations1073

Deep Interest Evolution Network for Click-Through Rate Prediction

  • Jul 17, 2019
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Guorui Zhou +7
  • Research Article
  • Citations25

Deep Field Relation Neural Network for click-through rate prediction

  • Jun 29, 2021
  • Information Sciences
  • Dafang Zou +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.