• Home
  • Search
  • Feature-Interaction-Enhanced Sequential Transformer for Click-Through Rate Prediction
  • Cite Icon1
  • https://doi.org/10.3390/app14072760Copy DOI Icon

Feature-Interaction-Enhanced Sequential Transformer for Click-Through Rate Prediction

Show More
  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Click-through rate (CTR) prediction plays a crucial role in online services and applications, such as online shopping and advertising. The performance of CTR prediction can have a direct impact on user experience and the revenue of the online platforms. For CTR prediction models, self-attention-based methods have been widely applied to this field. Recent works generally adopted the Transformer architecture, where the self-attention mechanism can capture the global dependencies of the user’s historical interactions and predict the next item. Despite the effectiveness of self-attention methods in modeling sequential user behaviors, most sequential recommenders hardly exploit feature interaction techniques to extract high-order feature combinations. In this paper, we propose a Feature-Interaction-Enhanced Sequence Model (FESeq), which integrates feature interaction and the sequential recommendation model in a cascading structure. Specifically, the interacting layer in FESeq is an automatic feature engineering step for the Transformer model. Then, we add a linear time interval embedding layer and a positional embedding layer to the Transformer in the sequence-refiner layer to learn both the time intervals and the position information in the user’s sequence behaviors. We also design an attention-based sequence pooling layer that can model the relevance of the user’s historical behaviors and the target item representation through scaled bilinear attention. Our experiments show that the proposed method beats all the baselines on both public and industrial datasets.

Loading PDF

Similar Papers
  • Conference Article
  • Citations95

An Embedding Learning Framework for Numerical Features in CTR Prediction

  • Aug 14, 2021
  • Huifeng Guo +5
  • PDF
  • Research Article
  • Citations4

A Dual Adaptive Interaction Click-Through Rate Prediction Based on Attention Logarithmic Interaction Network

  • Dec 15, 2022
  • Entropy
  • Shiqi Li +2
  • Book Chapter
  • Citations3

MCRF: Enhancing CTR Prediction Models via Multi-channel Feature Refinement Framework

  • Jan 01, 2022
  • Fangye Wang +5
  • Conference Article
  • Citations60

MiNet

  • Oct 19, 2020
  • Wentao Ouyang +7
  • PDF
  • Research Article
  • Citations11

XGBDeepFM for CTR Predictions in Mobile Advertising Benefits from Ad Context

  • Apr 27, 2020
  • Mathematical Problems in Engineering
  • Han An +1
  • Preprint Article

A Unsupervised graph comparison learning-based click-through rate prediction model

  • Jul 19, 2024
  • Research Square
  • Mingxiang He +3
  • Conference Article
  • Citations102

Open Benchmarking for Click-Through Rate Prediction

  • Oct 26, 2021
  • Jieming Zhu +4
  • Conference Article
  • Citations4

Enhancing CTR Prediction through Sequential Recommendation Pre-training: Introducing the SRP4CTR framework

  • Oct 21, 2024
  • Ruidong Han +6
  • Conference Article
  • Citations20

Looking at CTR Prediction Again: Is Attention All You Need?

  • Jul 11, 2021
  • Yuan Cheng +1
  • Research Article
  • Citations91

FinalMLP: An Enhanced Two-Stream MLP Model for CTR Prediction

  • Jun 26, 2023
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Kelong Mao +5
  • Research Article
  • Citations7

A knowledge distillation-based deep interaction compressed network for CTR prediction

  • Jun 08, 2023
  • Knowledge-Based Systems
  • Fei Guan +2
  • Conference Article
  • Citations36

Deep Time-Aware Item Evolution Network for Click-Through Rate Prediction

  • Oct 19, 2020
  • Xiang Li +5
  • Conference Article
  • Citations2

Time-aware Multi-layer Interest Extraction Network for Click-Through Rate Prediction

  • Mar 01, 2022
  • Guoan Wang +1
  • Research Article
  • Citations7

Exploring different interaction among features for CTR prediction

  • May 10, 2022
  • Soft Computing
  • Leilei Yang +2
  • Conference Article
  • Citations1

Context-Aware Modeling via Simulated Exposure Page for CTR Prediction

  • Jul 18, 2023
  • Xiang Li +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.