• Home
  • Search
  • Learning Program Semantics with Code Representations: An Empirical Study
  • Open Access IconOpen Access
  • Cite Icon48
  • https://doi.org/10.1109/saner53432.2022.00073Copy DOI Icon

Learning Program Semantics with Code Representations: An Empirical Study

  • Mar 1, 2022
  • Jing Kai Siow +4 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Program semantics learning is the core and fundamental for various code intelligent tasks e.g., vulnerability detection, clone detection. A considerable amount of existing works propose diverse approaches to learn the program semantics for different tasks and these works have achieved state-of-the-art performance. However, currently, a comprehensive and systematic study on evaluating different program representation techniques across diverse tasks is still missed. From this starting point, in this paper, we conduct an empirical study to evaluate different program representation techniques. Specifically, we categorize current mainstream code representation techniques into four categories i.e., Feature-based, Sequence-based, Tree-based, and Graph-based program representation technique and evaluate its performance on three diverse and popular code intelligent tasks i.e., Code Classification, Vulnerability Detection, and Clone Detection on the public released benchmark. We further design three research questions (RQs) and conduct a comprehensive analysis to investigate the performance. By the extensive experimental results, we conclude that (1) The graph-based representation is superior to the other selected techniques across these tasks. (2) Compared with the node type information used in tree-based and graph-based representations, the node textual information is more critical to learning the program semantics. (3) Different tasks require the task-specific semantics to achieve their highest performance, however combining various program semantics from different dimensions such as control dependency, data dependency can still produce promising results.

Similar Papers
  • Research Article
  • Citations18

Survey of source code vulnerability analysis based on deep learning

  • Sep 03, 2024
  • Computers & Security
  • Chen Liang +4
  • Research Article
  • Citations4

On the impact of multiple source code representations on software engineering tasks — An empirical study

  • Dec 27, 2023
  • Journal of Systems and Software
  • Karthik Chandra Swarna +3
  • Conference Instance

Proceedings of the 3rd Textgraphs Workshop on Graph-Based Algorithms for Natural Language Processing - TextGraphs '08

  • Jan 01, 2008
  • PDF
  • Research Article
  • Citations6

TCCCD: Triplet-Based Cross-Language Code Clone Detection

  • Nov 06, 2023
  • Applied Sciences
  • Yong Fang +3
  • Research Article
  • Citations1

Neural Methods for Programming: A Comprehensive Survey and Future Directions

  • Nov 16, 2025
  • Applied Sciences
  • Gebremedhin Gebreslassie Maru +4
  • PDF
  • Research Article
  • Citations5

Learning and Fusing Multi-View Code Representations for Function Vulnerability Detection

  • Jun 01, 2023
  • Electronics
  • Zhenzhou Tian +3
  • Research Article
  • Citations40

Vulnerability Detection via Multiple-Graph-Based Code Representation

  • Aug 01, 2024
  • IEEE Transactions on Software Engineering
  • Fangcheng Qiu +5
  • Research Article

PVDetector: Pretrained Vulnerability Detection on Vulnerability-enriched Code Semantic Graph

  • Sep 19, 2025
  • ACM Transactions on Software Engineering and Methodology
  • Jiayuan Li +5
  • Conference Article
  • Citations12

Rule-directed code clone synchronization

  • May 01, 2016
  • Xiao Cheng +4
  • PDF
  • Research Article
  • Citations1

A Novel Source Code Representation Approach Based on Multi-Head Attention

  • May 29, 2024
  • Electronics
  • Lei Xiao +5
  • Research Article
  • Citations15

Vulnerability detection through cross-modal feature enhancement and fusion

  • Jun 18, 2023
  • Computers & Security
  • Wenxin Tao +4
  • Research Article
  • Citations6

A Smart Contract Vulnerability Detection Model Based on Syntactic and Semantic Fusion Learning

  • Feb 03, 2023
  • Wireless Communications and Mobile Computing
  • Daojun Han +3
  • Research Article

An Empirical Study on the Characteristics of Reusable Code Clones

  • Jan 23, 2026
  • ACM Transactions on Software Engineering and Methodology
  • Chunli Yu +3
  • Conference Article
  • Citations1

Research on the Tools of Clone Code Refactoring

  • Jan 12, 2019
  • Zhao Fengrong +2
  • Conference Article
  • Citations7

Determining Degree of Relevance of Reviews Using a Graph-Based Text Representation

  • Nov 01, 2011
  • Lakshmi Ramachandran +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.