• Home
  • Search
  • Pre-Processing of Categorical Features Within Medical Analysis Systems.
  • Cite Icon1
  • https://doi.org/10.3233/shti240520Copy DOI Icon

Pre-Processing of Categorical Features Within Medical Analysis Systems.

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

The complexity of the cancer problem domain presents challenges not only to the medical analysis systems tasked with its analysis, but also to the users of such systems. While it is desirable to assist users in operating these medical analysis systems, prior groundwork is required before this can be achieved, such as recognising patterns in the way users create certain analyses within these systems. In this paper, we use machine learning algorithms to analyse user behaviour patterns and attempt to predict the next user interaction within the CARESS medical analysis system. Since an appropriate pre-processing scheme is essential for the performance of these algorithms, we propose the usage of a Natural Language Processing (NLP)- inspired approach to preserve some semantic cohesion of the mostly categorical features of these user interactions. Furthermore, we propose to use a sliding window that contains information about the latest user interactions in combination with Latent Dirichlet Allocation (LDA) to extract a latent topic from these last interactions and use it as additional input to the machine learning models. We compare this pre-processing scheme with other approaches that utilise one-hot encoding and feature hashing. The results of our experiments show that the sliding window LDA scheme is a promising solution, that performs better for our use case than the other evaluated pre-processing schemes. Overall, our results provide an important piece for further research and development in the area of assisting users in operating analysis systems in complex problem domains.

Similar Papers
  • Conference Article

Research and Application of Medical Service Analysis and Evaluation System based on Big Data Analysis in Hospitals

  • Oct 18, 2024
  • Wanfu Ding +5
  • Conference Article
  • Citations2

Predicting Budget from Transportation Research Grant Description: An Exploratory Analysis of Text Mining and Machine Learning Techniques

  • Oct 01, 2017
  • SHILAP Revista de lepidopterología
  • Ayush Singhal +2
  • Research Article
  • Citations7

Exploring Latent Dirichlet Allocation (LDA) in Topic Modeling: Theory, Applications, and Future Directions

  • Mar 11, 2024
  • NEWPORT INTERNATIONAL JOURNAL OF ENGINEERING AND PHYSICAL SCIENCES
  • Ugorji C Calistus +3
  • PDF
  • Research Article
  • Citations23

The development of the Medical Literature Analysis and Retrieval System (MEDLARS).

  • Oct 01, 2007
  • Journal of the Medical Library Association : JMLA
  • Cheryl Rae Dee
  • Research Article
  • Citations1

METHODS FOR DETERMINING SIMILARITY OF CATEGORICAL ORDERED DATA

  • Jun 29, 2023
  • Radio Electronics Computer Science Control
  • N E Kondruk
  • Research Article
  • Citations21

Use of machine learning in the field of prosthetics and orthotics: A systematic narrative review.

  • Feb 21, 2023
  • Prosthetics & Orthotics International
  • Yoo Jin Choo +1
  • Research Article
  • Citations31

Natural language processing and entrustable professional activity text feedback in surgery: A machine learning model of resident autonomy

  • Nov 26, 2020
  • The American Journal of Surgery
  • Christopher C Stahl +8
  • Research Article
  • Citations4

Guest Editors Introduction: Machine Learning in Speech and Language Technologies

  • Sep 01, 2005
  • Machine Learning
  • Pascale Fung +1
  • Conference Article
  • Citations1

Side channel analysis based on non-profiling singular spectrum analysis

  • Oct 01, 2016
  • Young-Jin Cho +4
  • PDF
  • Research Article
  • Citations19

Glioblastoma Surgery Imaging–Reporting and Data System: Validation and Performance of the Automated Segmentation Task

  • Sep 17, 2021
  • Cancers
  • David Bouget +28
  • Research Article
  • Citations2

Harnessing AI for Climate Change Communication: Analyzing Public Perception through NLP and Machine Learning

  • Apr 22, 2025
  • Sinergi International Journal of Communication Sciences
  • Gohar Rahman +1
  • Research Article
  • Citations46

EVALUATION OF COMMERCIAL ASSAYS FOR DETECTING WEST NILE VIRUS ANTIGEN

  • Mar 01, 2006
  • Journal of the American Mosquito Control Association
  • Kristen L Burkhalter +5
  • Research Article

From Text Tagging to Decision Support

  • Apr 16, 2014
  • Medical Decision Making
  • Harold P Lehmann
  • PDF
  • Research Article
  • Citations2

Trends in COVID-19 Publications: Streamlining Research Using NLP and LDA

  • Jan 01, 2020
  • SSRN Electronic Journal
  • Akash Gupta +3
  • Research Article

AI-Powered Knowledge Graphs for Efficient Medical Information Retrieval and Decision Support

  • Dec 31, 2024
  • Seminars in Medical Writing and Education
  • Santanu Kumar Sahoo +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.