• Home
  • Search
  • Application of multimodal deep learning using radar and water level data for water level prediction
  • https://doi.org/10.5194/egusphere-egu23-5818Copy DOI Icon

Application of multimodal deep learning using radar and water level data for water level prediction

  • May 15, 2023
  • Seongsim Yoon +2 more
Show More
  • Abstract
  • Literature Map
  • Similar Papers
Abstract

In general, water level prediction models using deep learning techniques have been developed using time-series water level observation data from upstream water level stations and target water level stations even though many of physical data are necessary to predict water level. The changes of the water level are greatly affected by rainfall in the basin, therefore rainfall information is needed to more accurately predict the water level. In particular, radar data has the advantage of being able to directly acquire the amount of rainfall occurring within a watershed. This study aims to develop the multimodal deep learning model to predict the water level using 2D grid radar rainfall data and 1D time-series water level observation data. This study proposed two multimodal deep learning models which have different structures. Both multimodal deep learning models predict the water level by simultaneously using the observed water level data up to the present time and the radar rainfall data that affects the water level in the future. The first proposed model consists of a deep learning network that links 2D Average Pooling (AvgPool2D), which compresses 2D radar data to 1D data, and Long Short-Term Memory (LSTM), which predicts 1D time series water level data. The second proposed model consists of a deep learning network that predicts water levels by linking Conv2DLSTM and LSTM, which can reflect the characteristics of 2D radar data without deformation.  The two proposed multimodal deep learning models were learned and evaluated in the upper basin of Hantan River. In addition, it was compared with the results of single-modal LSTM using only water level data. There are three water level stations in the study area, and the objective was to predict the water level of the downstream station up to 180 minutes in advance. For learning and verification of the deep learning model, 10-minute water level and radar rainfall data were collected from May 2019 to October 2021. For the radar data used as input, the grid data included in the target watershed were extracted and used among composite radar data with a resolution of 1 km operating by Ministry of Environment. As a result of evaluating each learned deep learning model, two multimodal models had higher prediction accuracy than the single-modal using only water level data. In particular, second proposed model (Conv2dLSTM+LSTM) had better predictive performance than first proposed model (AvgPool2D+LSTM) at the time of the sudden rise in water level due to rainfall.AcknowledgmentsResearch for this paper was carried out under the KICT Research Program (project no. 202200175-001, Development of future-leading technologies solving water crisis against to water disasters affected by climate change) funded by the Ministry of Science and ICT.

Similar Papers
  • Research Article
  • Citations14

Predicting microvascular invasion in hepatocellular carcinoma with a CT- and MRI-based multimodal deep learning model.

  • Mar 03, 2024
  • Abdominal radiology (New York)
  • Yan Lei +10
  • Research Article
  • Citations6

Multi-modal deep learning for automated assembly of periapical radiographs

  • Jun 21, 2023
  • Journal of Dentistry
  • L Pfänder +5
  • Research Article
  • Citations2

Analysis of Time Series Water Level Data Prediction Using Deep Learning Method at the Water Gate of DKI Jakarta Water Resources Office

  • Aug 25, 2023
  • Jurnal Indonesia Sosial Sains
  • Supriyade Supriyade +3
  • Research Article
  • Citations6

Multimodal deep learning model for prediction of breast cancer recurrence risk and correlation with oncotype DX

  • Jan 01, 2025
  • Breast Cancer Research : BCR
  • Ruixin Zhang +7
  • Research Article
  • Citations11

PSMA PET/CT based multimodal deep learning model for accurate prediction of pelvic lymph-node metastases in prostate cancer patients identified as candidates for extended pelvic lymph node dissection by preoperative nomograms.

  • Jan 27, 2025
  • European journal of nuclear medicine and molecular imaging
  • Qiaoke Ma +10
  • PDF
  • Research Article
  • Citations16

Prediction of central venous catheter-associated deep venous thrombosis in pediatric critical care settings

  • Nov 27, 2021
  • BMC Medical Informatics and Decision Making
  • Haomin Li +6
  • Research Article
  • Citations24

Predicting Obstructive Sleep Apnea Based on Computed Tomography Scans Using Deep Learning Models.

  • Jul 15, 2024
  • American journal of respiratory and critical care medicine
  • Jeong-Whun Kim +7
  • PDF
  • Research Article
  • Citations23

Improving Air Pollution Prediction System through Multimodal Deep Learning Model Optimization

  • Oct 15, 2022
  • Applied Sciences
  • Kyung-Kyu Ko +1
  • Research Article
  • Citations15

WavFace: A Multimodal Transformer-Based Model for Depression Screening.

  • May 01, 2025
  • IEEE journal of biomedical and health informatics
  • Ricardo Flores +3
  • PDF
  • Research Article
  • Citations13

Exploring the Effect of Meteorological Factors on Predicting Hourly Water Levels Based on CEEMDAN and LSTM

  • Sep 07, 2023
  • Water
  • Zihuang Yan +2
  • Research Article
  • Citations22

Multimodal deep learning model on interim [18F]FDG PET/CT for predicting primary treatment failure in diffuse large B-cell lymphoma.

  • Aug 27, 2022
  • European Radiology
  • Cheng Yuan +7
  • Research Article
  • Citations7

Multicenter Development and Validation of a Multimodal Deep Learning Model to Predict Moderate to Severe AKI.

  • Apr 15, 2025
  • Clinical journal of the American Society of Nephrology : CJASN
  • Jay L Koyner +8
  • Research Article

A multimodal deep learning model for predicting impending rupture in symptomatic abdominal aortic aneurysms using CTA and clinical data.

  • Jan 01, 2026
  • Frontiers in cardiovascular medicine
  • Jiaxin Cheng +9
  • Abstract

Development of a deep learning model using multimodal data for dementia diagnosis

  • Dec 01, 2025
  • Alzheimer's & Dementia
  • Hee Won Yang +2
  • Research Article
  • Citations1

The sarcopenia artificial intelligence diagnostic decision support system (SAID DSS) – a multimodal deep learning model

  • Jan 26, 2026
  • BMC Geriatrics
  • Kristoffer Kittelmann Brockhattingen +7
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.