• Home
  • Search
  • FetNet: a recurrent convolutional network for occlusion identification in fetoscopic videos
  • Cite Icon19
  • https://doi.org/10.1007/s11548-020-02169-0Copy DOI Icon

FetNet: a recurrent convolutional network for occlusion identification in fetoscopic videos

  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

PurposeFetoscopic laser photocoagulation is a minimally invasive surgery for the treatment of twin-to-twin transfusion syndrome (TTTS). By using a lens/fibre-optic scope, inserted into the amniotic cavity, the abnormal placental vascular anastomoses are identified and ablated to regulate blood flow to both fetuses. Limited field-of-view, occlusions due to fetus presence and low visibility make it difficult to identify all vascular anastomoses. Automatic computer-assisted techniques may provide better understanding of the anatomical structure during surgery for risk-free laser photocoagulation and may facilitate in improving mosaics from fetoscopic videos.MethodsWe propose FetNet, a combined convolutional neural network (CNN) and long short-term memory (LSTM) recurrent neural network architecture for the spatio-temporal identification of fetoscopic events. We adapt an existing CNN architecture for spatial feature extraction and integrated it with the LSTM network for end-to-end spatio-temporal inference. We introduce differential learning rates during the model training to effectively utilising the pre-trained CNN weights. This may support computer-assisted interventions (CAI) during fetoscopic laser photocoagulation.ResultsWe perform quantitative evaluation of our method using 7 in vivo fetoscopic videos captured from different human TTTS cases. The total duration of these videos was 5551 s (138,780 frames). To test the robustness of the proposed approach, we perform 7-fold cross-validation where each video is treated as a hold-out or test set and training is performed using the remaining videos.ConclusionFetNet achieved superior performance compared to the existing CNN-based methods and provided improved inference because of the spatio-temporal information modelling. Online testing of FetNet, using a Tesla V100-DGXS-32GB GPU, achieved a frame rate of 114 fps. These results show that our method could potentially provide a real-time solution for CAI and automating occlusion and photocoagulation identification during fetoscopic procedures.

Loading PDF

Similar Papers
  • Research Article
  • Citations70

Twin‐to‐twin transfusion syndrome after 26 weeks of gestation: is there a role for fetoscopic laser surgery?

  • May 16, 2007
  • BJOG: An International Journal of Obstetrics & Gynaecology
  • Jm Middeldorp +6
  • Research Article
  • Citations23

The value of Doppler ultrasound in the diagnosis and management of twin-to-twin transfusion syndrome.

  • Mar 01, 1994
  • Archives of gynecology and obstetrics
  • Y Ohno +5
  • Research Article
  • Citations47

An analysis of machine learning models for sentiment analysis of Tamil code-mixed data

  • May 28, 2022
  • Computer Speech & Language
  • Kogilavani Shanmugavadivel +6
  • Research Article

WS13: Multiple pregnancy WS13‐01The effect of treatment of twin‐to‐twin transfusion syndrome on the diagnosis to delivery interval

  • Oct 01, 2000
  • Ultrasound in Obstetrics & Gynecology
  • D Skupski +2
  • PDF
  • Research Article
  • Citations6

Energy Expenditure Prediction from Accelerometry Data Using Long Short-Term Memory Recurrent Neural Networks

  • Apr 14, 2024
  • Sensors (Basel, Switzerland)
  • Martin Vibæk +4
  • Conference Article
  • Citations11

A Hybrid CNN-LSTM Architecture for Path Planning of Mobile Robots in Unknow Environments

  • Aug 01, 2020
  • Yan Lu +2
  • Research Article
  • Citations30

CNN-LSTM deep learning based forecasting model for COVID-19 infection cases in Nigeria, South Africa and Botswana.

  • Nov 01, 2022
  • Health and Technology
  • L J Muhammad +3
  • Research Article
  • Citations8

Dynamic Temperature Prediction on High-Speed Angular Contact Ball Bearings of Machine Tool Spindles Based on CNN and Informer

  • Aug 11, 2023
  • Lubricants
  • Hongyu Li +6
  • Research Article
  • Citations9

Balancing Patient Access to Fetoscopic Laser Photocoagulation for Twin-to-Twin Transfusion Syndrome With Maintaining Procedural Competence: Are Collaborative Services Part of the Solution?

  • Apr 18, 2016
  • Twin Research and Human Genetics
  • Andrew G Edwards +6
  • Research Article
  • Citations27

Urban air quality index forecasting using multivariate convolutional neural network based customized stacked long short-term memory model

  • Aug 23, 2024
  • Process Safety and Environmental Protection
  • Sweta Dey
  • Conference Article
  • Citations21

Text Steganalysis with Attentional L STM-CNN

  • May 01, 2020
  • Yongjian Bao +4
  • Conference Article
  • Citations1

Systematic Evaluation of Deep Learning Models for Human Activity Recognition Using Accelerometer

  • Nov 26, 2020
  • Thu-Hien Le +2
  • PDF
  • Supplementary Content
  • Citations14

Computer‐assisted fetal laser surgery in the treatment of twin‐to‐twin transfusion syndrome: Recent trends and prospects

  • Aug 29, 2022
  • Prenatal Diagnosis
  • Anouk Marlon Van Der Schot +3
  • Research Article
  • Citations1

Isolated Ascites in a Monochorionic Twin after Fetoscopic Laser Ablation Is Not Necessarily Secondary to Recurrence or Anaemia: Bowel Complications in Twin-to-Twin Transfusion Syndrome after Fetoscopic Laser Ablation

  • Dec 14, 2018
  • Fetal Diagnosis and Therapy
  • Lee Na Tan +4
  • Conference Article

A CNN+LSTM Based Deep Learning Approach with Lagrange Interpolation for Network Intrusion Detection

  • Jan 10, 2025
  • Zhixuan Huang +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.