• Home
  • Search
  • HISP: Heterogeneous Image Signal Processor Pipeline Combining Traditional and Deep Learning Algorithms Implemented on FPGA
  • Cite Icon5
  • https://doi.org/10.3390/electronics12163525Copy DOI Icon

HISP: Heterogeneous Image Signal Processor Pipeline Combining Traditional and Deep Learning Algorithms Implemented on FPGA

Show More
  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

To tackle the challenges of edge image processing scenarios, we have developed a novel heterogeneous image signal processor (HISP) pipeline combining the advantages of traditional image signal processors and deep learning ISP (DLISP). Through a multi-dimensional image quality assessment (IQA) system integrating deep learning and traditional methods like RankIQA, BRISQUE, and SSIM, various partitioning schemes were compared to explore the highest-quality imaging heterogeneous processing scheme. The UNet-specific deep-learning processing unit (DPU) based on a field programmable gate array (FPGA) provided a 14.67× acceleration ratio for the total network and for deconvolution and max pool, the calculation latency was as low as 2.46 ms and 97.10 ms, achieving an impressive speedup ratio of 46.30× and 36.49× with only 4.04 W power consumption. The HISP consisting of a DPU and the FPGA-implemented traditional image signal processor (ISP) submodules, which scored highly in the image quality assessment system, with a single processing time of 524.93 ms and power consumption of only 8.56 W, provided a low-cost and fully replicable solution for edge image processing in extremely low illumination and high noise environments.

Loading PDF

Similar Papers
  • Conference Article
  • Citations1

Issue Based OCR Error Prediction in Video Streams

  • Sep 23, 2020
  • Dirk Siegmund +2
  • Conference Article
  • Citations62

Image quality assessment and human visual system

  • Jul 11, 2010
  • Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE
  • Xinbo Gao +3
  • Conference Article
  • Citations3

DAF: differential ACE filtering image quality assessment by automatic color equalization

  • Jan 27, 2008
  • Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE
  • S Ouni +3
  • Research Article
  • Citations14

A ParaBoost stereoscopic image quality assessment (PBSIQA) system

  • Feb 28, 2017
  • Journal of Visual Communication and Image Representation
  • Hyunsuk Ko +2
  • Conference Article

<title>High-volume image quality assessment systems: tuning performance with an interactive data visualization tool</title>

  • Mar 25, 1999
  • Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE
  • Patricia A Bresnahan +2
  • Research Article
  • Citations1

A fully automated, expert-perceptive image quality assessment system for whole-body [18F]FDG PET/CT

  • Apr 18, 2025
  • EJNMMI Research
  • Cong Zhang +9
  • Research Article
  • Citations4

Facial Image Verification and Quality Assessment System -FaceIVQA

  • Dec 01, 2013
  • International Journal of Electrical and Computer Engineering (IJECE)
  • Omidiora E O +5
  • Conference Article
  • Citations2

Towards Accurate and Efficient Image Quality Assessment with Interest Points

  • Apr 01, 2015
  • Xiang Zhang +3
  • Research Article
  • Citations32

An artificial intelligence-driven image quality assessment system for whole-body [18F]FDG PET/CT.

  • Dec 19, 2022
  • European Journal of Nuclear Medicine and Molecular Imaging
  • Chi Qi +7
  • Conference Article

An Image Denoising Algorithm Based On Image Quality Assessment

  • Oct 01, 2020
  • Hainan Zhang +1
  • Research Article
  • Citations79

Deep learning for quality assessment of retinal OCT images.

  • Nov 04, 2019
  • Biomedical optics express
  • Jing Wang +7
  • Research Article

PENILAIAN KUALITI IMEJ DIGITAL BERDASARKAN KAEDAH CIRI-CIRI SISTEM PENGLIHATAN MANUSIA DAN PRINSIP STRUKTUR IMEJ

  • May 30, 2016
  • Jurnal Teknologi
  • Bahbibi Rahmatullah +1
  • Dissertation

Application of OpenCL to FPGA-based systems in EPICS. Contribution to the standardization of advanced instrumentation systems for Big Science experiments

  • Mar 15, 2024
  • Miguel Astrain Etxezarreta
  • Conference Article
  • Citations6

Active learning for magnetic resonance image quality assessment

  • Mar 01, 2016
  • Annika Liebgott +4
  • Research Article
  • Citations26

IQAGPT: computed tomography image quality assessment with vision-language and ChatGPT models

  • Aug 05, 2024
  • Visual Computing for Industry, Biomedicine, and Art
  • Zhihao Chen +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.