• https://doi.org/10.1145/2967938.2974055Copy DOI Icon

POSTER

  • Sep 11, 2016
  • Tsung Tai Yeh +4 more
Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Massively multithreaded GPUs achieve high throughput by running thousands of threads in parallel. To fully utilize the hardware, contemporary workloads spawn work to the GPU in bulk by launching large tasks, where each task is a kernel that contains thousands of threads that occupy the entire GPU.GPUs face severe underutilization and their performance benefits vanish if the tasks are narrow, i.e., they contain less than 512 threads. Latency-sensitive applications in network, signal, and image processing that generate a large number of tasks with relatively small inputs are examples of such limited parallelism. Recognizing the issue, CUDA now allows 32 simultaneous tasks on GPUs; however, that still leaves significant room for underutilization.This paper presents Pagoda, a runtime system that virtualizes GPU resources, using an OS-like daemon kernel called MasterKernel. Tasks are spawned from the CPU onto Pagoda as they become available, and are scheduled by the MasterKernel at the warp granularity. This level of control enables the GPU to keep scheduling and executing tasks as long as free warps are found, dramatically reducing underutilization. Experimental results on real hardware demonstrate that Pagoda achieves a geometric mean speedup of 2.44x over PThreads running on a 20-core CPU, 1.43x over CUDA-HyperQ, and 1.33x over GeMTC, the state-of-the-art runtime GPU task scheduling system.

Similar Papers
  • Conference Article
  • Citations44

Design and implementation of efficient multiplier using vedic mathematics

  • Jan 01, 2011
  • J.M Rudagi +4
  • Research Article
  • Citations5

Introduction to the issue on Adaptive Sparse Representation of Data and Applications in Signal and Image Processing

  • Sep 01, 2011
  • IEEE Journal of Selected Topics in Signal Processing
  • Jean-Luc Starck +4
  • Research Article

On efficient computation of rational {1,2}-pseudo-inverses for multivariable rational matrix-valued functions and their applications

  • Aug 17, 2022
  • Mechanical Systems and Signal Processing
  • Yossi Peretz
  • Research Article

Wavelet Transform and Its Applications in Image Processing and Signal Analysis

  • Mar 15, 2026
  • International Journal For Multidisciplinary Research
  • Ramesh Aharwal +1
  • Research Article
  • Citations4

Radix‐4 3 based two‐dimensional FFT architecture with efficient data reordering scheme

  • Dec 04, 2018
  • IET Computers & Digital Techniques
  • Kala S +3
  • Research Article

2019 4th International Conference on Intelligent Computing and Signal Processing (ICSP 2019)

  • Jun 01, 2019
  • Journal of Physics: Conference Series
  • Research Article
  • Citations1

Neuro-Symbolic AI for Advanced Signal and Image Processing: A Review of Recent Trends and Future Directions

  • Jan 01, 2025
  • IEEE Access
  • Ricardo Fitas
  • Conference Article
  • Citations48

An Accurate GPU Performance Model for Effective Control Flow Divergence Optimization

  • May 01, 2012
  • Zheng Cui +3
  • Conference Article
  • Citations23

Boosting sphere decoding speed through Graphic Processing Units

  • Apr 01, 2010
  • Muhammad S Khairy +2
  • Research Article
  • Citations114

A fast globally optimal algorithm for template matching using low-resolution pruning

  • Apr 01, 2001
  • IEEE Transactions on Image Processing
  • M Gharavi-Alkhansari
  • Research Article
  • Citations71

A Maximum Entropy Solution of the Covariance Extension Problem for Reciprocal Processes

  • Sep 01, 2011
  • IEEE Transactions on Automatic Control
  • Francesca P Carli +3
  • Research Article
  • Citations11

Design of maximally flat IIR filters with flat group delay responses

  • Jan 26, 2008
  • Signal Processing
  • Xi Zhang
  • Research Article
  • Citations5

Characterization of nematic liquid crystals for nonlinear optical applications

  • Oct 01, 1990
  • Applied Physics B Photophysics and Laser Chemistry
  • R Neubecker +2
  • Book Chapter
  • Citations10

CBR for the Reuse of Image Processing Knowledge: a Recursive Retrieval/Adaptation Strategy

  • Jan 01, 1999
  • Valérie Ficet-Cauchard +2
  • Research Article
  • Citations5

An area-delay efficient single-precision floating-point multiplier for VLSI systems

  • Feb 21, 2023
  • Microprocessors and Microsystems
  • Anuradha +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.