• Home
  • Search
  • Bridging between Soft and Hard Thresholding by Scaling
  • Cite Icon4
  • https://doi.org/10.1587/transinf.2021edp7223Copy DOI Icon

Bridging between Soft and Hard Thresholding by Scaling

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

In this article, we developed and analyzed a thresholding method in which soft thresholding estimators are independently expanded by empirical scaling values. The scaling values have a common hyper-parameter that is an order of expansion of an ideal scaling value that achieves hard thresholding. We simply call this estimator a scaled soft thresholding estimator. The scaled soft thresholding is a general method that includes the soft thresholding and non-negative garrote as special cases and gives an another derivation of adaptive LASSO. We then derived the degree of freedom of the scaled soft thresholding by means of the Stein's unbiased risk estimate and found that it is decomposed into the degree of freedom of soft thresholding and the reminder connecting to hard thresholding. In this meaning, the scaled soft thresholding gives a natural bridge between soft and hard thresholding methods. Since the degree of freedom represents the degree of over-fitting, this result implies that there are two sources of over-fitting in the scaled soft thresholding. The first source originated from soft thresholding is determined by the number of un-removed coefficients and is a natural measure of the degree of over-fitting. We analyzed the second source in a particular case of the scaled soft thresholding by referring a known result for hard thresholding. We then found that, in a sparse, large sample and non-parametric setting, the second source is largely determined by coefficient estimates whose true values are zeros and has an influence on over-fitting when threshold levels are around noise levels in those coefficient estimates. In a simple numerical example, these theoretical implications has well explained the behavior of the degree of freedom. Moreover, based on the results here and some known facts, we explained the behaviors of risks of soft, hard and scaled soft thresholding methods.

Similar Papers
  • Research Article
  • Citations117

Wavelet denoising techniques with applications to experimental geophysical data

  • Aug 27, 2008
  • Signal Processing
  • Albert C To +2
  • Conference Article
  • Citations3

Performance Improvement of Wavelet Noise Reduction Based on New Threshold Function

  • Oct 15, 2020
  • Shiqi Yu +5
  • Conference Article
  • Citations1

A TE Process Fault Diagnosis Method Based on Improved Wavelet Threshold Denoising and Principal Component Analysis

  • Dec 01, 2018
  • Xingang Wang +1
  • Research Article
  • Citations19

Research of an Improved Wavelet Threshold Denoising Method for Transformer Partial Discharge Signal

  • Feb 01, 2013
  • Journal of Multimedia
  • Fucheng You +1
  • Research Article
  • Citations101

A wavelet-based method for improving signal-to-noise ratio and contrast in MR images

  • Feb 01, 2000
  • Magnetic Resonance Imaging
  • M.E Alexander +6
  • Conference Article
  • Citations2

A Boosted Wavelet Improvement Thresholding Algorithm Based on Birgé- Massart Strategy for Pipeline Leakage Signal Noise Reduction Processing

  • Jul 08, 2022
  • Jianfeng Gao +4
  • Book Chapter
  • Citations2

Restraining EMI of Displacement Sensors Based on Wavelet Fuzzy Threshold Denoising

  • Dec 17, 2020
  • Yuting Zhang +3
  • Preprint Article
  • Citations1

SURE-based Automatic Parameter Selection For ESPIRiT Calibration

  • Nov 14, 2018
  • S Sundar Kumar Iyer +4
  • Conference Article
  • Citations1

Adaptive Slow-time Singular Value Thresholding (SVT) based on Stein's Unbiased Risk Estimate (SURE) for Ultrasound Image Random Noise Reduction

  • Sep 07, 2020
  • Iason Zacharias Apostolakis +5
  • Conference Article
  • Citations56

A Comparative Study of Wavelet Denoising for Multifunction Myoelectric Control

  • Mar 01, 2009
  • A Phinyomark +2
  • Research Article
  • Citations3

Bayesian estimation for mean vector of multivariate normal distribution on the linear and nonlinear exponential balanced loss based on wavelet decomposition

  • Aug 26, 2024
  • International Journal of Wavelets, Multiresolution and Information Processing
  • Ziba Batvandi +2
  • Research Article

The Research of Infrared Image Denoising Algorithm Based on Curvelet Transform

  • Dec 01, 2014
  • Applied Mechanics and Materials
  • Wei Bo Yu +3
  • Research Article
  • Citations8

Order thresholding

  • Aug 01, 2010
  • The Annals of Statistics
  • Min Hee Kim +1
  • Conference Article
  • Citations2

Recursive Evaluation of Sure for Total Variation Denoising

  • Apr 01, 2018
  • Feng Xue +3
  • Research Article
  • Citations1

On estimation and prediction of geostatistical regression models via a corrected Stein's unbiased risk estimator

  • Oct 04, 2016
  • Environmetrics
  • Hong-Ding Yang +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.