• Home
  • Search
  • Collective Support Recovery for Multi-Design Multi-Response Linear Regression
  • Cite Icon30
  • https://doi.org/10.1109/tit.2014.2375328Copy DOI Icon

Collective Support Recovery for Multi-Design Multi-Response Linear Regression

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

The multi-design multi-response linear regression problem is investigated, in which design matrices are Gaussian with covariance matrices Σ (1:K) = (Σ (1) , ... , 1 (K) ) for K linear regression tasks. Design matrices across tasks are assumed to be independent. The support union of K p-dimensional regression vectors (collected as columns of matrix B*) is recovered using l 1 /l 2 -regularized lasso. Sufficient and necessary conditions on sample complexity are characterized as a sharp threshold to guarantee successful recovery of the support union. This model has been previously studied via l 1 /l ∞ -regularized lassoand via l 1 /l 1 + l 1 /l ∞ -regularized lasso, in which sharp threshold on sample complexity is characterized only for K = 2 and under special conditions. In this paper, using l 1 /l 2 -regularized lasso, sharp threshold on sample complexity is characterized under standard regularization conditions. Namely, if n > c p1 ψ(B*, Σ (1:K) ) log(p - s) where c p1 is a constant, and s is the size of the support set, then l 1 /l 2 -regularized lasso correctly recovers the support union; and if n <; c p2 ψ(B*, Σ (1:K) )log(p - s) where c p2 is a constant, then l 1 /l 2 -regularized lasso fails to recover the support union. In particular, the function ψ(B*, Σ (1:K) ) captures the impact of the sparsity of K regression vectors and the statistical properties of the design matrices on the threshold on sample complexity. Therefore, such threshold function also demonstrates the advantages of joint support union recovery using multitask lasso over individual support recovery using single-task lasso.

Similar Papers
  • Conference Article
  • Citations16

Model selection: Two fundamental measures of coherence and their algorithmic significance

  • Jun 01, 2010
  • Waheed U Bajwa +2
  • PDF
  • Research Article
  • Citations12

Rank bounds for design matrices with block entries and geometric applications

  • Mar 12, 2018
  • Discrete Analysis
  • Zeev Dvir +3
  • Research Article
  • Citations8

Sandwich algorithms for Bayesian variable selection

  • Aug 02, 2014
  • Computational Statistics &amp; Data Analysis
  • Joyee Ghosh +1
  • Research Article
  • Citations115

Why Gabor frames? Two fundamental measures of coherence and their role in model selection

  • Aug 01, 2010
  • Journal of Communications and Networks
  • Waheed U Bajwa +2
  • Research Article
  • Citations28

Short-term wind speed prediction based on feature extraction with Multi-task Lasso and Multilayer Perceptron

  • Mar 27, 2022
  • Energy Reports
  • Hui Wang +1
  • Research Article
  • Citations75

Multiple Comparison of Several Linear Regression Models

  • Jun 01, 2004
  • Journal of the American Statistical Association
  • Wei Liu +2
  • Research Article
  • Citations11

Subsurface characterization with localized ensemble Kalman filter employing adaptive thresholding

  • Apr 21, 2014
  • Advances in Water Resources
  • Ebrahim Biniaz Delijani +2
  • Research Article
  • Citations5

Interpretation of hybrid generative/discriminative algorithms

  • Oct 01, 2008
  • Neurocomputing
  • Jing-Hao Xue +1
  • Research Article

Prediction of Rice Production to Support Food Security in Bogor Regency using Linear Regression and Support Vector Machine (SVM)

  • Apr 01, 2024
  • Jurnal Teknika
  • Ani Apriani +2
  • Research Article
  • Citations1

Quantum Non-Markovianity via the Covariance Matrix

  • Jun 08, 2018
  • International Journal of Theoretical Physics
  • Yajing Fan +3
  • Research Article
  • Citations4

Properties of Separable Covariance Matrices and Their Associated Gaussian Random Processes

  • Sep 01, 1984
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • C W Therrien +1
  • Research Article
  • Citations1

A communication-efficient method for ℓ0 regularization linear regression models

  • Aug 25, 2022
  • Journal of Statistical Computation and Simulation
  • Lican Kang +4
  • Research Article

Needs and influencing factors of patients with cerebrovascular disease and their caregivers in rural areas

  • Feb 28, 2017
  • Int J Cerebrovasc Dis
  • Chunru Wang +8
  • Research Article
  • Citations15

A Model-free Variable Screening Method Based on Leverage Score

  • Jun 20, 2021
  • Journal of the American Statistical Association
  • Wenxuan Zhong +2
  • Research Article
  • Citations93

Modelling and investigating the impacts of climatic variables on ozone concentration in Malaysia using correlation analysis with random forest, decision tree regression, linear regression, and support vector regression

  • Mar 19, 2022
  • Chemosphere
  • Abdul-Lateef Balogun +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.