• Home
  • Search
  • A Closer Look at Correction for False Discovery Bias When Making Multiple Comparisons
  • Cite Icon3
  • https://doi.org/10.5085/0898-5510-21.1.55Copy DOI Icon

A Closer Look at Correction for False Discovery Bias When Making Multiple Comparisons

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

A recent article in this journal by Tabak (2006) highlighted a potentially serious source of bias that can arise when multiple statistical tests of a damages theory are performed and even one test rejecting the null hypothesis is regarded as supporting the damages theory. Repeated testing will eventually produce a “false discovery,” that is, rejection of the null hypothesis in favor of the alternative hypothesis when the null hypothesis is true, which statisticians refer to as type I error. Consequently, performing multiple tests without adjusting the critical value can be problematical because it can lead to improperly accepting statistical evidence that apparently supports rejection of the null hypothesis as reliable when it is not. Tabak (2006) recommends making the Sidak (1968, 1971) multiple-comparison adjustment to the standard statistical t-test to correct for the false-discovery bias inherent in multiple-comparison testing. In particular, he recommends making this adjustment when performing 10b-5 securities fraud event studies when more than one corrective disclosure date is involved. This article clarifies the circumstances in which a multiple-comparison adjustment is appropriate and explains why the correction is normally not needed in securities fraud event-study testing. More generally, I explain why it is not required when each of several tests is performed and its results are reported separately, as for example, where the objective is simply to test the statistical significance of the abnormal stock return on each day on which a new and distinct curative disclosure occurred. I show that the Sidak multiple-comparison adjustment is nearly as stringent as the classical Bonferroni procedure (Simes, 1986), which can increase the risk of type II error. This article discusses a more powerful alternative to the Sidak adjustment due to Benjamini and Hochberg (1993), which directly corrects for the false-discovery bias in multiple-comparison testing and reduces the risk of type II error. II. Application of Multiple-Comparison Adjustments to Securities Fraud Event Studies Multiple-comparison-false-discovery bias can arise when (a) several statistical tests are performed on subsets of the same larger data set in an effort to

Similar Papers
  • Front Matter
  • Citations31

Facts and Fictions About Handling Multiple Comparisons.

  • Aug 01, 2021
  • Journal of Graduate Medical Education
  • Gail M Sullivan +1
  • Research Article

The Impact of Firm-level Characteristics on Stock Abnormal Returns amid Crises in Egypt versus the United States

  • Jul 01, 2024
  • International Journal of Accounting and Management Sciences
  • Rania Pasha +1
  • Research Article

THE DYNAMICS OF THE CAPITAL MARKET: AN ANALYSIS OF PRE- AND POST-COVID-19 DEVELOPMENTS IN INDONESIA

  • Mar 31, 2025
  • Reviu Accounting, Business & Organizations
  • Larkana Sari +1
  • Research Article

Signaling the Characteristics of Business Combinations and Abnormal Stock Returns

  • Jan 01, 2025
  • BAR - Brazilian Administration Review
  • Juliane Pacheco +1
  • Research Article
  • Citations57

Online talk: does it matter?

  • May 09, 2008
  • Managerial Finance
  • Sanjiv Sabherwal +2
  • PDF
  • Research Article
  • Citations4

Lombok’s Tsunami and Stock Abnormal Returns

  • Feb 24, 2021
  • Accounting Analysis Journal
  • Ani Wilujeng Suryani +1
  • Research Article

The Effects of Annual Accounting Data on Stock Returns and Trading Activity: A Causal Model Study

  • Sep 01, 1987
  • Journal of the American Statistical Association
  • David A Ziebart
  • Conference Article

Financial Analysts’ Forecasts, Uncertainty and Abnormal Returns: Evidence from US REITs Geographic Concentration

  • Jan 01, 2019
  • Saadallah Zaiter +2
  • PDF
  • Research Article
  • Citations1

Market Reaction to The Announcement of General Election Result of The President and Vice President of Indonesia in 2019 (Study on LQ 45 Stock Index on The Indonesia Stock Exchange)

  • Jan 01, 2020
  • European Journal of Business and Management
  • Gede Pujaastawan +1
  • Research Article
  • Citations10

Deceptive advertising and abnormal stock returns

  • Jan 01, 2011
  • International Journal of Advertising
  • Jaeseok Jeong +1
  • Research Article
  • Citations131

Using Twitter trust network for stock market analysis

  • Jan 31, 2018
  • Knowledge-Based Systems
  • Yefeng Ruan +2
  • Research Article
  • Citations55

Prenatal Exposure to General Anesthesia and Childhood Behavioral Deficit.

  • Jan 22, 2021
  • Anesthesia and analgesia
  • Caleb Ing +6
  • Research Article
  • Citations1

How Political situation affected Major Stock’s Abnormal Return in Indonesia

  • Feb 26, 2021
  • Jurnal Pasar Modal dan Bisnis
  • Lufthia Sevriana +1
  • Research Article
  • Citations23

Introduction of a new critical p value correction method for statistical significance analysis of metabonomics data

  • Sep 13, 2013
  • Analytical and Bioanalytical Chemistry
  • Bo Wang +3
  • Research Article
  • Citations13

The Leverage Effect on Stock Returns

  • Oct 11, 2010
  • SSRN Electronic Journal
  • Sheeja Sivaprasad +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.