• Home
  • Search
  • Biased bivariate correlations in combined survey data measured with different instruments
  • Cite Icon2
  • https://doi.org/10.5964/miss.11217Copy DOI Icon

Biased bivariate correlations in combined survey data measured with different instruments

Show More
  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Social scientists increasingly form composite datasets using data from different survey programs, which often use different single-question instruments to measure the same latent construct. This creates an obstacle when we want to run analyses using the combined data, since the scores measured with different instruments are not necessarily comparable. In this paper, we explore one consequence of such comparability problems. Specifically, we examine the case where instruments measuring the same construct have different item difficulties. This means if we applied the instruments to the same population, we would get different mean responses. If such mean differences are not mitigated before combining data, we introduce a mean bias into our composite data. Such mean bias has direct consequences for analyses based on the combined data. In data drawn from the same population, mean bias introduces error variance. In data drawn from different populations it would bias or even invert true population differences. However, in this paper I demonstrate that mean bias can also bias bivariate correlations if one or both variables in a composite dataset are subject to mean bias. If differences in item difficulty are not mitigated before combining data, we introduce a variant of Simpson’s paradox into our data: The bivariate correlation in each source survey might differ substantially from the correlation in the composite dataset. In a set of systematic simulations, I demonstrate this correlation bias effect and show how it changes depending on the mean biases in each variable and the strength of the underlying true correlation.

Loading PDF

Similar Papers
  • Research Article
  • Citations32

Uncalibrated Arterial Pulse Cardiac Output Measurements in Patients With Moderately Abnormal Left Ventricular Function

  • Sep 20, 2010
  • Journal of Cardiothoracic and Vascular Anesthesia
  • Luigi Vetrugno +6
  • Research Article
  • Citations7

DIFFERENTIAL ITEM FUNCTIONING ON THE GRADUATE MANAGEMENT ADMISSION TEST

  • Dec 01, 1993
  • ETS Research Report Series
  • Kathleen A O'Neill +2
  • Research Article

Using parametric logistic item response theory model trees to detect item parameter heterogeneity in a high-stakes reading comprehension test

  • Mar 02, 2026
  • International Journal of Testing
  • Farshad Effatpanah +2
  • Research Article
  • Citations13

An Investigation of Context Effects for Item Randomization within Testlets

  • Apr 01, 2004
  • Journal of Educational Computing Research
  • Mark Pomplun +1
  • PDF
  • Research Article
  • Citations26

Agreement between Two Methods of Dietary Data Collection in Male Adolescent Academy-Level Soccer Players

  • Jul 17, 2015
  • Nutrients
  • Marc A Briggs +4
  • Research Article
  • Citations46

Assessing the goodness of fit of forest models estimated by nonlinear mixed-model methods

  • Dec 01, 2009
  • Canadian Journal of Forest Research
  • Shongming Huang +2
  • Research Article

#2812 Continuous blood pressure monitoring with a finger cuff is unreliable in chronic hemodialysis patients

  • May 23, 2024
  • Nephrology Dialysis Transplantation
  • Sabrine Chaara +5
  • Research Article
  • Citations41

CNN-based fire detection method on autonomous ships using composite channels composed of RGB and IR data

  • Jan 01, 2022
  • International Journal of Naval Architecture and Ocean Engineering
  • Donghyun Kim +1
  • Research Article
  • Citations1

Integrating a randomized controlled trial with a parallel observational cohort study in cervical spine surgery insights from the foraminotomy ACDF cost-effectiveness trial (FACET).

  • Sep 01, 2025
  • The spine journal : official journal of the North American Spine Society
  • Nádia F Simões De Souza +7
  • Research Article
  • Citations57

Oral non-steroidal anti-inflammatory drug therapy for lung disease in cystic fibrosis.

  • Sep 09, 2019
  • Cochrane Database of Systematic Reviews
  • Larry C Lands +1
  • Research Article
  • Citations10

Analysis of the Model Climate Sensitivity Spread Forced by Mean Sea Surface Temperature Biases

  • May 09, 2012
  • Journal of Climate
  • Dietmar Dommenget
  • Research Article

Health-related quality of life in children with traumatic brain injury; relationship between parent–proxy report and child self-report

  • Apr 01, 2010
  • Archives of Disease in Childhood
  • B Hameed +5
  • PDF
  • Research Article

Optimizing 131I-mIBG Dosimetry: Validation of Simplified Time-Point and Segmentation Approaches

  • Nov 25, 2025
  • Nuclear Medicine and Molecular Imaging
  • Sara Kurkowska +4
  • Research Article
  • Citations80

A chemo-ecologists’ practical guide to compositional data analysis

  • Nov 23, 2016
  • Chemoecology
  • Adrian Brückner +1
  • PDF
  • Research Article
  • Citations13

Stock delineation of striped snakehead, Channa striata using multivariate generalised linear models with otolith shape and chemistry data

  • Apr 14, 2021
  • Scientific Reports
  • Salman Khan +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.