Quantifying construct validity: two simple measures.

Major changes in thinking about validity have occurred during the past century, shifting the focus in thinking from the validity of the test to the validity of test score interpretations. These changes have resulted from the 'new' thinking about validity in which construct validity has emerged as the central or unifying idea of validity today. Construct validity was introduced by Cronbach and Meehl in the mid-1950s in an attempt to address the validity of those many psychological concepts that have no clear referent in reality. To do this, construct validity theory required a nomological network--an elaborate theoretical network of constructs and observations connected by scientific laws--to validate the constructs. However, nomological networks are hard to come by and none that would do the job required by construct validity has been forthcoming to date. Thus, the current construct validity approach has retreated to one of simply 'interpretation and argument', but this seems to be too general to tie down the constructs in the way a nomological network would do to give credibility to the validity of the construct. As a result, the concept of validity seems to have been watered down and the credibility of validity claims weakened. The purpose of this paper is to encourage a discussion of the use of construct validity in medical education, and to suggest that test developers and users reconsider the use of abstract theoretical constructs that have no referent apart from theory. We present a critical review of these concerns about construct validity and provide for contrast a brief overview of a recently proposed view of measurement based on scientific realism and causality analysis.

On Issues of Validity and Especially on the Misery of Convergent Validity

Although problem-based learning (PBL) has been widely used in medical schools, few studies have attended to the assessment of PBL processes using validated instruments. This study examined reliability and validity for an instrument assessing PBL performance in four domains: Problem Solving, Use of Information, Group Process, and Professionalism. Two cohorts of medical students (N = 310) participated in the study, with 2 years of PBL evaluation data extracted from archive rated by a total of 158 faculty raters. Analyses based on generalizability theory were conducted for reliability examination. Validity was examined through following the Standards for Educational and Psychological Testing to evaluate content validity, response processes, construct validity, predictive validity, and the relationship to the variable of training. For construct validity, correlations of PBL scores with six other outcome measures were examined, including Medical College Admission Test, United States Medical Licensing Examination (USMLE) Step 1, National Board of Medical Examiners (NBME) Comprehensive Basic Science Examination, NBME Comprehensive Clinical Science Examination, Clinical Performance Examination, and USMLE Step 2 Clinical Knowledge. Predictive validity was examined by using PBL scores to predict five medical school outcomes. The highest percentage of PBL total score variance was associated with students (60 %), indicating students in the study differed in their PBL performance. The generalizability and dependability coefficients were moderately high (Ep(2) = .68, ϕ = .60), showing the instrument is reliable for ranking students and identifying competent PBL performers. The patterns of correlations between PBL domain scores and the outcome measures partially support construct validity. PBL performance ratings as a whole significantly (p < .01) predicted all the major medical school achievements. The second year PBL scores were significantly higher than those of the first year, indicating a training effect. Psychometric findings provided support for reliability and many aspects of validity of PBL performance assessment using the instrument.

The aim of the present study was to adapt the Morningness-Eveningness-Stability Scale improved (MESSi) to the Spanish adolescent population, testing its factor structure and construct validity. The participants were 725 adolescents (52.9% girls; M = 14.8, SD = 1.99) who completed the MESSi, the Morningness Eveningness Scale of Children (MESC), questions about sleep habits adapted from the School Sleep Habits Survey, and self-reported academic performance. The psychometric results support a three-factor model with the factors of morning affect, eveningness, and distinctness, which show good internal consistency. The pattern of correlations between MESSi and the other measures was in the expected direction. The MESC correlated positively with morning affect and negatively with eveningness, whereas distinctness was uncorrelated. Boys reported higher morningness, whereas girls reported higher distinctness. Eveningness was negatively related to academic performance. Overall, the results support the validity and reliability of the Spanish adolescent version of the MESSi.

A disease-specific quality of life questionnaire is not available for patients with periampullary carcinoma, although cancer-specific questionnaires and the Gastrointestinal Quality of Life Index (GIQLI) have been used. The aim of this study was to validate the GIQLI for patients with periampullary tumours and to evaluate if subscales of the GIQLI could be identified to allow a more detailed assessment of the patients' quality of life. Patients with periampullary carcinoma, included in a study concerning diagnostic laparoscopy, were asked about symptoms and completed a questionnaire comprising the Medical Outcomes Study (MOS) 24 questionnaire, the GIQLI and one question of the Rotterdam Symptom Check List (RSCL). Clinical interpretation and statistical factor analysis were used to identify subscales of the GIQLI. The GIQLI could be divided into four subscales, measuring physical well-being, mental well-being, digestion and defaecation. All four subscales had a good internal reliability and the construct validity was supported by the pattern of correlations with the MOS and RSCL as well as differences in subscale scores for patients with or without certain symptoms. In patients with periampullary tumours the GIQLI can be divided into four subscales, measuring different aspects of quality of life. These subscales provide insight into the different problems affecting the patient.

Construct validity and sex differences in Cook-Medley hostility

Abstract. Leaves in tropical forests come in an enormous variety of sizes and shapes, each of which can be ultimately viewed as an adaptation to the complex problem of optimising the capture of light for photosynthesis. However, the fact that many different shape "strategies" coexist within a habitat demonstrate that there are many other intrinsic and extrinsic factors involved, such as the differential investment in support tissues required for different leaf lamina shapes. Here, we take a macrogeographic approach to understanding the function of different lamina shape categories. Specifically, we use 106 permanent plots spread across the Amazon rainforest basin to: 1) describe the geographic distribution of some simple metrics of lamina shape in plots from across Amazonia, and; 2) identify and quantify relationships between key environmental parameters and lamina shape in tropical forests. Because the plots are not randomly distributed across the study area, achieving this latter objective requires the use of statistics that can account for spatial auto-correlation. We found that between 60–70% of the 2791 species and 83 908 individual trees in the dataset could be classified as having elliptic leaves (= the widest part of the leaf is on an axis in the middle fifth of the long axis of the leaf). Furthermore, the average Amazonian tree leaf is 2.5 times longer than it is wide and has an entire margin. Contrary to theoretical expectations we found little support for the hypothesis that narrow leaves are an adaptation to dry conditions. However, we did find strong regional patterns in leaf lamina length-width ratios and several significant correlations with precipitation variables suggesting that water availability may be exerting an as yet unrecognised selective pressure on leaf shape of rainforest trees. Some support was found for the hypothesis that narrow leaves are an adaptation to low nutrient soils. Furthermore, we found a strong correlation between the proportion of trees with non-entire laminas (dissected, toothed, etc.) and mean annual temperature once again supporting the well documented association that provides a basis for reconstructing past temperature regimes.

Construct validity involves the evaluation of evidence for the validity of psychological theories and the measures used to test them. It is therefore a central concept in the field of clinical psychology. This entry describes how the process of construct validation works and includes a brief history of validation efforts in clinical psychology as well as current conceptualizations and issues pertaining to this topic.

AB0755 Reliability and Construct Validity of the Psoriasis Symptom Inventory in Subjects with Psoriatic Arthritis

Simple measures and complex structures: Is it worth employing a more complex model of personality in Big Five inventories?

BackgroundPrevious studies have provided the initial evidence for construct validity and test-retest reliability of the Mayo Hip Score. Instruments used for Total Hip Arthroplasty (THA) outcomes assessment should be valid, reliable and responsive to change. Our main objective was to examine the responsiveness to change, association with subsequent revision and the construct validity of the Mayo hip score.MethodsDiscriminant ability was assessed by calculating effect size (ES), standardized response mean (SRM) and Guyatt’s responsiveness index (GRI). Minimal clinically important difference (MCII) and moderate improvement thresholds were calculated. We assessed construct validity by examining association of scores with preoperative patient characteristics and correlation with Harris hip score, and assessed association of scores with the risk of subsequent revision.ResultsFive thousand three hundred seven provided baseline data; of those with baseline data, 2,278 and 2,089 (39 %) provided 2- and 5-year data, respectively. Large ES, SRM and GRI ranging 2.66–2.78, 2.42–2.61 and 1.67–1.88 were noted for Mayo hip scores with THA, respectively. The MCII and moderate improvement thresholds were 22.4–22.7 and 39.4–40.5 respectively. Hazard ratios of revision surgery were higher with lower final score or less improvement in Mayo hip score at 2-years and borderline significant/non-significant at 5-years, respectively: (1) score ≤55 with hazard ratios of 2.24 (95 % CI, 1.45, 3.46; p = 0.0003) and 1.70 (95 % CI, 1.00, 2.92; p = 0.05) of implant revision subsequently, compared to 72-80 points; (2) no improvement or worsening score with hazard ratios 3.94 (95 % CI, 1.50, 10.30; p = 0.005) and 2.72 (95 % CI, 0.85,8.70; p = 0.09), compared to improvement >50-points. Mayo hip score had significant positive correlation with younger age, male gender, lower BMI, lower ASA class and lower Deyo-Charlson index (p ≤ 0.003 for each) and with Harris hip scores (p < 0.001).ConclusionsMayo Hip Score is valid, sensitive to change and associated with future risk of revision surgery in patients with primary THA.Electronic supplementary materialThe online version of this article (doi:10.1186/s12891-016-0868-3) contains supplementary material, which is available to authorized users.

White matter volume predicts reaction time instability

Ideology is a central concept in political psychology. Here, we synthesise the scholarly debate's major themes. We first examine the ways in which ideology has been operationalised and discuss its prevalence (or lack thereof) in the mass public. This is followed by a discussion of the top-down and bottom-up forces that shape citizens' ideology. Top-down processes include political elites and socialisation. Bottom-up processes range from political values, basic human values, and personality to biology and genetics. Finally, we outline steps that we would welcome in the next generation of research on political ideology. These include fundamental questions about the causal relationship between different bottom-up factors and a call for more attention to measurement of key constructs and of open science practices in the study of political ideology. We hope this chapter inspires others and sets the stage for the next generation of research on political ideology.

Lines of Thought addresses how we are able to think about abstract possibilities: How can we think about math, despite the immateriality of numbers, sets, and other mathematical entities? How are we able to think about what might have happened if history had taken a different turn? Questions like these turn up in nearly every part of cognitive science, and they are central to our human position of having only limited knowledge concerning what is or might be true. Because we cannot experience hypothetical or future events or abstract concepts, we cannot use our ordinary sense of perception or memory to think about these subjects, so what underlies our ability to make these assumptions? Lance Rips explores people's beliefs about possibilities as they arise in the context of basic concepts, including numbers, causality, and reasons. He argues that beliefs about these concepts cannot be meaningfully reduced to perceptual information, remembered instances, or probabilities. He also claims that analogies to cognitive perception models are equally unhelpful in understanding what makes thinking of possibilities possible. Instead, he makes the case that our abilities here depend on the intrinsic hardwiring of the human mind. Lines of Thought provides an overview and a point of view on research in higher-level cognitive science, integrating theories from psychology, philosophy, and linguistics. The book is written in an accessible style that will provide students with essential background for their own thoughts about this domain.

Objectives: Flourishing, a central concept in positive psychology, encompasses multifaceted dimensions such as meaning, positive relationships, and engagement. Despite growing research interest, empirical studies focusing specifically on the flourishing of middle school students remain scarce. Given the critical need to promote flourishing among Chinese middle school students, the study aimed to adapt Diener’s Flourishing Scale for Chinese middle school students, examine its psychometric properties, and establish its measurement invariance across gender and time within this population. Methods: Participants were recruited from secondary schools in two Chinese provinces. The Chinese versions of the Flourishing Scale (CFS), along with the Index of Well-being (IWB) and the Satisfaction with Life Scale (SWLS), were employed. Data collection occurred in three phases, the first two for exploratory factor analysis (EFA) and confirmatory factor analysis (CFA), respectively, and the last one for testing longitudinal measurement invariance and gender measurement invariance. Results: The CFS demonstrated excellent discrimination and consistency with Diener’s original model. Significant positive correlations emerged between the CFS scores and well-being (r = 0.75, p < 0.01) as well as life satisfaction (r = 0.74, p < 0.01). Cronbach’s α was 0.948, and the Pearson correlation coefficient (PCC) for test-retest reliability was 0.85 (p < 0.01). The CFS demonstrated strict measurement invariance across both gender and time. Conclusion: The CFS demonstrates robust psychometric properties—including structural validity, reliability, and measurement invariance—for its application among Chinese middle school students.