Supporting Self-Directed Learning: Development of a Faculty Evaluation Scale

ObjectivesThis study aimed to explore the views and expectations of medical students and faculty members on blended learning following university-wide teaching reforms, focusing on its influence on self-directed learning (SDL)...

Objective:The objective of this survey was to explore the attitudes towards plagiarism of faculty members and medical students in Pakistan. Methods:The attitudes toward plagiarism questionnaire (ATPQ) was modified and distributed among 550 medical students and 130 faculty members in 7 medical colleges of Lahore and Rawalpindi. Data was entered in the SPSS v.20 and descriptive statistics were analyzed. The questionnaire was validated by principal axis factoring analysis. Results:Response rate was 93% and 73% respectively. Principal axis factoring analysis confirmed one factor structure of ATPQ in the present sample. It had an acceptable Cronbach’s alpha value of 0.73. There were 421 medical students (218 (52%) female, 46% 3rd year MBBS students, mean age of 20.93 ± 1.4 years) and 95 faculty members (54.7% female, mean age 34.5 ± 8.9 years). One fifth of the students (19.7%) trained in medical writing (19.7%), research ethics (25.2%) or were currently involved in medical writing (17.6%). Most of the faculty members were demonstrators (66) or assistant professors (20) with work experience between 1-10 years. Most of them had trained in medical writing (68), research ethics (64) and were currently involved in medical writing (64). Medical students and faculty members had a mean score of 43.21 (7.1) and 48.4 (5.9) respectively on ATPQ. Most of the respondents did not consider that they worked in a plagiarism free environment and reported that self-plagiarism should not be punishable in the same way as plagiarism. Opinion regarding leniency in punishment of younger researchers who were just learning medical writing was divided. Conclusions:The general attitudes of Pakistani medical faculty members and medical students as assessed by ATPQ were positive. We propose training in medical writing and research ethics as part of the under and post graduate medical curriculum.

A classic topic in the fields of psychometrics and measurement has been the impact of the number of scale categories on test score reliability. This study builds on previous research by further articulating the relationship between item response theory (IRT) and classical test theory (CTT). Equations are presented for comparing the reliability and precision of scores within the CTT and IRT frameworks. This study presented new results pertaining to the relative precision (i.e., the test score conditional standard error of measurement for a given trait value) of CTT and IRT, and the new results shed light on the conditions where total scores and IRT estimates are more or less precisely measured. The relative reliability of CTT and IRT scores is examined as a function of item characteristics (e.g., locations, category thresholds, and discriminations) and subject characteristics (e.g., the skewness and kurtosis of the latent distribution). CTT total scores were more reliable when the latent distribution was mismatched with category thresholds, but the discrepancy between CTT and IRT declined as the number of scale categories increased. This article also considered the appropriateness of linear approximations of polytomous items and presented circumstances where linear approximations are viable. A linear approximation may be appropriate for items with two response options depending on the item discrimination and the match between the item location and latent distribution. However, linear approximations are biased whenever items are located in the tails of the latent distribution and the bias is larger for more discriminating items.

Little research has investigated the establishment of norms for nursing students' self-directed learning (SDL) ability, recognized as an important capability for professional nurses. An item response theory (IRT) approach was used to establish norms for SDL abilities valid for the different nursing programs in Taiwan. The purposes of this study were (a) to use IRT with a graded response model to reexamine the SDL instrument, or the SDLI, originally developed by this research team using confirmatory factor analysis and (b) to establish SDL ability norms for the four different nursing education programs in Taiwan. Stratified random sampling with probability proportional to size was used. A minimum of 15% of students from the four different nursing education degree programs across Taiwan was selected. A total of 7,879 nursing students from 13 schools were recruited. The research instrument was the 20-item SDLI developed by Cheng, Kuo, Lin, and Lee-Hsieh (2010). IRT with the graded response model was used with a two-parameter logistic model (discrimination and difficulty) for the data analysis, calculated using MULTILOG. Norms were established using percentile rank. Analysis of item information and test information functions revealed that 18 items exhibited very high discrimination and two items had high discrimination. The test information function was higher in this range of scores, indicating greater precision in the estimate of nursing student SDL. Reliability fell between .80 and .94 for each domain and the SDLI as a whole. The total information function shows that the SDLI is appropriate for all nursing students, except for the top 2.5%. SDL ability norms were established for each nursing education program and for the nation as a whole. IRT is shown to be a potent and useful methodology for scale evaluation. The norms for SDL established in this research will provide practical standards for nursing educators and students in Taiwan.

There is a worldwide focus on the early development of collaborative skills in medical students as reflected in the design of the medicine program at the University of New South Wales, Australia. Integral to the success of student-centered curricula, is early development of students' self-directed and collaborative learning skills. The purpose of this innovative assessment is to develop and assess students' skills in self-directed and collaborative learning while they concurrently engage with stage-appropriate content knowledge. The educational design of the group projects allows junior medical students to work collaboratively to develop a deep understanding of the concepts and principles of a clinical scenario. Students are required to integrate and apply knowledge from different disciplines and share their learning with a wider peer group through appropriate peer teaching strategies. Two variants of these group projects are described in this resource, and generic versions of student and assessor instructions are included as Appendices A and B. Feedback on the projects collected over the last 7 years has been positive. Students begin to see the relevance and benefits of learning together and appreciate the impact this has on the quality of their learning. They also begin to appreciate the relevance of collaborative skills to their future practice as doctors. The group projects are based on well-established educational principles, and the templates provided in the appendices can be adapted by other medical educators.

Introduction: Listening, the first language skill developed by many children, serves as the basis of subsequent language skills. In addition, listening comprehension skills affect reading success in many different groups such as typically developing readers, children with learning disabilities and children with specific language disorders. The purpose of this research is to adapt the listening comprehension measurement tool to Turkish culture. Method: The purpose of this study is to examine the psychometric properties of the measurement tool within the framework of item response theory (IRT) through two-parameter logistic model (2PLM). Among model assumptions, confirmatory factor analysis (CFA) for unidimensionality Q3 statistics and item characteristic curve for the monotonic increase assumption showing the response probabilities conditional to the ability continuum were examined, respectively. The results for the assumptions were satisfactory. Then, general model-data fit, item-based model-data fit, discrimination parameters, difficulty parameters and information functions were examined with factor loadings. Findings: The results showed that item parameters were in the expected ranges in practical applications, and test information function peaked at lower ability level similar to the original measurement tool. Examining factor loadings, except the 23rd item, the remaining satisfied the generally acceptable cut-off point. Findings based on the model tests to find out the contribution of this item showed that it would be appropriate to include it in the measurement tool so as to keep the other items of associated with story block. Moreover, marginal reliability coefficient shows that the measurement results were highly reliable. Discussion: It was concluded that sufficient evidence of validity and reliability was obtained for one-dimensional structure of 36-item form of the measurement tool.

In this paper, we studied the effect over time of agomelatine, an antidepressant drug administered in patient with major depressive disorder, through item response theory (IRT), taking into account a strong placebo effect and missing not at random. We also assessed the informativeness of the HAMD-17 scale's item. The data includes five phase III clinical trials sponsored by Servier Institute, totalling 1549 patients followed during a maximum of 1year. At each observation, individual scores for the 17 items of the HAMD scale were recorded. The probability for each score was modelled with IRT. A non-linear mixed effects model was used to describe the evolution of the disease and was coupled with a time to event model to predict dropout. Clinical trial simulations were then used to compare placebo and active treatment. Informativeness of each item was evaluated using the Fisher information theory. The best model combined an IRT model, a longitudinal model for underlying depression which describes the remission and then a possible relapse, and a hazard model for dropout depending on the evolution from baseline. The drug effect was best modelled as an effect on the remission and the relapse phases. The median predicted drop in HAMD between baseline and 6weeks was 8.8 (90% PI, 8.3-9.2) when on placebo and 13.1 (90% PI, 12.8-13.4) when treated. Nine items were found to be the most informative. The IRT framework allowed to characterise the evolution of depression with time and estimate the effect of agomelatine, as well as the link between symptoms and disease.

This article proposes a general mixture item response theory (IRT) framework that allows for classes of persons to differ with respect to the type of processes underlying the item responses. Through the use of mixture models, nonnested IRT models with different structures can be estimated for different classes, and class membership can be estimated for each person in the sample. If researchers are able to provide competing measurement models, this mixture IRT framework may help them deal with some violations of measurement invariance. To illustrate this approach, we consider a two-class mixture model, where a person’s responses to Likert-scale items containing a neutral middle category are either modeled using a generalized partial credit model, or through an IRTree model. In the first model, the middle category (“neither agree nor disagree”) is taken to be qualitatively similar to the other categories, and is taken to provide information about the person’s endorsement. In the second model, the middle category is taken to be qualitatively different and to reflect a nonresponse choice, which is modeled using an additional latent variable that captures a person’s willingness to respond. The mixture model is studied using simulation studies and is applied to an empirical example.

Test equating is a statistical procedure to ensure that scores from differenttest forms can be used interchangeably. There are several methodologiesavailable to perform equating, some of which are based on the Classical TestTheory (CTT) framework and others are based on the Item Response Theory (IRT)framework. This article compares equating transformations originated from threedifferent frameworks, namely IRT Observed-Score Equating (IRTOSE), KernelEquating (KE), and IRT Kernel Equating (IRTKE). The comparisons were made underdifferent data-generating scenarios, which include the development of a noveldata-generation procedure that allows the simulation of test data withoutrelying on IRT parameters while still providing control over some test scoreproperties such as distribution skewness and item difficulty. Our resultssuggest that IRT methods tend to provide better results than KE even when thedata are not generated from IRT processes. KE might be able to providesatisfactory results if a proper pre-smoothing solution can be found, while alsobeing much faster than IRT methods. For daily applications, we recommendobserving the sensibility of the results to the equating method, minding theimportance of good model fit and meeting the assumptions of the framework.

This study explored the reflective experiences of three teachers using formative feedback to support the development of learner autonomy and lifelong learning skills. The reflective narrative explores the evolving journey and experiences of three teachers to support learners’ development of self-directed and independent learning skills to enable learning autonomy in an Institute of Technology and Polytechnic (ITP) in New Zealand. This study adopts an introspective-reflective method to report three contextual reflections of three teachers/facilitators to support self-directed and independent learning for undergraduate and postgraduate learners. The findings show specific examples of how each teacher adopted formative feedback to support independent and self-directed learning to enhance learning. The authors’ contribution adds to the growing body of guidance for teachers and facilitators on how to use formative feedback in ways that empower learners rather than directing them – striking a balance that nurtures learners without undermining original ideas or creative intent.

At a time when workplace skills are rapidly evolving, continuous learning is increasingly important, and the responsibility for learning has shifted from others (parents, schools, teachers, employers) to individuals. Self-directed learning (SDL) can help learner-earners thrive in a skills-based economy. Competency-based education (CBE) is well suited to appeal to self-directed learners and to scaffold learner self-direction; however, existing research on the relationship between SDL and CBE programs is limited. This chapter uses case studies of the experiences of two self-directed learners in a CBE program to explore the role of self-direction in their learning journeys. The key takeaways are that (1) self-direction can have a strong impact on learner success and (2) CBE programs are uniquely positioned to support self-directed learners. The chapter concludes with a discussion of considerations for future research.

The Mini-Mental State Examination (MMSE) is a 30-item, dichotomously scored test of general cognition. A number of benefits could be gained by modeling the MMSE in an item response theory (IRT) framework, as opposed to the currently used classical additive approach. However, the test, which is built from groups of items related to separate cognitive subdomains, may violate a key assumption of IRT: local item independence. This study aimed to identify the most appropriate measurement model for the MMSE: a unidimensional IRT model, a testlet response theory model, or a bifactor model. Local dependence analysis using nationally representative data showed a meaningful violation of the local item independence assumption, indicating multidimensionality. In addition, the testlet and bifactor models displayed superior fit indices over a unidimensional IRT model. Statistical comparisons showed that the bifactor model fit MMSE respondent data significantly better than the other models considered. These results suggest that application of a traditional unidimensional IRT model is inappropriate in this context. Instead, a bifactor model is suggested for future modeling of MMSE data as it more accurately represents the multidimensional nature of the scale. (PsycINFO Database Record

Vision-Specific Quality-of-Life Research: A Need to Improve the Quality

Standard procedures for equating tests, including those based on item response theory (IRT), require item responses from large numbers of examinees. Such data may not be forthcoming for reasons theoretical, political, or practical. Information about items' operating characteristics may be available from other sources, however, such as content and format specifications, expert opinion, or psychological theories about the skills and strategies required to solve them. This paper shows how, in the IRT framework, collateral information about items can be exploited to augment or even replace examinee responses when linking or equating new tests to established scales. The procedures are illustrated with data from the Pre-Professional Skills Test (PPST).

While much has been written about science education from pre-K through to postgraduate study, interaction with science and technology does not stop when schooling ends. Moving beyond scholarship on conventional education, this book extends the research and provides an original in-depth look at adult and lifelong learning in science and technology. By identifying the knowledge and skills that individuals need to engage in self-directed learning, the book highlights how educators can best support adult learners beyond the years of formal schooling. Through case studies and empirical analysis, the authors offer a research-based exploration of adults’ self-directed learning and provide tools to support adults’ learning experiences in a wide range of environments while being inclusive of all educational backgrounds.