Hard Impact: Journal Impact Factor and JMT

Impact Factors and Other Measures of a Journal's Influence

The Institute for Scientific Information (ISI) publishes annually listings of impact factors of scientific journals, based upon data extracted from the Science Citation Index (SCI). The impact factor of a journal is defined as the average number of citations given in a specific year to documents published in that journal in the two preceding years, divided by the number of “citable” documents published in that journal in those 2 years. This article presents evidence that for a considerable number of journals the values of the impact factors published in ISI's Journal Citation Reports (JCR) are inaccurate, particularly for several journals having a high impact factor. The inaccuracies are due to an inappropriate definition of citable documents. Document types not defined by ISI as citable (particularly letters and editorials) are actually cited and do contribute to the citation counts of a journal. We present empirical data in order to assess the degree of inaccuracy due to this phenomenon. For several journals the results are striking. We propose to calculate for a journal impact factors per type of document rather than one single impact factor as given currently in the JCR. © 1995 John Wiley & Sons, Inc.

The decision of which journals researchers submit their manuscripts to is based on a range of factors, including the quality of reviews, acceptance probability, turnaround time, target audience and fit, but an increasing one is the journal's reputation or perceived ‘quality’ as most commonly currently quantified by its impact factor.1 In an earlier editorial, it was argued that the impact factor, although not without flaws, provides a reasonable ball park assessment of the journal's impact or usefulness.2 It was, however, suggested that a small array of metrics would be more appropriate and could include a second citation metric that included citations to textbooks (are papers from the journal being used to provide evidence for undergraduate and postgraduate texts?), a download metric (how many people are reading the articles?) and a journal's acceptance rate.2 Because of its recognised flaws, new citation metrics are being introduced to rival the impact factor3-7 and these new metrics have been highlighted by their use in recent international Government research assessments.7 For example, Elsevier's Scopus database, which provides the citation metrics SCImago Journal Ranking Indicator and CiteScore, has been used in a number of national assessment exercises, including the UK Research Excellence Framework (2014), The Excellence in Research for Australia (ERA) assessments (2010, 2012, 2015), the Italian Abilitazione Scientifica Nazionale's researcher assessment (2012, 2013) and the Portuguese Fundação para a Ciência e aTecnologia (FCT) assessment (2013/14).7 In light of these developments, it is timely to describe the various citation metrics and consider what is the most appropriate metric(s) for a clinical journal such as Ophthalmic & Physiological Optics (OPO). The most well-known, currently used citation metric is the Thomson-Reuters (now Clarivate Analytics) Institute of Scientific Information (ISI)'s 2-year journal impact factor.2, 8-10 The 2016 impact factor was calculated by the number of citations to the journal's articles published in 2014 and 2015, divided by the number of ‘papers’ published in the journal during those years. Only citations from journals that are included in Clarivate's Journal Citation Reports (JCR) on the online subscription-based service Web of Science (previously Web of Knowledge) count. This severely limits what is counted as a citation, although it could be argued that this keeps the quality of citations high. The denominator includes research papers (original articles, review papers, etc.) and does not include editorials, letters and news items, but JCR citations to all articles count (including those to editorials and letters). Case reports appear to be judged on a journal-by-journal basis by Web of Science, sometimes they are included in the denominator (and as they are rarely cited, this would lower impact factors) and sometimes not. This lack of transparency is also a flaw in the use of the impact factor and it is difficult to predict impact factors as it is not easy to forecast which documents will be included in calculations and which will not. OPO has an impact factor of 2.30 with 290 citations in 2014 and 2015 to 126 research papers (290/126 = 2.30). Web of Science also provides several other citation metrics, including an immediacy index, a 5-year impact factor and an Eigenfactor score (see Table 1).3 The 2016 immediacy index was determined by the number of citations in 2016 from papers published in 2016 (for OPO, 57/60 = 0.95) and is heavily dependent on papers published earlier in the year (e.g. the January OPO issue) as the papers published in the later issues (e.g. the November OPO issue) are highly unlikely to be cited in that year, given the lag in time from submission to publication of any papers that could cite a November publication. The immediacy index is sometimes considered an indicator for the following year's impact factor. This also highlights the fact that the 2-year window for impact factors is less (1.5 years?) for papers published in the November and December issues due to this time lag between submission and publication of citing papers. This is another reason why the 2-year impact factor is flawed. The 2016 5-year impact factor was determined by the number of citations in 2016 from papers published in 2011, 2012, 2013, 2014 and 2015 (for OPO, 777/323 = 2.41). It is similar to the 2-year impact factor in that includes citations to editorials and letters in the numerator, but does not count them in the denominator. Web of Science also includes an indicator of the longevity of citations from journals, the journal half-life. This indicates the median age of papers cited in the given year, so that OPO's 2016 cited half-life of 9.9 years, indicates that half of the citations to OPO in 2016 were from papers 9.9 years old or younger. This citation metric is rarely discussed or used, but is a useful indicator of the longevity of papers in a journal. For example, our website includes a list of OPO's classic papers (http://onlinelibrary.wiley.com/journal/10.1111/(ISSN)1475-1313/homepage/classic_papers.htm) that remain relevant and still cited despite being up to 25 years old. The Eigenfactor is produced for Web of Science by Jevin West and Carl Bergstrom at the University of Washington, www.eigenfactor.com).3 It provides 5-year citation data and weights the prestige of citations using an algorithm similar to Google's PageRank, so that citations from high ranking journals such as Nature and Science count more than lower ranking journals. It does not include journal self-citations (e.g. Journal of Cataract & Refractive Surgery citations in Journal of Cataract & Refractive Surgery papers; author self-citations in different journals are counted), which works against highly specialised journals. However, its algorithm attempts to adjust for citation differences between different research fields.3 Unlike impact factors, eigenfactors are based on a total score of citations and are not divided by the number of papers published. This means that if two journals have the same impact factor, but one publishes 1000 papers per year and the other 500 papers, the former will have twice the eigenfactor. This may be partly because the eigenfactor is provided as a reference for libraries, in that journals can be ranked using a ‘Cost-Effectiveness Search’ based on the citation value per dollar that they provide. From the perspective of libraries, the 1000 paper volume journal provides twice as many articles for their readers compared to a 500 paper journal of equal impact factor. SCImago and CiteScore are the principal citation metrics developed within Elsevier's online subscription-based service Scopus to rival impact factors provided by Clarivate Analytics’ Web of Science.6 SCImago is the most well-established of the Scopus metrics. It is based on 3-year citation data, so that the 2016 SCImago Journal Rank Indicator (JRI) is based on citations in 2016 from papers published in 2013, 2014 and 2015.11 Like Eigenfactors, it weights the prestige of citations using an algorithm similar to Google's PageRank. It also differs from impact factors in that editorials and letters are included in the denominator. This means that journals which include a large number of editorials and letters, such as the Nature and Lancet series of journals, tend to have significantly lower SCImago JRIs (and CiteScores) than would be expected from their impact factors.5 CiteScore is a more recently introduced metric (December 2016) and is similar to SCImago, but differs in that it doesn't weight citations (Table 1). Both SCImago and CiteScore consider ‘documents’ beyond just journal articles, such as books and conference proceedings. Indeed, the Scopus database includes far more (they claim ‘double’) journals than Web of Science. For example, Web of Science includes four optometry journals: Ophthalmic & Physiological Optics, Optometry & Vision Science, Contract Lens & Anterior Eye and Clinical & Experimental Optometry. Scopus includes these four journals, plus the Journal of Optometry and Clinical & Refractive Optometry and Scopus includes a subcategory of optometry journals11 unlike Web of Science where Optometry journals are considered within the Ophthalmology subcategory or Google Scholar which has a joint Ophthalmology and Optometry subcategory.12 Google Scholar provides two citation metrics, the 5-year h-index and 5-year median h-index.12 These h-indices are Journal indices (h-indices can also be calculated for individual researchers and will be the topic for a future editorial). A h-index of N is calculated if N papers published in a journal have been cited N or more times. The median h-index is the median number of times that those N articles have been cited. In these ways the h-index avoids being distorted by one or a small number of very highly cited articles, which is a problem for the other metrics. Another strength is that it provides citations from all sources available on the web and can include citations in textbooks and important websites for example. This is also a potential downfall in that some of those sources are non-scholarly and some citations can be double (or more) counted if they appear in different places on the web. In addition, the h-index is typically driven by the papers in the two earliest years as these have the largest citations, so it provides potentially out-of-date information. For example, Optometry & Vision Science's 2017 h-index of 36 is based on 34 papers from 2012 and 2013, two from 2014 and none from 2015 or 2016. The 2017 h-index is therefore indicating the citation levels of the 2012 and 2013 volumes. It also provides a total score of citations and does not divide by the number of papers a journal publishes in the 5-year period, so that it is highly dependent on the number of papers. For example, although Ophthalmic & Physiological Optics (OPO) has much higher average citation metrics (Impact factor, SCImago and CiteScore) than Optometry & Vision Science, OPO's Google Scholar h-index (25) is lower than Optometry & Vision Science (36) as it published about three times fewer papers in 2012–2016 (391 vs 1207). Of the six main citation metrics, three are 5-year, two 3-year and one 2-year. Eigenfactors chose 5-years as ‘in many research areas, articles are not frequently cited until several years after publication. Therefore, measures that only look at citations in the first 2 years after publication can be misleading’.3 Scopus’ metrics use 3-years as ‘The time window that is chosen for a metric calculated for all serial titles in a multi-disciplinary database like Scopus should be a compromise that is the best fit across all subject areas……3 years is long enough to capture the citation peak of the majority of disciplines. A shorter time window, such as 2 years, is unfair to slower moving fields such as Physics and Astronomy. A longer time window, such as 5 years, is unfair to more rapidly moving fields such as Biochemistry and Molecular Biology.’6 The champions for a 2-year citation metric are, not surprisingly, those that this metric favours such as researchers in the biochemistry and molecular biology fields. Indeed, it has been suggested that the importance of the 2-year impact factor in rating research quality has led to the loss of clinical staff in UK academic departments of medicine in favour of basic scientists who are likely to provide higher impact factor papers (and thereby perhaps gain greater funding for their University) for the UK Research Assessment Exercise.10 Basic research is cited by both basic research and clinical research papers, while clinical research is cited by other clinical research papers, textbooks, professional guidelines etc. and much of the latter does not get included in impact factor calculations. Certainly, researchers in the biochemistry and molecular biology fields can readily publish in high impact factor journals and this can affect inter-discipline comparisons within Universities and with granting agencies as well as Government research assessments. Journals receiving numerous citations soon after publication might suggest that they have immediate and high impact and therefore must be high quality. However, papers in fields that cite a high volume of recent work tend to do so because older work rapidly becomes obsolete because of rapid advances in that field.13 Taking the example in Table 2, a hypothetical journal in which papers were cited highly in the first few years but then tails off, could have an impact factor of 10 but minimal impact after about 5 years. A journal in a discipline that is more of a slow burner would have citations in the other direction. Its impact factor could be 2.5, but its greatest impact is after 5 years and remains highly cited in subsequent years given the broader and sustained relevance of the research. The former journal does not appear to be providing papers that are four-times more impactful or higher quality and it could be argued that its overall impact is considerably less in the longer term. The latter example is not fanciful. For example, OPO's top cited paper, with 324 citations at an average of 25 citations per year, received 2 and 6 citations in its first 2 years after publication! The top cited papers in OPO tend to peak in terms of citations in years 3 and 4. For example, the top 10 cited OPO papers from the last 8 years that have a full 5-year history had mean citations rates of 12 and 13 in years 1 and 2, yet 15 and 17 in years 3 and 4, then drop to 13 in year 5. The lower cited papers follow this pattern even more strongly. Given that our impact factor is 2.3 currently, this highlights that impact factors tend to be greatly influenced by a relatively small number of highly cited papers rather than the breadth of papers published.2, 9 A 5-year window appears to be better, but has other problems. As discussed previously the Google Scholar h-index tends to be out-of-date and often reflects the two oldest volumes included, so that a 2017 h-index is essentially based on citations from 2012 and 2013. The issue is also present for other 5-year metrics such as the Eigenfactor and 5-year impact factor, although to a lesser extent. The 5-year impact factor score also takes many years to change in that a new editorial team would have to wait about 7 years before they could determine whether changes to the journal had influenced the 5-year citation metrics. Three or 4 year metrics may therefore be a good compromise. The impact factor's inclusion of citations from editorial and letters without including them in the denominator during its calculation seems inappropriate. I am not aware of any rationale for doing this and no other citation metric does so. The variable inclusion of case reports and other items means that there is a lack of transparency in the calculation of the impact factor and it is difficult to predict despite access to Web of Science. All journal articles other than news items should be included in both the numerator and denominator of citation metric calculations. Although the inclusion of journal self-citation is open to citation ‘game playing’ by journals, their removal as in Eigenfactors, seems harsh on specialised journals (such as Cataract & Refractive Surgery and the Journal of Refractive Surgery) which are bound to have a high level of journal self-citations. The weighting of citations in Eigenfactors and SCImago seems reasonable, but again leads to questions about transparency: what is the algorithm? Who decides what it is? I assume this is why Scopus have recently introduced the simpler CiteScore. Finally, should the main citation metric be an average or total score of citations? Is a journal of higher quality because it produces a good number of highly cited papers (but many more poorly cited ones) because it publishes a large number of papers? Or is it a journal whose average quality is high? I clearly prefer the latter, but this is likely due to the fact that OPO is a relatively small journal. The use of the total number of citations without division by the number of papers published means that Google Scholar and Eigenfactor citation metrics are heavily influenced by how many papers the journal publishes: they do not measure quantity or quality but a variable mixture of both. An earlier editorial argued that several citation metrics should be used, the standard 2-year impact factor plus another.1 That argument was predicated on the perception that the impact factor is so well established it is irreplaceable. It is not. Not too many years ago, the suggestion of Snellen visual acuity being replaced would have been laughed out of clinics. However, the Snellen chart is flawed and visual acuity using logMAR-based charts is now the standard in research studies, clinical trials and in computer-based systems and is quickly becoming the standard in everyday clinics.14 Similarly, the impact factor (i.e. the standard 2-year impact factor) is flawed, mainly because the 2-year window is inappropriate for so many journals and disciplines,2, 3, 5, 9 but also because of its illogical calculation, restriction to the relatively small range of journals included in Web of Science and lack of transparency. A range of metrics may well be ideal,2, 4, 6 but the 2-year impact factor being used as the standard surely needs to be challenged. To answer the question in the title, the best citation metric for a clinical journal (that provides an average citation score) currently available appears to be Scopus’ SCImago Journal Ranking Indicator or CIteScore. This may be best accompanied by a range of other metrics2, 4 that could include the Web of Science's 5-year impact factor and cited half-life, download metrics and acceptance rate. Thank you to Prof. Joanne Wood for helpful comments on an earlier version of this editorial. As the Editor-in-Chief of OPO, I am likely to favour the citation metrics that best portrays OPO; similarly as a researcher I am likely to favour citation metrics that favour my own clinical vision science research and highlight inadequacies in metrics that do not (such as the 2-year impact factor). OPO is listed in Web of Science, Scopus and Google Scholar.

Blockbuster effect of COVID-19 on the impact factor of infectious disease journals

The Journal Impact Factor (JIF) for 2023 was announced last summer for the Journal of Periodontal & Implant Science (JPIS), the official publication of the Korean Academy of Periodontology.JPIS is ranked 52nd among 157 journals in the field of Dentistry, Oral Surgery & Medicine, placing it in the second quartile (Q2) with a JIF of 2.2.Despite fluctuations in its JIF over the past few years-declining from 2.614 in 2020 to 2.086 in 2021 and further to 1.9 in 2022-the recent increase to 2.2 is encouraging.The JIF, when excluding self-citations, stands at 2.1, with only 9 self-citations.This low number underscores the journal's strong academic reputation and broad international reach, as the majority of citations are from external journals.The number of journals receiving impact factors has risen significantly, from 91 in 2022 to 157 in 2023.This increase is largely due to the inclusion of journals in the Emerging Sources Citation Index (ESCI).Journals indexed in the ESCI typically have lower impact factors, which may have contributed to an apparent increase in the relative positions of traditional SCIE journals.While a high JIF does not necessarily indicate the quality of a journal, it does reflect the level of interest within the research community.To facilitate a more accurate comparison, the Journal Citation Indicator (JCI) was introduced in 2021.This metric normalizes citations across subject categories, publication years, and document types.A JCI of 1.0 indicates an average citation level.Currently, JPIS has achieved a JCI of 0.91, and we are optimistic that it will exceed the average in the future.The SCImago Journal & Country Rank (SJR) from Elsevier/Scopus serves as another relevant metric.JPIS holds the 27th position out of 60 (Q2) in the field of Oral Surgery according to the SJR.However, the influence and utilization of the SJR have not yet reached the level of the JIF, which continues to be a prominent metric for institutions and universities.

Influence of Article Type on the Impact Factor of Dermatology Journals

Does the Journal Impact Factor Help Make a Good Indicator of Academic Performance?

Misuse of Journal Impact Factors in Scientific Assessment

Lapses at the New England Journal of Medicine

Journals' impact and pecking order: tyranny and tyrannosaurs

The journal impact factor (JIF) is a measure that provides a ratio of citations to a journal in a given year to the citable items in the prior two years. The JIF has become a symbol and measure of a journal's prestige in the modern world of peer-reviewed publications. The difficulty and importance for a peer-reviewed journal to obtain an impact factor has been highlighted in numerous medical journals. Irving H. Sher and Eugene Garfield were the first to create the concept of the impact factor of a peer-reviewed journal. According to Eugene Garfield (2006), the JIF is based on two elements: the numerator, which is the number of citations in the current year to items published in the previous two years, and the denominator, which is the number of substantive articles and reviews published in the same two years. Scientists around the world may notice that as of 2024, the JIF is calculated not only by Clarivate, but also by exaly. Clarivate is known for being the company that calculates the JIF, using data from its Web of Science product family, that also includes services/applications such as Publons, etc. In this editorial, we will explain in more detail why the JIF is important both for the peer-reviewed journals published in Ukraine and for Ukrainian authors. Also, let's also explain how both the impact factor calculated by Web of Science and the impact factor calculated by exaly can be useful. The article presents the experience of the Journal of Diagnostics and Treatment of Oral and Maxillofacial Pathology in assigning it an impact factor calculated by the exaly. The advantages for Ukrainian authors of publishing articles in the journals with an impact factor are presented. According to the Order of the Ministry of Healthcare of Ukraine of February 22, 2019, No. 446, publication of an article or review in a journal with an impact factor allows an oral and maxillofacial surgeon to be awarded 20 or 30 continuing professional development (CPD) points. The CPD points obtained are necessary for doctors to the annual review of their personal educational portfolio with CPD points, certification, confirmation or obtaining a new doctor’s category. In summary, the peer-reviewed journal that has received an impact factor automatically becomes a kind of provider of CPD activities for healthcare professionals, for which CPD points are awarded.

The paper reports the application of classical bibliometric methods to evaluate the impact of scientific, political, and business developments. The novel aspect is to regard the Web as a citation network where the traditional information entities (scientific articles and the citations given to and taken from them) are replaced by webpages with external and internal links. The methodological studies are intended to test the usability of large international citation databases and the World Wide Web as feasible and reliable tools in quantitative analyses for gathering useful information for business intelligence. Formerly, the impact of authors and their scientific production was measured by the average citation frequencies of journals publishing their research: the Journal Impact Factor (JIF), calculated by the Institute for Scientific Information (ISI) in the United States and published annually in the Journal Citation Reports (JCR)—the most frequently used quantitative indicator to measure the quality/value/impact of research works published in the core international journals. It has been suggested that, by calculating the number of webpages pointing to a given site, analogously, a Web Impact Factor can be calculated as a way of comparing the attractiveness of sites or domains on the World Wide Web. A key to webometric studies has been the use of large-scale Web search engines such as Alta Vista that allow measurements to be made of the total number of pages in a Web space and links to those Web spaces. These search engines provide similar possibilities for the investigation of links between documents to those provided by the citation databases created by ISI. To illustrate the scope and nature of informetric research methods applied in competitive intelligence analysis, a short presentation is given of samples of research studies carried out at the Centre for Informetic Studies in Copenhagen (CIS). © 2001 John Wiley & Sons, Inc.

Goodbye <i>International Journal of Andrology</i>, welcome <i>Andrology</i>!

The front page of the Arquivos Brasileiros de Cardiologia (Brazilian Archives of Cardiology) discloses an objective view of the current representativeness of the journal1: “With over 60 years of existence, the Arquivos Brasileiros de Cardiologia (Arq Bras Cardiol) is the official scientific publication of Brazilian Society of Cardiology (BSC), serving as the main channel for the dissemination of Brazilian scientific research on cardiovascular sciences. Published in two languages and indexed in major international databases (ISI Web of Science; Cumulated Index Medicus — MEDLINE; EMBASE; SCOPUS; SCIELO and LILACS), Arquivos Brasileiros de Cardiologia has an average impact factor of 1.1, according to Thompson Reuters. This rating puts our journal at a level that is similar to most journals indexed in ISI Web of Science in the field of Cardiology.” Considering the historical and academic significance of the Arquivos Brasileiros de Cardiologia, since its indexing in MEDLINE that started in 1950, some authors have assumed the hypothesis that the analysis of publications in the last 60 years could reflect the changing trends of heart disease in Brazil. The existence of an epidemiological link between cardiac diseases that are prevalent in Brazil and the publications of the Arquivos has been suggested. This evidence, associated with planning, publications and guideline updates, leaves no doubt about its crucial importance for Brazilian Cardiology2-4. Regarding the evaluation of its impact, the announcement of the Arquivos’ first Impact Factor by the Journal of Citation Report of Thompson Reuters occurred in 2010. Since then, the values of this bibliometric index, documented by the Web of Science database of the Institute for Scientific Information (ISI), have confirmed the degree of scientific relevance and the scope of studies carried out in Brazil, as well as those performed in international centers that have been published in our journal. The ratings place the Arquivos at the same level of approximately 30% of international journals indexed in the ISI database in the field of Cardiology. The Arquivos Brasileiros de Cardiologia currently occupies position 95 among 125 journals listed by ISI with a positive impact factor in the field of cardiovascular diseases in 2014. Among these publications, only five have an impact factor greater than ten (4%); 17 (13.6%) between 5.04 and 7.44; 47 (37.6%) between 2.044 and 4.918; 35 (28%) between 1.965 and 1.018 and; 21 (16.8%) with an impact factor of 0.011 and 0.912. Individual analysis of the Arquivos by Web of Science currently discloses the following numbers: 3,383 indexed publications, with 2,509 original and review articles. Since 2003, these articles have received 7,365 citations (Figure 1), corresponding to a mean rate of 2.64 citations per ar ticle and an H index of 25. The number of self‑citations was 1,482, accounting for only 26.2% of the total. Among the ten most cited papers, the majority corresponds to guidelines and epidemiological data5-10. It is worth mentioning the presence of a single article on basic sciences11. The interesting thing is that these articles are not totally dependent on national citations. Figure 1 Number of original and review articles published and number of citations obtained by the same articles in the Web of Science database during the analyzed period. The relevance of the Arquivos Brasileiros de Cardiologia for Brazilian cardiology science can also be assessed through its position as the main vehicle for the dissemination of national research at international level. Of 1,581 original articles published by Brazilian authors and institutions between 2010 and 2012 in journals indexed in the Web of Science database, it is noteworthy the fact that 27% were published in the Arquivos, whereas 43% of these articles were published by journals with a higher impact factor, located at the upper strata of the CAPES Qualis classification (Figure 2). Figure 2 Percentage of original and review articles published by Brazilian authors and institutions, according to the Qualis-CAPES classification. ABC: Brazilian Archives of Cardiology Aiming to improve the quality of publications, the Editorial Board of the journal has adopted a certain degree of academic prioritization. Currently, 60% of the articles published in the Arquivos originate from academic studies at post-graduate level. Although greater receptivity has been observed from Post-Graduate Programs in Cardiology, unfortunately this decision has not reflected the positive variation of the Impact Factor in recent years, leading to the suggestion that the Brazilian academic community has not prioritized the Arquivos Brasileiros de Cardiologia as an option to have their best works published. However, we believe that this trend can be reversed, being one of the motivations of this editorial, seeking to encourage postgraduate programs to give higher priority to the Archives. Finally, there is a clear need for greater participation in the area of Basic Science and applied research in Cardiology, as well as the publication of a greater number of controlled clinical trials and meta-analyses in our journal.

BackgroundScientists, physicians, and the general public legitimately expect scholarly publications to give true answers to study questions raised. We investigated whether findings from studies published in journals with higher Journal Impact Factors (JIFs) are closer to truth than findings from studies in less-cited journals via a meta-epidemiological approach.MethodsWe screened intervention reviews from the Cochrane Database of Systematic Reviews (CDSR) and sought well-appraised meta-analyses. We used the individual RCT study estimates’ relative deviation from the pooled effect estimate as a proxy for the deviation of the study results from the truth. The effect of the JIF on the relative deviation was estimated with linear regression and with local polynomial regression, both with adjustment for the relative size of studies. Several sensitivity analyses for various sub-group analyses and for alternative impact metrics were conducted.ResultsIn 2459 results from 446 meta-analyses, results with a higher JIF were on average closer to “truth” than the results with a lower JIF. The relative deviation decreased on average by −0.023 per JIF (95% CI −0.32 to −0.21). A decrease was consistently found in all sensitivity analyses.ConclusionsOur results indicate that study results published in higher-impact journals are on average closer to truth. However, the JIF is only one weak and impractical indicator among many that determine a studies’ accuracy.