- Front Matter
5
- 10.1053/j.jfas.2013.03.039
Impact Factors and Other Measures of a Journal's Influence
- Apr 24, 2013
- The Journal of Foot and Ankle Surgery
- D Scot Malay
Impact Factors and Other Measures of a Journal's Influence
Ziemann and Oestmann showed that the impact factor of medical publications resulting from doctoral theses at the Charite University Hospital rose by 50% over a decade (4). Mooreover, the number of publications per doctoral candidate rose from 0.8 to 1.4.. These data have to be appreciated. Nevertheless, they should also prompt a discussion about the validity of the impact factor in comparison within faculties. Submitted manuscripts are carefully reviewed by editors/publishers and peer reviewers in order to determine a priority for publication. As a rule, suggestions are implemented aiming for improving the quality of the presentation and thus citations of the publication (1). In view of the current discussions on plagiarism, these hidden “external services” by reviewers that have not been involved in the study are not trivial. The impact factor of medical journals correlates with the number of journals publishing in this domain and the seize of the audience; this results in differences in cross-sectional fields, organ specialties, and subspecialties (2). This is facilitated by modern technologies and several scientific on-line services. Furthermore, formal rules are relevant for citation numbers (1). In general, excellent studies with a presumed scientific and medical impact are preferably published in top journals that do not belong to any particular medical specialty. As a result, the impact factor of journals publishing in a specific domain does not necessarily reflect the scientific potential of that specialty. This statement can be illustrated by current experience in pediatric oncology and hematology. In 2012, five researchers recently received prizes and honors, while their corresponding publications were all published in non-pediatric journals (3). The allocation by specialty for each individual publication is hardly able to abolish such imbalances (2) and appears unrealistic. However, a score that assigns points for the quartile-ranking of a journal within a discipline-specific list is easy to perform and should be considered. If such a score were used across disciplines to compare scientific achievements, the top journal still would retain their influence – however outside of discipline specific lists. Formal biases could be marginalized and disciplines that are currently at a disadvantage could win. This would then enable a valid comparison both within medical faculties and between faculties with different profiles.
Impact Factors and Other Measures of a Journal's Influence
Impact Factors and Other Measures of a Journal's Influence
Editor's evaluation: Tracing the path of 37,050 studies into practice across 18 specialties of the 2.4 million published between 2011 and 2020
Comprehensive decade-long analysis of point-of-care resources reveals insights into how clinical research makes its way into practice across different medical specialties and through time to enable us to identify potential translational bottlenecks in the pathway from research to practice.
Read moreImpact factor of medical journals: problems in geriatrics.
The Impact Factor (IF) is one of the most reliable methods for evaluating the quality of scientific journals. To date, no one has studied the IF of geriatric journals over time. Our aims were 1) to evaluate the IF trend of geriatric journals in general, and with respect to internal medicine, which is the nearest discipline, and 2) to assess the proportion of papers on common geriatric topics published in geriatric journals, with respect to other general periodicals. The current literature was studied to define what IF is and describe its good points and deficiencies. We then analyzed the situation regarding geriatric journals. A bibliometric analysis addressed the kind of journal interested in important geriatric themes (syncope, falls, hip fractures, delirium). Geriatric journals have a low IF, but their importance has been growing over the years. Despite this, papers regarding geriatric themes are published mainly in non-specific journals, and the number of publications regarding syncope, falls, hip fractures, and delirium has not increased during the period in question. In conclusion, it is difficult to use the IF for comparisons between different disciplines, in particular when the one under consideration (geriatrics and gerontology) is spread over a wide range of medical fields. The increase in IF of geriatric journals over time is the most important result of our analysis; this finding will encourage geriatric scientists to submit their papers to geriatric periodicals and will increase the specificity of the gerontological discipline.
Read moreImpact Factor of Medical Journals
Impact factor, which is a measure of the frequency of citation of articles published in a journal over a specified time, measures the rank or importance of a journal. There is a trend towards publication of high quality research in journals with high impact factor. This paper has outlined the importance, method of calculation, clinical implications, pitfalls and financial issues related to the impact factor of medical journals.
Read moreRelationship between journal impact factor and the thoroughness and helpfulness of peer reviews.
The Journal Impact Factor is often used as a proxy measure for journal quality, but the empirical evidence is scarce. In particular, it is unclear how peer review characteristics for a journal relate to its impact factor. We analysed 10,000 peer review reports submitted to 1,644 biomedical journals with impact factors ranging from 0.21 to 74.7. Two researchers hand-coded sentences using categories of content related to the thoroughness of the review (Materials and Methods, Presentation and Reporting, Results and Discussion, Importance and Relevance) and helpfulness (Suggestion and Solution, Examples, Praise, Criticism). We fine-tuned and validated transformer machine learning language models to classify sentences. We then examined the association between the number and percentage of sentences addressing different content categories and 10 groups defined by the Journal Impact Factor. The median length of reviews increased with higher impact factor, from 185 words (group 1) to 387 words (group 10). The percentage of sentences addressing Materials and Methods was greater in the highest Journal Impact Factor journals than in the lowest Journal Impact Factor group. The results for Presentation and Reporting went in the opposite direction, with the highest Journal Impact Factor journals giving less emphasis to such content. For helpfulness, reviews for higher impact factor journals devoted relatively less attention to Suggestion and Solution than lower impact factor journals. In conclusion, peer review in journals with higher impact factors tends to be more thorough, particularly in addressing study methods while giving relatively less emphasis to presentation or suggesting solutions. Differences were modest and variability high, indicating that the Journal Impact Factor is a bad predictor of the quality of peer review of an individual manuscript.
Read moreBlockbuster effect of COVID-19 on the impact factor of infectious disease journals
Blockbuster effect of COVID-19 on the impact factor of infectious disease journals
Hard Impact: Journal Impact Factor and JMT
Hard Impact: Journal Impact Factor and JMT
Editorial: Self-citation in Publishing
The role of impact factor in evaluating the value of scientific publications is critically reviewed. \nOther possible criteria for evaluation are assessed and proposed.
Read moreRelationship between category size and journals' impact factor: implications for emergency medicine journals and researchers.
We assessed the relationship between the size of the 39 Journal Citation Reports (JCR) medical categories and impact factor (IF) of journals in these categories, and the implications that it might have for emergency medicine (EM) journals. Using the 2010 JCR database, we calculated the mean IF, 5-year IF (5y-IF), Eigenfactor (EF), and Article Influence (AI) scores including all journals for each category. We also calculated a 'weighted IF' for all journals by dividing each journal IF by the mean IF of its category. We ranked EM journals according to IF and 'weighted IF' into all the journals included in the 39 categories. We assessed the relationship between category size and bibliometric scores by linear regression. Category size varied from 252 journals (Pharmacology and Pharmacy) to 14 (Primary Healthcare), EM category occupying the 36th position (23 journals). The mean IF of EM category ranked in 34th position, 5-yIF in 32nd, EF in 34th, and AI in 34th position. Category size had a direct and significant association with mean IF, 5y-IF, and AI but not with mean EF. When the EM journals were ranked among all the journals according to their IF, only two (9%) were placed into the first quartile and raised up to eight (35%) when 'weighted IF' was considered. There is a negative relationship between JCR size category and IF achieved by the journals. This places EM journals at a clear disadvantage because they represent one of the smallest clinical medical research disciplines.
Read moreGoodbye International Journal of Andrology, welcome Andrology!
Goodbye <i>International Journal of Andrology</i>, welcome <i>Andrology</i>!
Journals' impact and pecking order: tyranny and tyrannosaurs
Journals' impact and pecking order: tyranny and tyrannosaurs
No difference in abstract publication rates between the open and closed American Shoulder and Elbow Surgeons meetings from 2013 to 2019.
No difference in abstract publication rates between the open and closed American Shoulder and Elbow Surgeons meetings from 2013 to 2019.
Read moreRecent Outcomes Research in Helicopter Emergency Medical Services: A Scoping Review of Publication Year 2023 Additions to the Helicopter Outcomes Assessment Research Database
Recent Outcomes Research in Helicopter Emergency Medical Services: A Scoping Review of Publication Year 2023 Additions to the Helicopter Outcomes Assessment Research Database
Read moreImproving the accuracy of institute for scientific information's journal impact factors
The Institute for Scientific Information (ISI) publishes annually listings of impact factors of scientific journals, based upon data extracted from the Science Citation Index (SCI). The impact factor of a journal is defined as the average number of citations given in a specific year to documents published in that journal in the two preceding years, divided by the number of “citable” documents published in that journal in those 2 years. This article presents evidence that for a considerable number of journals the values of the impact factors published in ISI's Journal Citation Reports (JCR) are inaccurate, particularly for several journals having a high impact factor. The inaccuracies are due to an inappropriate definition of citable documents. Document types not defined by ISI as citable (particularly letters and editorials) are actually cited and do contribute to the citation counts of a journal. We present empirical data in order to assess the degree of inaccuracy due to this phenomenon. For several journals the results are striking. We propose to calculate for a journal impact factors per type of document rather than one single impact factor as given currently in the JCR. © 1995 John Wiley & Sons, Inc.
Read moreEditorial: The First Impact Factor of the Journal of Diagnostics and Treatment of Oral and Maxillofacial Pathology
The journal impact factor (JIF) is a measure that provides a ratio of citations to a journal in a given year to the citable items in the prior two years. The JIF has become a symbol and measure of a journal's prestige in the modern world of peer-reviewed publications. The difficulty and importance for a peer-reviewed journal to obtain an impact factor has been highlighted in numerous medical journals. Irving H. Sher and Eugene Garfield were the first to create the concept of the impact factor of a peer-reviewed journal. According to Eugene Garfield (2006), the JIF is based on two elements: the numerator, which is the number of citations in the current year to items published in the previous two years, and the denominator, which is the number of substantive articles and reviews published in the same two years. Scientists around the world may notice that as of 2024, the JIF is calculated not only by Clarivate, but also by exaly. Clarivate is known for being the company that calculates the JIF, using data from its Web of Science product family, that also includes services/applications such as Publons, etc. In this editorial, we will explain in more detail why the JIF is important both for the peer-reviewed journals published in Ukraine and for Ukrainian authors. Also, let's also explain how both the impact factor calculated by Web of Science and the impact factor calculated by exaly can be useful. The article presents the experience of the Journal of Diagnostics and Treatment of Oral and Maxillofacial Pathology in assigning it an impact factor calculated by the exaly. The advantages for Ukrainian authors of publishing articles in the journals with an impact factor are presented. According to the Order of the Ministry of Healthcare of Ukraine of February 22, 2019, No. 446, publication of an article or review in a journal with an impact factor allows an oral and maxillofacial surgeon to be awarded 20 or 30 continuing professional development (CPD) points. The CPD points obtained are necessary for doctors to the annual review of their personal educational portfolio with CPD points, certification, confirmation or obtaining a new doctor’s category. In summary, the peer-reviewed journal that has received an impact factor automatically becomes a kind of provider of CPD activities for healthcare professionals, for which CPD points are awarded.
Read more