Do you care about if and how you and your colleagues’ research articles are cited by other researchers? Which articles published in this journal are the most cited? Is it possible to calculate the impact factor of a journal by yourself? I often go to Google Scholar to check out the citations of articles. And being new as editor I wanted to study how the articles in our journal are being cited.
Google Scholar has the advantage of being free to use as compared with Web of Science owned by Thomson (who publish the Thomson Reuters Impact Factor), and Scopus, owned by Elsevier. Subscription fees for Web of Science are secret, but considered to be higher than Scopus fees which in 2005 were $US20 000–120 000 per year depending on institution size [Citation1]. Google Scholar has increased its capacities and features in recent years and is now updated twice a week. Google Scholar used to yield fewer articles published before 1996, while today it readily retrieves earlier research. Bibliometric research comparing Google Scholar with Web of Science and Scopus shows differences but the correlation is high [Citation2–5]. In addition to Thomson journal articles, Google Scholar searches show science reports, dissertations, books, and articles from journals not indexed by Thomson.
Lacking access to Web of Science or Scopus, I used Google Scholar to track citations for all 111 original publications in the Scandinavian Journal of Primary Health Care (SJPHC) in 2008–2010. The median number of Thomson journal citations according to a manual Google Scholar search for the 111 articles was two. I then calculated a 2010 impact factor by summing all Thomson journal citations published in 2010 that I found in Google Scholar for articles published in the SJPHC in 2008 and 2009. The sum of 144 citations was then divided by 77, which is the number of original articles published in the SJPHC during 2008 and 2009. My own 2010 impact factor calculation for SJPHC was 1.87. The 2010 impact factor delivered by Thomson is 1.909. This means that Google Scholar search missed three citations, i.e. 2% of those that make up the impact factor.
In the titles of the most cited articles in each of the 12 issues published in the SJPHC 2008–2010 are presented plus the cumulated number of citations they have received both Google Scholar and Thomson journal citations; the number of cumulated citations from the SJPHC, 18% of all Thomson citations, as well as the share of Thomson journal citations that make up the 2010 impact factor. Obviously, articles published in 2008 and 2009 have been cited more than the 2010 articles. And, evidently, the most cited articles in 2008 contribute twice as much (17%) to the 2010 impact factor as do the most cited in 2009 (9%). This is because they have on average twice as much time available to be cited for the impact factor algorithm.
Table I. Original articles published in the Scandinavian Journal of Primary Health Care (SJPHC) with the highest number of citations per issue in 2008–2010.1
Looking at the article titles shows that the journal publishes a wide variety of research subjects, which goes with our diverse area of medicine. I wanted to study whether any substantive fields of research were more cited than others. Therefore, I further analysed the article titles and tested a possible correlation between article title content and number of citations. No significant correlations between article title content and number of Thomson citations were found after repeated non-parametric tests using different title content categorizations.
Many have criticized the impact factor for various reasons [Citation6]. Nevertheless, the success of research and its implementation requires articles to be read, spread, and cited. And one easy way to measure research impact is counting citations.
References
- LaGuardia C. Library Journal, 01/15 2005. (http://www.libraryjournal.com/article/CA491154.html, accessed September 28, 2011).
- Van Aalst, J. Using Google Scholar to estimate the impact of journal articles in education. Educational Researcher 2010;39:387–400.
- Sember M, Utrobicić A, Petrak J. Croatian Medical Journal citation score in Web of Science, Scopus, and Google Scholar. Croat Med J 2010;51:99–103.
- Falagas ME, Pitsouni EI, Malietzis GA, Pappas G. Comparison of PubMed, Scopus, Web of Science, and Google Scholar: Strengths and weaknesses. FASEB J 2008;22:338–42.
- Kulkarni AV, Aziz B, Shams I, Busse JW. Comparisons of citations in Web of Science, Scopus, and Google Scholar for articles published in general medical journals. JAMA 2009;302:1092–6.
- Favaloro EJ. The journal impact factor: Don't expect its demise any time soon. Clin Chem Lab Med 2009;47: 1319–24.
- von Knorring M, Sundberg L, Löfgren A, Alexanderson K. Problems in sickness certification of patients: A qualitative study on views of 26 physicians in Sweden. Scand J Prim Health Care 2008;26:22–8.
- Brekke M, Rognstad S, Straand J, Furu K, Gjelstad S, Bjørner T, Dalen I. Pharmacologically inappropriate prescriptions for elderly patients in general practice: How common? Baseline data from the Prescription Peer Academic Detailing (Rx-PAD) study. Scand J Prim Health Care 2008;26:80–5.
- Björkelund C, Andersson-Hange D, Andersson K, Bengtsson C, Blomstrand A, Bondyr-Carlsson D, Eiben G, Rödström K, Sjöberg A, Sundh V, Weman L, Zylberstein D, Hakeberg M, Lissner L. Secular trends in cardiovascular risk factors with a 36-year perspective: Observations from 38- and 50-year-olds in the Population Study of Women in Gothenburg. Scand J Prim Health Care 2008;26:140–6.
- Mikkelsen TH, Søndergaard J, Jensen AB, Olesen F. Cancer rehabilitation: Psychosocial rehabilitation needs after discharge from hospital? Scand J Prim Health Care 2008;26:216–21.
- Iinattiniemi S, Jokelainen J, Luukinen H. Falls risk among a very old home-dwelling population. Scand J Prim Health Care 2009;27:25–30.
- Adolfsson ET, Smide B, Rosenblad A, Wikblad K. Does patient education facilitate diabetic patients’ possibilities to reach national treatment targets? A national survey in Swedish primary healthcare. Scand J Prim Health Care 2009;27:91–6.
- Rognstad S, Brekke M, Fetveit A, Spigset O, Wyller TB, Straand J. The Norwegian General Practice (NORGEP) criteria for assessing potentially inappropriate prescriptions to elderly patients: A modified Delphi study. Scand J Prim Health Care 2009;27:153–9.
- Gjelstad S, Dalen I, Lindbaek M. GPs’ antibiotic prescription patterns for respiratory tract infections – still room for improvement. Scand J Prim Health Care 2009;27:208–15.
- Toljamo T, Kaukonen M, Nieminen P, Kinnula VL. Early detection of COPD combined with individualized counselling for smoking cessation: A two-year prospective study. Scand J Prim Health Care 2010;28:41–6.
- Wynne-Jones G, Mallen CD, Main CJ, Dunn KM. What do GPs feel about sickness certification? A systematic search and narrative review. Scand J Prim Health Care 2010;28:67–75.
- Neergaard MA, Vedsted P, Olesen F, Sokolowski I, Jensen AB, Sondergaard J. Associations between successful palliative trajectories, place of death and GP involvement. Scand J Prim Health Care 2010;28:138–45.
- Jakobsen KA, Melbye H, Kelly MJ, Ceynowa C, Mölstad S, Hood K, Butler CC. Influence of CRP testing and clinical findings on antibiotic prescribing in adults presenting with acute cough in primary care. Scand J Prim Health Care 2010;28:229–36.