Home 9 Uncategorized 9 Op Ed — To Err is Human:  Part 3

Op Ed — To Err is Human:  Part 3

by | Jun 30, 2023 | 0 comments


Citing the Errors

By Daniel S. Dotson  (Professor, The Ohio State University, Columbus, OH 43210) 

Against the Grain V35#3


Mistakes happen.  We all make them from time to time.  But what does it say when our most scholarly sources — peer reviewed journals — publish mistakes?  This is the third in a series of three articles on issues related to errata and retractions in scholarly journals.  This article will focus on the citation rates of errata and retractions.


Scopus was chosen for its wider title coverage than Web of Science and its ability to export data for analysis.  In order to find these errata and retractions, all that needs to be done is to enter Scopus and conduct search for the source title and then limit to the document type “Erratum” or “Retracted” for each type.  Finding these across all publications is a bit more work, but a search for all fields using the following search should get every document indexed:

a* OR b* OR c* OR d* OR e* OR f* OR g* OR h* OR i* OR j* OR k* OR l* OR m* OR n* OR o* OR p* OR q* OR r* OR s* OR t* OR u* OR v* OR w* OR x* OR y* OR z*

For the purposes of this study, the items were limited to 2012-2021 content prior to search.  After search, source type of journal was applied as a limit.  Then the appropriate document type limit was applied.  Note Erratum is used for all errata types.

There were over 229,000 total errata.  Due to the output limits for Scopus, the data for the 20,000 most cited errata were downloaded.  Items with ten or more citations were examined closer.  On examination of citations, it appeared that only 2,809 (1.2%) of the total errata had 10 or more citations.  This means considering all of the errata from 2012-2021, only this small amount are getting 10 or more citations.  So, while errata are getting some citations, they’re not getting cited at overwhelmingly larger numbers.  As outlined in Table 1, less than 9% of errata see more than 50 citations. 

Table 1: Errata Citation Distribution for 10+ Citations Only

Comparing some highly cited items, original articles are most often cited far more often than corresponding errata.  For example, the biggest difference is an errata cited 200 times, but the original article is cited 48,386 times.  However, some errata have higher citation counts in Scopus compared to their original.  In one case, an errata (in this case, a corrigendum according to its title, since Scopus does not separate errata type) had 427 cites with the original cited only 22 times.

A similar method was used to isolate retractions and examine their citation rates.  The same set of 6,791 retractions from my second article in this series were examined close.  Retracted items get citations, in this group as high as 1,270.  While this study did not examine retracted articles to determine if citations were done before or after the retraction, the citations are nevertheless to an article that has been retracted.  But they are not seeing high citation levels, with most having 6 or fewer citations and only 6.57% of citation counts being 50 or more citations.  Many (13.72%) have thus far seen no citations.  See Table 1.

Table 2: Retractions Citation Distribution


In summary, examining the data for these highly cited retractions and errata published 2012-2021 revealed:

• Retracted items and errata are getting cited, but usually not heavily.

• Errata are almost always less cited than their original article.

What cannot be determined via the data for this study, or were not examined closer, but are potential areas to explore further:

• Are people citing a portion of an article where an error is and missing the erratum related to that error?

• Why are people citing an erratum rather than the original?

— Are these citations sometimes citing authors’ error?

— Is the database incorrectly attributing citation to the wrong item?

• Are cites of a retracted article occurring mostly before retraction or do they continue and are mostly after the retraction has occurred? 

— Are those citing the item knowingly citing a retracted item and does their citation indicate that?

— Can publishers and databases do anything different to make it clearer items are retracted?

Final Thoughts on Errata and Retractions

This article concludes a three-part series on error and retractions.  What had let me down this route was seeing several errata when examining search results for another line of research.  My curiosity led me to try to find how prevalent these were.  I have also been telling students for quite some time that despite peer review, issues like errors and plagiarism still occur in our most quality-checked literature.  This issue speaks to multiple themes of information literacy, such as those related to evaluation, authority, information creation, etc.

These three examinations drive home the point librarians make about evaluating your sources in all cases, that no information format is perfect.  Never assume an item is perfect because it is peer reviewed, from top scholars in a discipline, or in one of our highest quality journals.  The evidence here illustrates the major importance of evaluation of one’s sources and the non-foolproofness of peer review.  

Use these links to read Part 1 and Part 2 of Daniel’s Op Ed:

Daniel Dotson’s “Op Ed — To Err is Human Part 1: Errata in Scholarly Journals?” which appeared in our February 2023 issue (v.35#1, pgs. 28-30) is available on the Charleston Hub here:  https://www.charleston-hub.com/2023/03/op-ed-to-err-is-human-part-1/.

Daniel Dotson’s “Op Ed — To Err is Human Part 2: Retractions in Scholarly Journals” which appeared in our April 2023 issue (v.35#2, pgs. 26-28) is available on the Charleston Hub here:  https://www.charleston-hub.com/2023/05/op-ed-to-err-is-human-part-2/.  


Submit a Comment

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.


Tea Time With Katina And Leah

4-12-24 The wonderful Ramune Kubilius sends us this astonishing news!   Garbage collectors in Ankara, Turkey, started noticing an increasing number of books being thrown away. Rather than let them end up in landfills, they began rescuing the books....

Tea Time With Katina And Leah

4-12-24 The wonderful Ramune Kubilius sends us this astonishing news!   Garbage collectors in Ankara, Turkey, started noticing an increasing number of books being thrown away. Rather than let them end up in landfills, they began rescuing the books....


Share This