Please note that this summary was posted more than 5 years ago. More recent research findings may have been published.
This is a plain English summary of an original research article. The views expressed are those of the author(s) and reviewer(s) at the time of publication.
Changing the order in which readers examine screening mammograms has no effect on breast cancer detection rates, rates of recall for further tests or rates of disagreement between readers.
In the UK each woman’s mammogram is examined by two independent readers (radiologists, radiographers or breast clinicians) who review each batch of mammograms from about 40 women in the same order. Research in other fields has indicated that vigilance can decrease with increasing time spent performing a particular task, but this effect has not been tested previously for the repetitive task of screening mammography.
This large multicentre trial therefore examined whether changing the order in which the second reader looks at the mammograms could improve cancer detection rates. Contrary to expectation it had no effect. In fact, it found that the performance of individual readers improved and they recalled fewer women for further tests if they read the mammogram last in the batch compared to reading it first. This didn’t affect their cancer detection rates.
The findings are generalisable only to breast cancer screening programmes where two readers examine mammograms separately, which happens in most of Europe but not in the US.
Why was this study needed?
Breast cancer screening detects about 18,000 cancers per year in the UK (8.6 per thousand women screened). About 6,030 cancers per year are detected between screening rounds. This is due to cancers missed at screening and those developing in between screening rounds. An additional 69,700 women each year experience false positives at each screening round, where the result wrongly indicates that breast cancer might be present, and women are recalled for further tests.
Interpreting mammograms is a difficult and visually repetitive task that can result in missed cancers and false positives. Findings from settings, such as airport baggage screening, have suggested that increased time spent performing a task may reduce ability to accurately detect abnormalities.
In the UK National Health Service Breast Screening Programme two readers separately examine each woman’s mammograms for signs of cancer. Women have mammograms taken of both breasts. Both readers scrutinise batches of around 35 women’s mammograms. Current practice is that both readers examine the x-rays in the same order. The study questioned whether reader fatigue towards the end of a batch has a part to play in detection of breast cancers. They therefore looked at the effect of reversing the order in which the second mammography reader views batches. If vigilance fell towards the end of their batch it could be expected that the rates of disagreements in the group where the order was reversed might occur.
What did this study do?
This randomised controlled trial (CO-OPS trial) was carried out across 46 specialist NHS breast cancer centres over one year.
A total of 360 qualified mammogram readers were included – 186 radiologists, 143 radiography advanced practitioners and 31 breast clinicians – who reviewed mammograms from almost 1.2 million women.
In the control group, two readers examined each batch of mammograms in the same order. In the intervention group, two readers examined each batch in the opposite order to one another.
There were between 16 and 46 mammograms per batch, and each reader examined between one and 26 batches in a single day.
The main outcome of interest was the cancer detection rate – the number of women with cancer detected as a proportion of all women screened. Other outcomes were rates of recalling women for further tests and disagreement between mammography readers.
What did it find?
- There was no significant difference in breast cancer detection rates when two readers reviewed mammograms in the opposite order (5272 cancers, 0.88%) compared with the same order as each other (5212 cancers, 0.87%) (difference 0.01% points, 95% confidence interval [CI] -0.02 to 0.04% points).
- There was also no significant difference in the rate of recall of women for further tests in the opposite order review group (24,681 women, 4.14%) compared with the same order group (24,894, 4.17%) (difference -0.03% points, 95% CI -0.10% to 0.04% points).
- Also there was no significant difference in rates of reader disagreements when two readers reviewed in the opposite order (20,471 disagreements, 3.43%) compared with the same order (20,793, 3.48%) (difference -0.05% points, 95% CI -0.11% to 0.02% points).
- Increasing the time that individual readers spent reviewing a batch of mammograms had no effect on their cancer detection rates, but they did recall fewer women for further tests towards the end of reading the batch.
What does current guidance say on this issue?
Women in England aged between 50 and 70 are offered breast mammography screening every three years through the NHS Breast Screening Programme. The NHS is in the process of extending the programme as a trial to offer screening to some women aged 47 to 73.
What are the implications?
This large trial does provide evidence that two readers examining mammograms in a different order to each other, rather than the same order as each other, has no effect on breast cancer detection rates or rates of recall for further tests.
This suggests that, up to about 40 readings, there is no loss of “vigilance” or carefulness. These findings are contrary to those from research in other fields which suggest that performance on a repetitive task may worsen over time. The study did show that over the course of reviewing around 40 mammograms, an individual reader’s performance improved and they recalled fewer women for further tests and this did not affect the cancer detection rates.
The findings are generalisable only to breast cancer screening programs that use two readers to examine mammograms separately. It was noted by these researchers that programmes in the US rarely incorporate double reading.
Citation and Funding
Taylor-Phillips S, Wallis MG, Jenkinson D, et al. Effect of Using the Same vs Different Order for Second Readings of Screening Mammograms on Rates of Breast Cancer Detection: A Randomized Clinical Trial. JAMA. 2016;315(18):1956-65.
This project was funded by the National Institute for Health Research through a fellowship and the CLAHRC West Midlands initiative and the University of Warwick.
Bibliography
NHS Choices. Breast Cancer Screening. London. Department of Health; updated 2015.
Produced by the University of Southampton and Bazian on behalf of NIHR through the NIHR Dissemination Centre
NIHR Evidence is covered by the creative commons, CC-BY licence. Written content and infographics may be freely reproduced provided that suitable acknowledgement is made. Note, this licence excludes comments and images made by third parties, audiovisual content, and linked content on other websites.
