Dear Commons Community,
This is the second posting I will be making in as many months on concerns with peer review. In this morning’s Science, an editorial entitled, “Australia’s erosion of peer review” rings alarm about the state of peer review down under. Here is an excerpt:
“Between 1992 and 2018, government support for fundamental research decreased by 17%, according to the Australian Academy of Science. Despite frustration in the gross underinvestment in biomedical research, Australian scientists were comforted by a trusted peer review system. For generations, Australia’s National Health and Medical Research Council (NHMRC), the major funding body for medical research, aspired to fund excellence through a careful process involving peer review grant panels. However, in 2020 the COVID-19 pandemic led to the necessary cancellation of the grant review panels that buttressed Australian science. Unfortunately, since then, there has been a systematic dismantling of high-quality review panels by the NHMRC in the name of efficiency, reduced administrative costs, and peer review flexibility. This has raised concerns across Australia’s scientific community that the peer review system is no longer reliable and thus poses an imminent threat to the future direction of Australian science.
These problems are best highlighted by detailing the farcical process through which the NHMRC has eroded the pillars that should support every credible peer review process. This includes the involvement of qualified experts. Previous grant review panels were carefully considered and assembled. Typically, about 80% of the panel (usually 12 members) were independent laboratory heads with prior grant panel experience. Remaining members were either new laboratory heads or, rarely, senior postdoctoral fellows. For training purposes, some senior postdocs were invited to serve as confidential observers, preparing them for future panels. This formative educational process for emerging leaders has now been scrapped and replaced with a YouTube-style video for junior scientists to educate themselves on peer review. In this new system, each grant is assigned to four or five anonymous reviewers whose qualifications are unknown.
…there has been a systematic dismantling of high-quality review panels… in the name of efficiency…”
Below is the entire editorial.
Tony
———————————————————-
Science
Australia’s erosion of peer review
In Section Editorial
Mark A. Dawson and Massimo A. Hilliard
Throughout the world, peer review serves as the cornerstone of the scientific enterprise, providing rigorous quality control and building the confidence that underpins progress for both science and society. Without such a robust process, scientists and the general public would rapidly lose the ability to distinguish groundbreaking advances from noise, which undermines policy decisions, research translation, and most importantly, public trust in science. Sadly, that is exactly what has been happening in Australia.
Between 1992 and 2018, government support for fundamental research decreased by 17%, according to the Australian Academy of Science. Despite frustration in the gross underinvestment in biomedical research, Australian scientists were comforted by a trusted peer review system. For generations, Australia’s National Health and Medical Research Council (NHMRC), the major funding body for medical research, aspired to fund excellence through a careful process involving peer review grant panels. However, in 2020 the COVID-19 pandemic led to the necessary cancellation of the grant review panels that buttressed Australian science. Unfortunately, since then, there has been a systematic dismantling of high-quality review panels by the NHMRC in the name of efficiency, reduced administrative costs, and peer review flexibility. This has raised concerns across Australia’s scientific community that the peer review system is no longer reliable and thus poses an imminent threat to the future direction of Australian science.
These problems are best highlighted by detailing the farcical process through which the NHMRC has eroded the pillars that should support every credible peer review process. This includes the involvement of qualified experts. Previous grant review panels were carefully considered and assembled. Typically, about 80% of the panel (usually 12 members) were independent laboratory heads with prior grant panel experience. Remaining members were either new laboratory heads or, rarely, senior postdoctoral fellows. For training purposes, some senior postdocs were invited to serve as confidential observers, preparing them for future panels. This formative educational process for emerging leaders has now been scrapped and replaced with a YouTube-style video for junior scientists to educate themselves on peer review. In this new system, each grant is assigned to four or five anonymous reviewers whose qualifications are unknown.
…there has been a systematic dismantling of high-quality review panels… in the name of efficiency…
Also gone is a stringent process that ensured fairness and accountability. Bias and conflicts of interest were frequently laid bare in prior grant review panels. Furthermore, to account for variation in raw scores, benchmarking and normalization was performed to guarantee that only the top grants from each panel were prioritized for funding. All of these measures have now been abandoned for a process that favors convenience over diligence. Reviewers do not interact, remain anonymous, and are not accountable. Consequently, variations in opinions and scores are simply mathematically averaged rather than scientifically debated, resulting in a 10% increase in funding cut-off scores and a decline of funding from 17.3% (2018) for grants reviewed at panel to 8.1% (2025).
The previous NHMRC mechanism also provided applicants with detailed reviewer comments and the opportunity to submit a two-page response before adjudication. This process has been replaced by one that provides applicants with little feedback—initially with just raw scores, and more recently with an assessment summary of as few as 100 characters. Because there are often no distinguishing features to the reviews, it is often unclear whether a grant has even been read. When scientists receive these reviews, there is no pride or sense of meritocratic achievement for a successful grant and no solace or guidance for improvement if an application was unsuccessful. On the annual occasion when NHMRC grant outcomes are released, there is only one unifying sensation felt: Australian scientists are left with the stain of embarrassment of belonging to a system that lacks the credibility of rigorous scholarly review.
The prospect of reducing or discarding grant review panels has recently been raised in other countries, including the United States, as a measure to reduce administrative costs. Australia provides a stark example of the consequences of such an action. If left unchecked, Australia will soon have a generation of scientists that has never been adequately trained, supervised, or mentored in upholding the pillars of peer review to provide an equitable adjudication on the scientific merit and value of a grant proposal. The NHMRC needs to reinstate grant review panels to ensure research excellence, restore faith in Australian science, and prevent an exodus of talent to overseas.
———————-
Mark A. Dawson is a professor at the Peter MacCallum Cancer Centre and Sir Peter MacCallum Department of Oncology, University of Melbourne, and a professor at the Collaborative Centre for Genomic Cancer Medicine, University of Melbourne, Melbourne, Australia. [email protected] Massimo A. Hilliard is a professor at the Clem Jones Centre for Aging Dementia Research, Queensland Brain Institute, Faculty of Health, Medicine and Behavioural Sciences, The University of Queensland, Brisbane, Australia. [email protected]











