Peer review has some problems – but the science community is working on it

  • Written by Dr Jessica Borger, Postdoctoral Research Fellow in Immunology, Monash University
Peer review has some problems – but the science community is working on it

Peer review is the central foundation of science. It’s a process where scientific results are vetted by academic peers, with publication in a reputable journal qualifying the merits of the work and informing readers of the latest scientific discoveries.

But peer review sometimes gets a bad rap – criticised for a purported lack of transparency, low accountability and even poor scientific rigour.

There’s now considerable movement towards tweaking or even remodelling the peer review system. Key areas of focus include making journal editors more directive in the process, rewarding reviewers, and improving accountability of editors, reviewers and authors.

Read more: Science isn't broken, but we can do better: here's how

Peer review relies on volunteers

The peers in the peer review system are volunteer academics with expertise relevant to the paper being considered. But it’s hard to find suitable volunteers.

Reviewing is more complex and onerous than just rejecting or accepting a manuscript. More often than not, a reviewer suggests additional experiments that authors have overlooked, or challenges the interpretation of some of the data. This initiates a dialogue between author and reviewer aimed at improving the integrity and scientific merit of the paper.

It takes time – at least seven to eight hours per paper done properly, with no remuneration or recognition for the reviewer and hence rarely regarded as a priority in a busy academic schedule. As a result, scientific rigour can be lost when reviews become fast-tracked.

Read more: Not just available, but also useful: we must keep pushing to improve open access to research

On the other extreme, sometimes novice reviewers (perhaps trying to impress the editor) can turn small discrepancies into significant flaws. This presents a breakdown in the fairness of the review process.

Overall, these issues create a limited number of peer reviewers in practise, an outcome that can lead to cronyism.

Delving further into this remaining inadequate pool of reviewers, a significant gender gap is also apparent. Nature reports that less than 20% of its reviewers in 2017 were women.

More accountability from editors

We should demand more of our journal editors.

Editors can become more proactive by rejecting articles that are not at publication standard upon submission, rather than placing the arduous task on a reviewer to be both scientist and copy checker.

To retain and train novice reviewers, clearer evaluation criteria from editors would vastly improve the reliability and quality of submitted papers.

Editors could also engage better in a dynamic dialogue between author and reviewer – digital communication technologies enable real-time global discussions to facilitate streamlined review processes for all involved.

Read more: Bored reading science? Let's change how scientists write

Recognition of reviewers

Traditionally, editors are held up to be a revered part of the peer review process, and reviewers are simply not acknowledged for their contributions. But this is changing.

To promote increased transparency, greater accountability and fairness, open peer review processes list reviewers and editors in addition to authors in each publication.

This is happening now in newly established online journals such as eLife. Independent platform Publons rewards reviewers by listing all peer reviewing and editorial activity to provide evidence of a reviewer’s expert contributions in their field. Publons also runs a reviewer awards program.

Read more: Demasi cleared, but images in science continue to attract intense scrutiny

Similarly, Elsevier has started a “reviewer recognition programme”, extending various rewards and publishing a yearly list acknowledging the contributions of all the reviewers.

This process has been met with criticism by some who insist anonymity guarantees unbiased opinions.

Post- vs pre-publication peer review

It’s now becoming clear that scientific dialogue does not need to stop at the endpoint of publication, and that not all problems within a manuscript may be identified at the time of peer review.

Post-publication peer review in its most validated form, involves a journal such as Frontiers asking academics to perform a published interactive dialogue with authors during the review process, giving a level of accountability and responsibility.

Other journals such as Faculty of 1000 Research, Copernicus and PLOS ONE publish papers with minimal evaluation. This shifts the focus towards post-publication peer review – authors, reviewers and readers critique and comment on the paper to judge its scientific merit in the public domain.

Alternative post-publication peer review platforms such as ScienceOpen invite all scientists registered with digital identifier ORCID to write a review or comment on DOI-linked papers. This facilitates engagement of a large cross-section of the scientific community for dynamic appraisal of a publication’s scientific merit.

Forums such as Pubpeer invite anonymous commentary from anyone in the scientific or general community. This occurs without moderation, openly facilitating the possibility of trolling and abusive behaviour at times culminating in legal action.

Time to try something new?

Peer review is not ready to be retired – but it is primed to change.

A recent trial by eLife intends to radically transform the roles of editor, reviewer and author. According to this model, if a senior editor deems a publication worthy of going to review, this paper immediately qualifies for publication.

Read more: Weakened code risks Australia’s reputation for research integrity

Once under review, an open dialogue between author and reviewers takes place. Upon receipt of reviewers’ recommendations, the authors can decide to continue experiments if advised, retract the paper or publish it. This leaves the author’s decision to the scrutiny of the general scientific community.

This innovation may greatly improve the transparency of open peer review, increase accountability on behalf of all participants and reduce burden on the peer review system. It addresses the three major strategies required for improvement of the peer review system. But is it a step too far, too soon? Time will tell.

The overall goal of debates around peer review and appearance of new publication platforms and approaches is to create a united front of authors, reviewers and editors to uphold scientific integrity.

This is vital not just within academic circles, but also to maintain the reputation of science in the broader community.

Authors: Dr Jessica Borger, Postdoctoral Research Fellow in Immunology, Monash University

Read more http://theconversation.com/peer-review-has-some-problems-but-the-science-community-is-working-on-it-99596

Australia Today

Capturing the shadow of Saturn's moon Titan from right here on Earth

David Coward, Associate professor, University of Western Australia

NASA's Cassini spacecraft captures Saturn's largest moon, Titan, passes in front of the planet and its rings.NASA/JPL-Caltech/Space Science InstituteTitan is Saturn’s largest moon, and it is more like a planet than a moon in many respects.It has a thick atmosphere as well as wind, rivers, lake...

Read more

Battle scars reveal the life of 'Mephisto', a WW1 German tank from a century ago

Michael Westaway, Senior Research Fellow, Australian Research Centre for Human Evolution, Griffith University

Mephisto after its capture in France by the Australian 26th Battalion.Queensland Museum, Author providedWhat can we possibly learn from the archaeological study of a World War I battle tank? Quite a lot, it turns out, when the attention is devoted to a rare German-built A7V Sturmpanzerwagen tank kno...

Read more

are phone-obsessed teens at greater risk of ADHD?

Hannah Kirk, Research Fellow in Psychology, Monash University

Hyperactivity and inattentiveness doesn't mean you have ADHD.Ant RozetskyThis week, news outlets across the world reported a study from the Journal of the American Medical Association (JAMA) linking digital media exposure to reduced attention spans and attention deficit/hyperactivity disorder (ADHD)...

Read more

Is the 'Zero Hour' youth climate march a turning point, or more of the same?

Marc Hudson, PhD Candidate, Sustainable Consumption Institute, University of Manchester

This weekend, young climate activists will march through Washington DC’s National Mall. The rally, part of the Zero Hour movement, is another sign of the concern and dismay felt by young people after 30-plus years of prevarication and hesitation by their elders. Just as young Americans are rea...

Read more

Michelle Grattan on the Mayo byelection and crossbenchers in the parliament

Michelle Grattan, Professorial Fellow, University of Canberra

Centre Alliance candidate Rebekha Sharkie is polling strongly ahead of next weekend's byelection in the South Australian seat of Mayo.AAP/Roy VandervegtMichelle Grattan discusses the week in politics with Director of the University of Canberra’s Institute for Governance and Policy Analysis, Ma...

Read more

do neckties reduce blood supply to the brain?

Steve Kassem, Postdoctoral fellow, Neuroscience Research Australia

The fashion advice is generally to tighten ties so they're tight but not too tight.from www.shutterstock.comNews reports about a study from Germany may provide the ultimate excuse for men to dress more casually for work, finding neckties reduce blood supply to the brain.The study showed that wearing...

Read more

Holidays & Travel

Luxury Camping Adventures Around the World

Perhaps in direct response to the dominance of technology in the modern world, many travelers are feeling a strong draw towards nature. While some are able to fully embrace their...

Dredging works underway Plantation Island

Tourists and workers travelling to popular tourist destination Plantation Island, Fiji, are set to benefit from safer access when marine channel dredging is completed at the end of June 2018...

Top 5 Tips for Traveling With Dogs

Travelling with your dog can be thrilling, but sometimes it can turn into a real nuisance. Unless you know how to properly restrain the pooch, whether it’ll be able to...

Top Island Destinations for 2018

When we picture island destinations in our minds, we often imagine a tropical beach of white sand, a sun lounger laid out in the shade of a line of palm...

Why Car Rental Excess Insurance is a Smart Choice

Some car rental agencies include basic damage cover in the standard rental fee, with the option to add on liability reduction, or excess insurance. The addition of excess insurance normally...

More Than a Third of Australians Feel 'Too Busy' With Work to Take a Holiday

New research from InterContinental Hotel & Resorts has unveiled a large number of Australians (32 percent) are simply too busy with work to take some much-needed rest and relaxation. Almost...

Matakauri Lodge and Mahu Whenua Lodge

TRIED, TRUE AND SOMETHING NEW  A luxurious accommodation package at Matakauri Lodge + Mahu Whenua Lodge South Island, New Zealand  Available 1 May, 2018 - 30 September, 2018   Central Otago, NEW ZEALAND –...

Heaven is the Adelaide Hills

Looking for a quick getaway? Enjoy food and wine? How about stunning countryside? Look no further! The Adelaide Hills has something for everyone. We flew to Adelaide for a weekend-getaway...

5 Amazing Australian Holiday Ideas

Australia is one of the most fantastic places in the world to travel, explore, and witness all of the beauty that Mother Nature has to offer. With so much rich...

Fashion & Beauty

Groom To Do List

Sorry Aussie Men, you no longer just pay for the alcohol, flowers and marriage license. Times have certainly changed. Wedding Expert shares what Australian Grooms are now expected to do before...

Simple Secrets To A More Confident Smile

We all know just how important first impressions are. After a handshake, what’s one of the first things people will notice about you? It’s your smile. A friendly smile is...

Improve Your Body Confidence and Feel Great

No matter how good you feel about yourself, sometimes you just can’t help but see a few little flaws that seem gigantic to you and make you feel self-conscious. Whether...

First-Timer Tips For Your First Lip Filler Appointment

Getting injectable lip fillers can be a quick and effective way to plump up your smile with minimal drama. They’re a cost-effective and safe way to boost the natural shape...

The Most Common Skin Conditions and How to Deal with Them

We often underestimate the importance of our skin, but as the largest organ in our body, and our primary layer of defense, it is constantly affected by many environmental factors...

Beach Babe Basics: Everything You Need to Look Stylish at the Beach

Summer is right around the corner, and this year, we all should make the best of it. Right now, it is not just about looking stylish on the streets, it...

HEALTH

Eye Health Dos and Don'ts

Most people take their eyes for granted and spend little to no time thinking about their eye health until they notice something wrong. This leads to plenty of common and...

Non-invasive Cosmetic Treatments

In a world where everyone is chasing perfection, plastic surgeries have become more and more common to the point where it’s odd if you don’t get one during your life...

My Health Yoga

Carrie-Anne Fields of My Health Yoga has taken her Gold Coast yoga teacher training worldwide. She started her health business 20 years ago aged 22 and has grown into a...

Fit Body 101 - Increase Your Fitness Effectiveness

You have to find some space for physical exercise in your weekly schedule in order to live a good life. Embracing this way of life is very beneficial because it...

The World of Dentistry: 5 Most Common Dental Procedures in Australia

Are you dissatisfied with the state of your pearly whites? Do you often experience discomfort and pain while eating and drinking? Well, be sure that you’re not the only one...

How You Can Conquer Your Dental Anxiety

Does the thought of going to the dentist fill you with dread? Well, you will be pleased to know that you are not the only one. A large number of...

LIFE STYLE

Dog Flea Allergy

Severe itchy skin disease in dogs causes Flea bite hypersensitivity. The itch is as a result of an allergic reaction to the saliva of the flea which is injected into...

5 Ways to Turn Your Bedroom into a True Zen Retreat

The bedroom should be our little sanctuary where we come to relax after a long day of work. However, in order to be able to unwind all the accumulated stress...

Things to Consider when Deciding on your Wedding Flowers for the Big Day

Choosing the wedding flowers is a complicated process where you have to take into account many elements, from the wedding dress to the wedding theme. You can discover in this...

Renovating tips for your house

There are very few property owners who move into a house where they don’t want to make any changes. Alterations are almost inevitable every time you move-house, but alterations can...

Tips for Decluttering Your Yard

Decluttering probably sounds like a tedious job, but it’s essential if you want to have a nice, well-decorated backyard. Bad organization habits and hoarding can eventually lead to clutter, and...

Dry Carpet Cleaning Vs Steam Carpet Cleaning: Which one to Choose?

A clean carpet not only improve your interiors, increases your comfort around the office and home but also beneficial for your health. This is why it is necessary to choose...

FOOD & DINING

Morning greens: the breakfast skincare regime

It’s safe to assume that most Aussies fail to eat enough greens. Although this was momentarily resolved with the rise and popularity of the green juice movement, the lack of...

Best Hidden Gem Hong Kong Restaurants

You finally find yourself enjoying the endless beauties of China and this fascinating city. In a place with so much variety, all your senses will be wide awake, and your...

JOHNNY DI FRANCESCO NAMED OFFICIAL AMBASSADOR OF EAT STREET MELBOURNE

Johnny Di Francesco, world champion pizzaiolo and owner of Melbourne’s Gradi Group of restaurants, is excited to announce he has been named official ambassador for Eat Street Melbourne 2018. As Ambassador...

The best Mother's Day gift EVER!

Whether it’s to celebrate a special occasion, or just wind down at the end of a long day, there’s nothing much better than pouring yourself a glass (or two…) of...

Sing for Your Supper at Chargrill Charlie’s

To celebrate the final curtain call of the Barden Bellas, Chargrill Charlie’s is giving you the chance to Sing for your Supper! Show off your best acapella vocals to win...

MAKE IT WINE TIME, ANY TIME

Whether it’s to celebrate a special occasion, or just wind down at the end of a long day, there’s nothing much better than pouring yourself a glass (or two…) of...