Advances in automation technology mean that robots and artificial intelligence programs are capable of performing an ever-greater share of our work, including collecting and analyzing data. For many people, automated colleagues are still just office chatter, not reality, but the technology is already disrupting industries once thought to be just for humans. Case in point: science publishing.
Increasingly, publishers are experimenting with using artificial intelligence in the peer review process for scientific papers. In a recent op-ed for Wired, one editor described how computer programs can handle tasks like suggesting reviewers for a paper, checking an author’s conflicts of interest and sending decision letters.
In 2014 alone, an estimated 2.5 million scientific articles were published in about 28,000 journals (and that’s just in English). Given the glut in the industry, artificial intelligence could be a valuable asset to publishers: The burgeoning technology can already provide tough checks for plagiarism and fraudulent data and address the problem of reviewer bias. But ultimately, do we want artificial intelligence evaluating what new research does — and doesn’t — make the cut for publication?
The stakes are high: Adam Marcus, co-founder of the blog Retraction Watch, has two words for why peer review is so important to science: “Fake news.”
“Peer review is science’s version of a filter for fake news,” he says. “It’s the way that journals try to weed out studies that might not be methodologically sound, or they might have results that could be explained by hypotheses other than what the researchers advanced.”
The way Marcus sees it, artificial intelligence can’t necessarily do anything better than humans can — they can just do it faster and in greater volumes. He cites one system, called statcheck, which was developed by researchers to quickly detect errors in statistical values.
“They can do, according to the…