Peer Review: latest review (Introduction)
by David Turell , Tuesday, October 09, 2012, 14:56 (4430 days ago)
http://salvomag.com/new/articles/salvo22/bunk-science-peer-review.php-The article explains itself: solutions needed
Peer Review: another mess
by David Turell , Tuesday, February 26, 2013, 14:42 (4290 days ago) @ David Turell
Danish cell phone study very flawed:-http://www.the-scientist.com//?articles.view/articleNo/34518/title/Opinion--Scientific-Peer-Review-in-Crisis/
Peer Review: another mess
by David Turell , Thursday, May 30, 2013, 15:19 (4197 days ago) @ David Turell
Peer review is still frightening. Can't even agree on phoney resubmitted articles:-http://journals.cambridge.org/action/displayAbstract?fromPage=online&aid=6577844-At least the tide is turning
Peer Review: another opinion
by David Turell , Tuesday, June 25, 2013, 15:33 (4171 days ago) @ David Turell
An essay asking to kill peer review. How to replace it is not answered:-http://wattsupwiththat.com/2013/06/25/peer-evil-the-rotten-business-model-of-modern-science/#more-88722
Peer Review: another sting works
by David Turell , Friday, October 04, 2013, 15:46 (4070 days ago) @ David Turell
edited by unknown, Friday, October 04, 2013, 16:05
A Science reporter pulls a sting and the results are frightening:-http://www.sciencemag.org/content/342/6154/60.full-http://phys.org/news/2013-10-paper-publishing-reveals-lax-standards.html
Peer Review: another sting works
by BBella , Friday, October 04, 2013, 17:16 (4069 days ago) @ David Turell
A Science reporter pulls a sting and the results are frightening: > > http://www.sciencemag.org/content/342/6154/60.full > > http://phys.org/news/2013-10-paper-publishing-reveals-lax-standards.html-Our species has always been a sucker for the written word or for that matter belief itself. Once a delusion has caught on, like wildfire, the delusion begets more delusion and the masses become compelled to believe and there's no convincing the original belief was/is a hoax. But I assume it's a primal characteristic for survival within most species. Go with the flow or be consumed by it. Cynicism and skepticism has become a good sign we are growing and expanding as a species.
Peer Review: another sting works
by George Jelliss , Crewe, Friday, October 04, 2013, 17:49 (4069 days ago) @ David Turell
There is quite a lot about this "sting" on twitter. Here are some links:-Stephen Curry: Has numerous articles on Open Access Publishing http://occamstypewriter.org/scurry/-from Stephen Curry: is it about peer review or open access? http://im2punt0.wordpress.com/2013/10/04/science-mag-sting-of-oa-journals-is-it-about-open-access-or-about-peer-review/-from Ben Goldacre: an author who questions the ethics of the "sting" http://www.thefacultylounge.org/2013/10/schadefreude-for-those-who-publish-in-non-peer-review-law-reviews-and-the-blurry-line-between-human-.html-from Ben Goldacre: a site that lists malpractices http://retractionwatch.wordpress.com/-The publishing of scientific papers is evolving towards open access publishing combined with crowd-sourced reviewing.
--
GPJ
The future of science publishing
by George Jelliss , Crewe, Saturday, October 12, 2013, 00:08 (4062 days ago) @ George Jelliss
Another article on evolution of science publishing-http://www.frontiersin.org/Human_Neuroscience/10.3389/fnhum.2013.00291/full-This goes beyond peer review and journals to something like an online searchable collective consciousness!
--
GPJ
The future of science publishing
by David Turell , Saturday, October 12, 2013, 02:10 (4062 days ago) @ George Jelliss
George: Another article on evolution of science publishing > > http://www.frontiersin.org/Human_Neuroscience/10.3389/fnhum.2013.00291/full &am... > This goes beyond peer review and journals to something like an online searchable collective consciousness!-Thank you for an interesting article. My science paper writing goes well back before all of these factors, mushrooming piles of various journals, peer review which I intensely dislike. But heck, I'm long retired and chose not to pursue academic medicine.
Peer Review: another says bad
by David Turell , Tuesday, October 15, 2013, 18:33 (4058 days ago) @ George Jelliss
A review that tried to quantify the value of review says it is bad:-http://www.the-scientist.com//?articles.view/articleNo/37878/title/Useless-Peer-Review-/
Peer Review: bad science
by David Turell , Sunday, October 20, 2013, 01:08 (4054 days ago) @ David Turell
Too many PhDs chasing grant money. Too much emphasis on publish or perish. -http://www.economist.com/news/leaders/21588069-scientific-research-has-changed-world-now-it-needs-change-itself-how-science-goes-wrong
Peer Review: bad science
by David Turell , Friday, November 22, 2013, 01:24 (4021 days ago) @ David Turell
Same story, new study. Too many folks living off government grant money:-http://www.reuters.com/article/2012/03/28/us-science-cancer-idUSBRE82R12P20120328
Peer Review: bad science
by George Jelliss , Crewe, Tuesday, February 25, 2014, 08:31 (3926 days ago) @ David Turell
Publishers withdraw 120 gibberish papers!-http://www.nature.com/news/publishers-withdraw-more-than-120-gibberish-papers-1.14763-Labbé developed a way to automatically detect manuscripts composed by a piece of software called SCIgen, which randomly combines strings of words to produce fake computer-science papers.
--
GPJ
Peer Review: bad science
by David Turell , Tuesday, February 25, 2014, 15:18 (3926 days ago) @ George Jelliss
George: Publishers withdraw 120 gibberish papers! > > http://www.nature.com/news/publishers-withdraw-more-than-120-gibberish-papers-1.14763&a... > Labbé developed a way to automatically detect manuscripts composed by a piece of software called SCIgen, which randomly combines strings of words to produce fake computer-science papers.-Still more evidence of the publish or perish aspect of grantsmanship. When easy money is thrown at science to speed up research progress, fraud and garbage appear.
Peer Review: more fraud
by David Turell , Wednesday, July 09, 2014, 01:55 (3792 days ago) @ David Turell
Too much grant money too few new facts:-http://retractionwatch.com/2014/07/08/sage-publications-busts-peer-review-and-citation-ring-60-papers-retracted/#more-21437
Peer Review: good review
by David Turell , Sunday, September 28, 2014, 15:20 (3711 days ago) @ David Turell
The fact that much discussion is in the open is a great advance. Hidden agenda have little power with open blogs on the inernet, and pre-publication views of a 'discovery'. Note the Guardian forgets to discuss the 'global warming' debate.-http://www.theguardian.com/commentisfree/2014/sep/26/scientists-gravitational-waves-science
Peer Review: more study retractions
by David Turell , Wednesday, December 10, 2014, 22:06 (3637 days ago) @ David Turell
Too little good science chasing diminishing government grants:-http://retractionwatch.com/
Peer Review: shoddy publishing
by David Turell , Wednesday, December 17, 2014, 00:44 (3631 days ago) @ David Turell
Whew!-http://www.vox.com/2014/12/7/7339587/simpsons-science-paper-"A scientific study by Maggie Simpson, Edna Krabappel, and Kim Jong Fun has been accepted by two journals.-"Of course, none of these fictional characters actually wrote the paper, titled "Fuzzy, Homogeneous Configurations." Rather, it's a nonsensical text, submitted by engineer Alex Smolyanitsky in an effort to expose a pair of scientific journals — the Journal of Computational Intelligence and Electronic Systems and the comic sans-loving Aperito Journal of NanoScience Technology."
Peer Review: 2014 retraction review
by David Turell , Tuesday, December 23, 2014, 14:39 (3625 days ago) @ David Turell
Peer Review: Double blind reviews
by David Turell , Thursday, February 19, 2015, 15:07 (3567 days ago) @ David Turell
Should be an improvement:-http://www.the-scientist.com//?articles.view/articleNo/42203/title/Nature-Debuts-Peer-Review-Option/-"“Good scientists will continue to publish good papers in good journals under a double-blind peer review system,” wrote Boyan Garvalov of Justus Liebig University Giessen, Germany, in a January Advances in Regenerative Biology article (hat tip: Alexis Verger). “But every now and again a lesser known research team could make it on the strength of their work against a more famous one, when they would have failed in the single-blind setting—and this would be reason enough for me to endorse the shift to double-blind review.”"
Peer Review: More mess
by David Turell , Friday, March 27, 2015, 22:08 (3530 days ago) @ David Turell
43 papers withdrawn by publisher. Fraud.-http://www.washingtonpost.com/news/morning-mix/wp/2015/03/27/fabricated-peer-reviews-prompt-scientific-journal-to-retract-43-papers-systematic-scheme-may-affect-other-journals/?wpisrc=nl_evening&wpmm=1
Peer Review: More retractions
by David Turell , Tuesday, August 18, 2015, 14:03 (3387 days ago) @ David Turell
It continues:-http://www.the-scientist.com/?articles.view/articleNo/43761/title/Another-Mass-Retraction/-"Following up on the hunch of an editor who noticed irregularities in the reviewers suggested by submitting authors, Springer has identified more than five dozen papers that were published through manipulated peer review. The publisher is now pulling 64 papers, which were published in 10 of its journals, it announced today (August 17)."
Peer Review: psycology studies mostly wrong
by David Turell , Tuesday, September 01, 2015, 14:23 (3373 days ago) @ David Turell
Be careful how you interpret: only 39% reproducible:-http://www.the-scientist.com/?articles.view/articleNo/43875/title/Psychology-s-Failure-to-Replicate/-"According The New York Times, the study authors noted that the lack of reproducibility for more than 60 percent of the studies was not linked to fraud or misconduct, but rather may reflect a collection of published conclusions that were stronger than their data. Another possibility is that the study reproduction results were wrong, or that small differences in study design made big impacts on the results of both analyses."
Peer Review: psycology studies mostly wrong
by David Turell , Wednesday, September 23, 2015, 05:28 (3351 days ago) @ David Turell
Another article on the same findings, 60% wrong.:-http://www.breakpoint.org/bpcommentaries/entry/13/28188- "In the New York Times, Benedict Carey describes a University of Virginia-led effort to reproduce the findings of 100 key psychological studies published in top journals. Over 250 researchers chose some of the most often cited findings in their field and tried to replicate the results with their own experiments. The outcomes, published in the journal, “Science,” weren't pretty. Of the 100 studies tested, 60 did not yield the results their authors reported. In other words, the findings couldn't live up to a basic requirement of science—repeatability. It's a revelation Carey says confirms many scientists' worst fears.-“'The vetted studies,” he explained, “were considered part of the core knowledge by which scientists understand the dynamics of personality, relationships, learning and memory.” And the fact that so many studies were called into question makes one question the work of therapists and educators who relied on that research to do their jobs.-"Now what's behind this embarrassing revelation? Why are so many scientists apparently exaggerating and misinterpreting their findings? Carey points to what the scientists themselves describe as “a hypercompetitive culture across science that favors novel, sexy results and provides little incentive for researchers to replicate the findings of others, or for journals to publish studies that fail to find a splashy result.”-"In other words, sensationalist science is its own undoing. But there's more to it. Norbert Schwarz, a psychology professor at the University of Southern California, tells the Times that many senior researchers bristle at the thought of a younger, less experienced scientist critiquing their work. “There's no doubt,” he said, “that replication is important, but it's often just [seen as] an attack, a vigilante exercise.”-"In other words, the real flaw in a lot of research isn't technical or methodological. It's just old-fashioned human pride. And it's not restricted to psychology or the social sciences. Dr. John Ioannidis, director of Meta-Research at Stanford, hints that the peer-review climate could be even more toxic in other fields, like cell biology, economics, neuroscience, clinical medicine, and animal research, calling the reliability of science itself into question."
Peer Review: more bad press
by David Turell , Wednesday, November 04, 2015, 00:40 (3309 days ago) @ David Turell
Theodore Dalrymple, a noted English writer and a physician comments on fraud in peer review:-http://pjmedia.com/lifestyle/2015/10/31/peer-review-fraud-on-the-rise-at-scientific-journals/-"But a recent article in the New England Journal of Medicine draws attention to a relatively new form of fraud. Before accepting a paper for publication, reputable scientific journals send it out to peer review, that is to say to other workers in the field who criticize it, make suggestions for improvement, and recommend either acceptance or rejection. An author whose paper is rejected by one journal need not despair: he can try other journals in a descending order of prestige.-"Peer review is time consuming and it is often difficult for the editors of general journals, such as the Lancet, the New England Journal and so forth, to be familiar with the experts in all fields. The editors of smaller journals do not have the resources of their more eminent confrères necessary to find them, and they, the editors, are frequently judged by the speed with which they publish manuscripts sent to them. Scientists are anxious to be published as quickly as possible because others in their field might publish before them, and to be second to publish a discovery is about as useful as being the seventh best javelin thrower in the world.-"Because of super-specialization, the authors of papers themselves are nowadays often asked to suggest referees for peer review of their own work, but this, of course, leaves an opening for the practice of fraud. In a modern variant on Gogol's Dead Souls, some scientists have been caught sending their papers for peer review to non-existent reviewers, complete with a curriculum vitae and an e-mail address. The article quotes the author of a blog on scientific research called “Retraction Watch,” who said “This is officially becoming a trend:” an odd way to put it, since either it is a trend or it isn't, official recognition having nothing to do with it. There are even companies in China, apparently, that will help scientists to manufacture bogus peer reviews. A new twist would be for the rivals of those scientists to pay for bad reviews. Everything is possible in this crooked world of ours.-"The pressure on academics to publish, irrespective of whether they have anything to say, either for the sake promotion or even of mere continuance in post, is the soil which allows this particular weed in the garden of human dishonesty to flourish. Two large publishers of scientific journals, Sage and Springer, have retracted more than 100 papers in the last year because of bogus peer review. Neither the article nor the commentary from readers on it mentions that a bogus peer review does not necessarily mean that the science is bogus too, though it stands to reason that it is likely to be. But what stands to reason may not be the case, and as far as I know, no one has looked into this question.-"I look forward to the next kind of fraud in medical research."-No need for comment.
Peer Review: more bad press
by David Turell , Sunday, December 02, 2018, 21:50 (2184 days ago) @ David Turell
Two new articles on how bad it is:
https://www.realclearscience.com/articles/2018/11/26/junk_science_has_become_a_profitab...
"Science is supposed to be self-correcting. Smart editors. Peer review. Competition from other labs. But when we see that university research claims – published in the crème de la crème of scientific journals, no less -- are so often wrong, there must be systematic problems. One of them is outright fraud – “advocacy research” that has methodological flaws or intentionally misinterprets the results.
"Another is the abject failure of peer review, which is especially prevalent at “social science” journals. The tale of three scholars who tested the integrity of journals’ peer review is revealing. They wrote 20 fake papers using fashionable jargon to argue for ridiculous conclusions, and tried to get them placed in high-profile journals in fields including gender studies, queer studies, and fat studies. Their success rate was remarkable: By the time they took their experiment public on [October 2nd], seven of their articles had been accepted for publication by ostensibly serious peer-reviewed journals. Seven more were still going through various stages of the review process. Only six had been rejected.
***
"This situation creates a self-serving, self-aggrandizing process. Researchers have been thriving by churning out this junk science since at least the early 1990s, and as most of the work is government funded, it’s ripping off taxpayers as well as misleading them. It’s a kind of business model in which the dishonest researchers win, and you lose: You lose on the initial cost of the research, the flawed policy implications, and the opportunity costs.
"Because editors and peer-reviewers of research articles have failed to end widespread statistical malpractice, it will fall to government funding agencies – or their appropriators, the Congress -- to cut off support for studies with flawed design; and to universities, which must stop rewarding the publication of bad research. Only last month a tenured professor at Cornell University was forced to resign for data dredging and HARKing, but to truly turn the tide, we will need pressure from many directions.
'And the same stuff in another article:
https://www.dailywire.com/news/38793/junk-science-everywhere-and-media-eat-it-ashe-schow
"The two say publishing articles in “predatory journals,” which publish just about anything for the right price, also helps spread junk science.
"Science “journalists” are a huge part of the problem. If the talking points make for a good headline, like Young and Miller’s example about coffee, then the “research” will get written up, no questions asked.
"Young and Miller ultimately ask what can be done to save science, and suggest the solution might fall on government funding agencies “to cut off support for studies with flawed design; and to universities, which must stop rewarding the publication of bad research.” But since so many studies these days just confirm preconceived notions, it seems unlikely that partisans at federal agencies or congressional appropriators will stop giving funds."
Comment: All science professors live on grant monies. Governments love to pass out the money because it looks good to the voting public. The taxpayers are the goats who are made to support this racket, and most don't know it. I can't tell you how many ' new' articles I see that simply repeat what we knew 40+ years ago as physicians.
Peer Review: more bad press
by dhw, Monday, December 03, 2018, 14:35 (2184 days ago) @ David Turell
DAVID's comment: All science professors live on grant monies. Governments love to pass out the money because it looks good to the voting public. The taxpayers are the goats who are made to support this racket, and most don't know it. I can't tell you how many ' new' articles I see that simply repeat what we knew 40+ years ago as physicians.
Thank you for another important article. Every week there seems to be a new sensational discovery that will change the face of science - and the next week it is rebutted! All the more reason why we should retain a degree of independence in our thinking, bearing in mind that all the fundamental mysteries we discuss remain unsolved.
Peer Review: predatory journals
by David Turell , Monday, March 11, 2019, 00:37 (2086 days ago) @ David Turell
It is important for scientists to get published. Unfortunately there are journals that invite authors to publish with them posing as authentic peer-reviewed publications:
https://cosmosmagazine.com/society/paper-tigers-when-scientists-hoax-publishers
"“Predatory journals” pretend to be high quality peer-reviewed journals, when they’re really just scams out to make money. It can be difficult to tell the difference between real and predatory journals, however, and many academics have been tricked. But sometime the tables are turned.
"Gary Lewis, a senior lecturer in psychology from Royal Holloway University in London, decided to prank a predatory journal that emailed him out of the blue. He concocted an utterly mad paper about British politicians and the hand they used to wipe their behinds. It argued that conservative, or right wing, politicians would wipe with their left hand, and left wing, or progressive, politicians would wipe with their right.
"He described himself as a researcher from the Institute of Interdisciplinary Political and Faecal Science and told the publishers, Crimson Publishing, that the paper had been peer reviewed by Dr I P Daly. Unbelievably, Testing inter-hemispheric social priming theory in a sample of professional politicians – a brief report was published in full.
***
"When Christoph Bartneck, an industrial designer who works on the interaction of humans and computers and robots at the University of Canterbury in New Zealand, received an email asking if he’d like to submit a paper to the International Conference on Atomic and Nuclear Physics, he smelled a rat – and decided to do so.
"He knew nothing about physics, so he let the autocomplete function of his Apple devices do the work for him. He started sentences using words like nuclear or atomic and let the iOS software complete them. Obviously, it made no sense whatsoever: even the title was crazy – Atomic Energy will have been made available to a single source. What?
"The first line of the paper is awesome: “Atomic Physics and I shall not have the same problem with a separate section for a very long long way.”
"Nonetheless, within three hours the paper had been accepted and Bartneck was asked for $1099. He didn’t pay.
***
"Another MedCrave publication – International Journal of Molecular Biology: Open Access – also got pranked. The psychology blogger known only as Neuroskeptic submitted an article about the midichlorians found in each cell that help people connect to the Force. If that sounds familiar, it’s because it’s straight from the Star Wars prequel movies.
"It’s completely full of nonsensical Star Wars references and is basically plagiarised from the Wikipedia page on mitochondria, the small, very real organelles found in each cell of our bodies. Even worse, he admitted to doing this in the paper itself. They still published it.
***
"This is my favourite. In 2005, computer science professors Eddie Kohler from Harvard University and David Mazières from Stanford University, both in the US, became so sick and tired of predatory journals and conferences spamming their inbox that they put together a 10-page fake article that they would automatically send off to any predators that emailed them.
The result is a simple as it is naughty. The entire article, including the graphs and flow charts, is made up of only seven words: “Get me off your f@#king mailing list”. Computer scientists found it so funny that it spread far and wide.
"Things begin to get really hilarious when Peter Vamplew, an associate professor in IT at Federation University Australia, sent off Kohler and Mazières’ original paper to the International Journal of Advanced Computer Technology.
"The predatory journal had emailed him with an invitation to submit a paper, and immediately accepted it for publication. I think we can guess that it isn’t peer-reviewed."
Comment: It is nice to have lighter articles to chuckle over. Money is the source of all evil. With my background, medical research articles and books published, for several years, out of the blue, I received invitations to "important" foreign conferences, all of which I ignored.
Peer Review: predatory journals
by dhw, Monday, March 11, 2019, 11:15 (2086 days ago) @ David Turell
Many thanks for a good laugh! Keep ‘em coming!