Scivillage.com Casual Discussion Science Forum

Full Version: Most Psychology Experiments Fail Replication Test
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
A team of several hundred international researchers tried to replicate 100 psychological experiments reported in top psychological journals. They were only able to replicate 36% of them. Even when results were successfully replicated, effects tended to be smaller and less dramatic than were originally reported.

Results varied by psychological specialty. Social psychology papers were only replicated 25% of the time. Cognitive psychology did a little better, with replication in about half the cases.

Observers are blaming these appalling results on the academic subculture, where an academic's reputation depends on what he or she publishes. So there is a lot of pressure to publish dramatic results that generate talk and rise to the top of the citation rankings. As one of the authors of this replication study writes, "What it takes to be a successful academic is not necessarily that well alligned with what it takes to be a good scientist".

http://www.theguardian.com/science/2015/...nt-results
(Aug 28, 2015 07:11 PM)Yazata Wrote: [ -> ][...] Observers are blaming these appalling results on the academic subculture, where an academic's reputation depends on what he or she publishes. So there is a lot of pressure to publish dramatic results that generate talk and rise to the top of the citation rankings. [...]

The physical sciences are the group that has enjoyed a good stretch of being above suspicion. With the exception of highly fickle nutrition / health / medical research that repeatedly swings one way and then another in regard to some of their specific study targets.

But the supposed reputable status of the physical sciences is oozing downward, too. What with the heated competitions for government funding, the intrusion of special interests, and the continuing but exploding reliance on the commercial / industrial sector to provide non-institution scientists with employment ("we OWN you, we want THESE conclusions or results from your work"), as well as the similar "get published or die" pressures above.