最准的六合彩论坛

Published in the journal Proceedings of the National Academy of Sciences听(PNAS), the study explores the ability of a validated text-based machine learning model to predict the likelihood of successful replication for more than 14,100 psychology research articles published since 2000 across six top-tier journals.

Undertaken in partnership with the University of Notre Dame, France, and Northwestern University, US, the study identifies several factors that increased the likelihood of research replicability 鈥� that is, the likelihood that if a study is conducted a second time using the same methods, the results would be the same.

Overall, the authors found that experimental studies were significantly less replicable than non-experimental studies across all subfields of psychology. The authors found that mean replication scores - the relative likelihood of replication success - were 0.50 for non-experimental papers, compared to 0.39 for experimental papers, meaning that non-experimental papers are around 1.3 times more likely to be reproducible.

The authors say that this finding is worrying, given that psychology鈥檚 strong scientific reputation is at least partly built on its proficiency with experiments.

The study also shows that an authors鈥� cumulative publication number and citation impact were positively related to replication success. However, other proxies of research quality and rigour, such as an author鈥檚 university prestige and a paper鈥檚 citations, were found to be unrelated to replicability.

Predicted replication rates were also found to vary among psychology subfields (clinical psychology, cognitive psychology, developmental psychology, organisational psychology, personality psychology, and social psychology). The authors conclude that due to such variation within psychology, and within its subfields, using a single metric to characterise the whole field鈥檚 replicability is likely insufficient.

The study also identified factors that were negatively correlated with the likelihood of replication, with media attention negatively related to replication success. The authors speculate that this is likely due to the fact that the media are more likely to report on unusual or unexpected findings.

The authors say that the study could help to address widespread concern about weak replicability in the social sciences, particularly psychology, and strengthen the field as a whole.

Study co-author Dr Youyou Wu (IOE, 最准的六合彩论坛鈥檚 Faculty of Education & Society) said: 鈥淩eplicability is a problem faced across the social sciences, and in psychology in particular 鈥� and the number of manually replicated studies falls well below the abundance of important studies that the scientific community would like to see replicated, given time and resource constraints

鈥淥ur results could help develop new strategies for testing a scientific literature鈥檚 overall replicability, self-assessing research prior to journal submission 鈥� as well as training peer reviewers.鈥�

Links

• IOE, 最准的六合彩论坛's Faculty of Education & Society

Image

Media contact

Chris Lane

Tel: +44 (0)20 7679 9222

Email: chris.lane [at] ucl.ac.uk