Professor Leigh Ann Vaughn publishes paper on Many Labs 3 research reproducibility project

09/18/16

Contributed by Leigh Ann Vaughn

Leigh Ann Vaughn, Associate Professor of Psychology, is a co-author on "Many Labs 3: Evaluating participant pool quality across the academic semester via replication," which was published in the Journal of Experimental Social Psychology on September 17, 2016.

This publication is the culmination of work by researchers at 22 institutions in the U.S. and Canada, which was headed by Charles Ebersole of the University of Virginia. The article acknowledges the following Ithaca College alumnae for contributing to the data collection in fall 2014: Emma Hayden Arnaut (2015), Patricia Herrmann (2015), Christine Hill (2015), Kanako Kambe (2016), Abigail Kane-Gerard (2016), and Hayley Paquette (2015). These students were psychology majors in Professor Vaughn's Social Judgment Research Team.

The article, data sets, and all other materials are publicly available at https://osf.io/ct89g/

Results of the project are summarized in the abstract:

"The university participant pool is a key resource for behavioral research, and data quality is believed to vary over the course of the academic semester. This crowdsourced project examined time of semester variation in 10 known effects, 10 individual differences, and 3 data quality indicators over the course of the academic semester in 20 participant pools (N = 2696) and with an online sample (N = 737). Weak time of semester effects were observed on data quality indicators, participant sex, and a few individual differences—conscientiousness, mood, and stress. However, there was little evidence for time of semester qualifying experimental or correlational effects. The generality of this evidence is unknown because only a subset of the tested effects demonstrated evidence for the original result in the whole sample. Mean characteristics of pool samples change slightly during the semester, but these data suggest that those changes are mostly irrelevant for detecting effects."

2 Comments



https://www.ithaca.edu/intercom/article.php/20160918130510660