Mean prediction accuracy score across all participants
Number of study ratings submitted by all participants
Total number of different users who have submitted ratings
Users currently rating studies (active in last 60 seconds)
Completed the workshop? Enter your username below to view your personalised results page.
How well did participants predict what others would rate each study?
Top performers ranked by prediction accuracy. Scores show how well participants predicted crowd ratings. This leaderboard includes only participants who completed at least 12 ratings.
Average percentage of tokens assigned to each criterion by participants, reflecting what they considered most important when evaluating study quality.
No data yet.
How did participants actually rate the quality of each study?
Mean quality rating (1-7 scale) with 95% confidence intervals. Error bars show rating variabilityβwider bars indicate less agreement among participants. Data includes only participants who completed at least 12 ratings. Click on any bar to view detailed statistics and study information.
Complete breakdown of how participants rated each study's quality. Std Dev measures disagreement (higher = more variable ratings). Agreement % shows consensus level. Color scales highlight relative values. Click study names to view detailed information. Click column headers to sort.
| Study | Quality | Responses | Mean Rating | Std Dev | Min | Max | Agreement % |
|---|---|---|---|---|---|---|---|
| Loading data... | |||||||
Author: Dr Pablo Bernabeu, Department of Education, University of Oxford
Legal disclaimer: This app and workshop were created by Dr Pablo Bernabeu in a personal capacity during spare time. The employer is not affiliated with, does not endorse, and bears no liability for this app or workshop.
Materials: github.com/pablobernabeu/Unlock_the_Lab
Licence: CC BY 4.0 β Free to use with attribution
π‘ Contributions welcome! Suggest improvements or report issues on GitHub.