Mean prediction accuracy score across all participants
Number of study ratings submitted by all participants
Total number of different users who have submitted ratings
Users currently rating studies (active in last 60 seconds)
Completed the workshop? Enter your username below to view your personalised results page.
How well did participants predict what others would rate each study?
Top performers ranked by prediction accuracy. Scores show how well participants predicted crowd ratings. The leaderboard includes all participants who have submitted at least one rating. Click any entry to view that participant's personalised results page.
Average percentage of tokens assigned to each criterion by participants, reflecting what they considered most important when evaluating study quality. Error bars show 95% confidence intervals for the mean percentage across participants.
No data yet.
How did participants actually rate the quality of each study?
Mean quality rating (1-7 scale) with 95% confidence intervals. Error bars show rating variabilityβwider bars indicate less agreement among participants. All participants with at least one valid rating are included. The leaderboard shows the subset who completed the full workshop. Click on any bar to view detailed statistics and study information.
Complete breakdown of how participants rated each study's quality. Std Dev measures disagreement (higher = more variable ratings). Agreement % shows consensus level. Color scales highlight relative values. Click study names to view detailed information. Click column headers to sort.
| Study | Quality | Responses | Mean Rating | Std Dev | Min | Max | Agreement % |
|---|---|---|---|---|---|---|---|
| Loading data... | |||||||
Author: Dr Pablo Bernabeu, Department of Education, University of Oxford
Legal disclaimer: This app and workshop were created by Dr Pablo Bernabeu in a personal capacity during spare time. The employer is not affiliated with, does not endorse, and bears no liability for this app or workshop.
Materials: github.com/pablobernabeu/Unlock_the_Lab
Licence: CC BY 4.0 β Free to use with attribution
π‘ Contributions welcome! Suggest improvements or report issues on GitHub.