Unlock the Lab - Live Dashboard

0
Average Score

Mean prediction accuracy score across all participants

0
Total Ratings

Number of study ratings submitted by all participants

0
Participants

Total number of different users who have submitted ratings

0
Active Now

Users currently rating studies (active in last 60 seconds)

πŸ“Š Review Your Results

Completed the workshop? Enter your username below to view your personalised results page.

🎯 Part 1: Prediction Performance

How well did participants predict what others would rate each study?

πŸ† Top Predictors

Top performers ranked by prediction accuracy. Scores show how well participants predicted crowd ratings. This leaderboard includes only participants who completed at least 12 ratings.

Loading leaderboard...

βš–οΈ Criterion Importance

Average percentage of tokens assigned to each criterion by participants, reflecting what they considered most important when evaluating study quality.

No data yet.

πŸ“Š Part 2: Rating Patterns

How did participants actually rate the quality of each study?

πŸ“Š Average Quality Ratings by Study

Mean quality rating (1-7 scale) with 95% confidence intervals. Error bars show rating variabilityβ€”wider bars indicate less agreement among participants. Data includes only participants who completed at least 12 ratings. Click on any bar to view detailed statistics and study information.

πŸ“ˆ Detailed Rating Statistics

Complete breakdown of how participants rated each study's quality. Std Dev measures disagreement (higher = more variable ratings). Agreement % shows consensus level. Color scales highlight relative values. Click study names to view detailed information. Click column headers to sort.

Study Quality Responses Mean Rating Std Dev Min Max Agreement %
Loading data...
×

Author: Dr Pablo Bernabeu, Department of Education, University of Oxford

Legal disclaimer: This app and workshop were created by Dr Pablo Bernabeu in a personal capacity during spare time. The employer is not affiliated with, does not endorse, and bears no liability for this app or workshop.

Materials: github.com/pablobernabeu/Unlock_the_Lab

Licence: CC BY 4.0 β€” Free to use with attribution

πŸ’‘ Contributions welcome! Suggest improvements or report issues on GitHub.

Admin

πŸ” Admin Access

Time remaining: 10s