Malmo Collaborative AI Challenge

Leaderboard


This leaderboard shows current team scores for the Malmo Collaborative AI Challenge. For more details, see the challenge website.

# Team Experiment Name Submission date Eval Score @100k Confidence @100k Eval Score @500k Confidence @500k
12 AASMA AASMA vs Astar 5/19/2017 7:38 AM 1.442 1.79 1.248 1.63
13 AASMA AASMA vs Default 5/19/2017 8:06 AM 0.591 1.07 0.499 1.00
2 AASMA My Exp 1 5/2/2017 1:08 PM 0.917 3.04 1.277 3.85
10 AutoMagico FirstExperiment 5/18/2017 6:52 PM -0.663 0.17 -0.734 0.13
11 AutoMagico FirstExperiment2 5/18/2017 7:58 PM 0.152 0.51 0.090 0.35
35 Bacon Gulch UCT_budget_1000_explorati 5/22/2017 9:14 PM 1.514 2.01 1.681 2.18
27 Bacon Gulch UCT_budget_1000_explorati 5/22/2017 1:35 PM 1.498 1.99 1.360 1.83
34 bacon-reloaded final 5/22/2017 6:06 PM 0.123 0.47 0.416 0.80
21 bacon-reloaded My experiment 1 5/22/2017 9:38 AM 0.470 0.83 0.480 0.84
29 bacon-reloaded My experiment 2 5/22/2017 2:15 PM -0.852 0.07 0.505 0.83
30 bacon-reloaded My experiment 3 5/22/2017 3:41 PM 0.021 0.36 0.167 0.48
38 CollaMind avg-greedy_failed! 5/22/2017 11:20 PM -0.810 0.09 -0.855 0.06
36 CollaMind avg_failed! 5/22/2017 10:37 PM -0.867 0.06 -0.797 0.10
37 CollaMind greedy_failed! 5/22/2017 10:55 PM -0.817 0.09 -0.865 0.06
4 CollaMind My experiment 1 5/17/2017 9:21 PM -0.737 0.15 -0.812 0.09
5 CollaMind My experiment 2 5/17/2017 9:50 PM -0.789 0.10 -0.777 0.11
6 CollaMind My experiment 3 5/17/2017 10:17 PM -0.808 0.09 -0.803 0.10
20 HelloJason HiDDeN Vs PigChaseChallen 5/22/2017 12:16 AM -0.816 0.10 -0.890 0.06
24 HelloJason HiDDeN Vs PigChaseChallen 5/22/2017 11:07 AM -0.374 0.37 -0.160 0.50
26 HogRider HogRider 5/22/2017 1:25 PM 1.740 2.18 2.196 2.59
25 HogRider HogRiderA 5/22/2017 1:01 PM 1.802 2.21 2.034 2.44
33 HogRider HogRiderD 5/22/2017 4:31 PM 2.411 2.84 1.894 2.33
7 HogRider My Exp 1 5/18/2017 5:55 AM 1.373 1.74 1.669 2.01
1 MSRC-Admin Random vs Random 4/11/2017 5:11 PM -0.778 0.11 -0.848 0.07
14 ParSys E_AStar vs AStar 5/19/2017 10:45 PM 1.407 1.78 1.489 1.88
15 ParSys E_AStar vs AStar (Final) 5/19/2017 11:22 PM 1.752 2.15 2.113 2.51
8 ParSys Enhanced AStar Exp 1 5/18/2017 11:29 AM 0.879 1.31 1.138 1.52
9 ParSys Enhanced AStar Exp 2 5/18/2017 3:09 PM 1.088 1.44 1.198 1.54
19 Pathfinder Final 5/22/2017 12:16 AM -0.077 0.56 0.045 0.64
17 Pathfinder Lapisjunkie 5/20/2017 6:51 PM 0.134 0.58 0.159 0.59
16 RoyalPuzzle q-learning 5/20/2017 2:26 PM -0.579 0.22 -0.531 0.24
3 RoyalPuzzle qlearning100000Exp 5/16/2017 1:35 PM -0.085 0.54 -0.213 0.44
18 The Danish Puppeteers Guided Danish Puppet vs P 5/21/2017 9:40 PM 2.189 2.60 2.435 2.88
39 Village People My Exp 1 5/23/2017 1:34 PM 1.618 2.05 1.318 1.74