BibSonomy Recommendation Framework Live Evaluation

last updated: Mo 14. Sep 11:33:32 CEST 2009 (updated every hour, statistics start on 2009-07-29)

Precision and Recall.

Precision and Recall (ignoring timeouts).

Latency per selected query (sorted by latency).

id	3	5	6	7	8	9	10	11	12	13	14	15	16
#posts	344	388	359	411	404	380	372	369	380	378	369	353	398

Post counts.

id	submission
3	Content-based and Graph-based Tag Suggestion Xiance Si, Zhiyuan Liu, Peng Li, Qixia Jiang, and Maosong Sun
5
6	Tag Sources for Recommendation in Collaborative Tagging Systems Marek Lipczak, Yeming Hu, Yael Kollet, and Evangelos Milios
7
8
9
10
11
12
13
14
15
16	Measuring Vertex Centrality in Co-occurrence Graphs for Online Social Tag Recommendation Iván Cantador, David Vallet, and Joemon M. Jose

Recommender-Mapping

id	#posts	f1m@5	#posts	f1m@5	#posts	f1m@5
	F_r \ L_r		L_r \ F_r		F_r ∩ L_r
3	50	0.243	42	0.184	228	0.180
5	39	0.248	50	0.220	279	0.171
6	38	0.223	44	0.261	258	0.222
7	56	0.125	44	0.224	290	0.138
8	35	0.131	48	0.211	305	0.157
9	46	0.166	49	0.193	266	0.168
10	41	0.179	38	0.198	273	0.160
11	43	0.164	36	0.160	268	0.124
12	42	0.120	49	0.065	270	0.089
13	43	0.085	42	0.121	276	0.119
14	54	0.137	45	0.223	260	0.155
15	46	0.138	51	0.183	231	0.153
16	47	0.087	66	0.102	264	0.133

The influence of the 'reload' button.

id	Min. Latency	Max. Latency	Avg. Latency	Nr. of Selections	Nr. of Successes	Nr. of Timeouts	Total nr. of Results
3	173	191926	755.9979	1992	14470	2437	16907
5	179	161654	774.4592	2214	14299	2604	16903
6	307	312039	1083.9396	2004	21497	7047	28544
7	389	182307	1630.5796	2062	11102	16423	27525
8	902	313499	15998.8586	2103	2	255	257
9	1784	447599	18364.7349	2051	0	420	420
10	3149	346861	29008.8252	2133	0	125	125
11	3173	464542	18620.6612	2088	0	1171	1171
12	263	156655	929.6578	2062	12437	3254	15691
13	262	91331	1088.3393	2058	18471	11374	29845
14	517	319506	1521.7574	2064	5367	23645	29012
15	279	5230	1013.5069	2039	253	104	357
16	228	205422	1233.2015	1983	18213	8200	26413

id	Recommender ID
Min. Latency	Shortest time period the recommender needed for delivering tag recommendations
Max. Latency	Longest time period the recommender needed for delivering tag recommendations
Avg. Latency	Average time period the recommender needed for delivering tag recommendations
Nr. of Selections	Number of posts for which the recommender was selected
Nr. of Successes	Number of posts for which the recommender successfully delivered tag recommendations
Nr. of Timeouts	Number of posts for which the recommender failed to deliver tag recommendations
Total nr. of Results	Nr. of Successes + Nr. of Timeouts

Recommender Connection Summary

The fraction of matching tags which have been clicked.

Users sorted by their fraction of click/noclick-posts; The y-axis depicts the fraction of posts where recommended tags were clicked.