by Juergen

Recommending Given Names

nameling logoWe are pleased to organize this year’s ECML PKDD Discovery Challenge, tackling the task of recommending given names. The challenge comprises two phases:

  1. First, there will be an offline competition, where participants predict future search activities based on a training data set which is derived from the name search website nameling.
  2. Then, there will also be  an online competition, where participants integrate their recommender systems into the nameling website.

Of course there will be prizes that we will announce later!

by .folke

Final Leaderboard

We are happy to announce the winners of the first part of 15th ECML PKDD Discovery Challenge. In total 17 teams participated in the competition, setting new standards for the new recommendation task of recommending given names. A broad variety of recommendation techniques has been applied and adapted to this new kind of data, ranging from classical collaborative filtering approaches and association rule mining to advanced factorization machines.

Pos Diff Team Name Score
1

uefs.br 0,0491
2

ibayer 0,0472
3

all your base 0,0423
4

Labic 0,0379
5

cadejo 0,0367
6

disc 0,0340
7

Context 0,0321
8

TomFu 0,0309
9

Cibal 0,0262
10

thalesfc 0,0253
11

Prefix 0,0203
12

Gut_und_Guenstig 0,0169
13

TeamUFCG 0,0156
14

PwrInfZC 0,0130
15

persona-non-data 0,0043
16

erick_oliv 0,0021
17

Chanjo 0,0016

Although the challenge’s evaluation scores indicate a leadership, the results are very close. At the workshop we will present and discuss a thorough evaluation and comparison of the different recommendations.

We are looking forward to see different recommender systems in the online challenge!

by .folke

We are curiously awaiting your paper submissions

As the offline challenge has ended and the online challenge not yet started, we had a short look at your submitted result files. Though we only saw what was recommended, we already know that completely different approaches for the name recommendation task were applied. So we are very much looking forward to reading your papers and getting an impression of all the different pre processing and recommendation systems.

After passing the reviewing process, all papers of participants of the challenge’s workshop will be published in the workshop proceedings (for details, have a look at the workshop description). The workshop will take place on September 27th, that is, on the last conference day.

The introduction of the workshop proceedings will contain an introduction to the overall setup of the challenge as well as a detailed task description. You can therefore skip these details in your paper and just refer to the introduction.

If you have further questions concerning your workshop submission, please don’t hesitate to contact us.

Happy letter typing!

by Juergen

16th Leaderboard

There it is, our last public leaderboard. Team ‘uefs.br’ did an awesome job again and increased its score by 12 %! The other teams did also a good job increasing their scores and, who knows, maybe they are on top on the final non-public leaderboard. So, who dares to submit new results? Faites vos jeux!

P.S.: The submission for your workshop paper is open!
P.P.S.: Don’t miss the chance to test your recommender in the online challenge!

Pos Diff Team Name Score
1

uefs.br 0,0491
2

ibayer 0,0425
3

all your base 0,0423
4

Labic 0,0379
5

cadejo 0,0363
6

disc 0,0346
7

Context 0,0321
8

TomFu 0,0309
9

Cibal 0,0262
10

thalesfc 0,0253
11

Prefix 0,0203
12

Gut_und_Guenstig 0,0169
13

TeamUFCG 0,0156
14

PwrInfZC 0,0130
15

persona-non-data 0,0043
16

erick_oliv 0,0020
by Juergen

15th Leaderboard v2

The first version of the 15th leaderboards was calculated witch switched results. The current scores where handles as the recent ones and vise versa. This was the reason why no score has changed, but the rank arrows indicated change.
We apologize for this inconvenience and wish you good luck for the board of tomorrow (which will be handled with maximum care of course).

Pos Diff Team Name Score
1

uefs.br 0,0440
2

all your base 0,0419
3

Labic 0,0377
4

ibayer 0,0368
5

cadejo 0,0352
6

Context 0,0321
7

disc 0,0319
8

TomFu 0,0309
9

thalesfc 0,0253
10

Cibal 0,0237
11

Prefix 0,0203
12

TeamUFCG 0,0156
13

PwrInfZC 0,0130
14

persona-non-data 0,0043
15

erick_oliv 0,0020
by .folke

15th Leaderboard (update)

We too are nervous due to the approaching end of the offline challenge… So please excuse us that the 15th Leaderboard was somehow buggy.

As every minute counts, I quickly list the raw (unsorted) evaluation results:

TeamUFCG	0.0155641
all your base	0.0419351
cadejo	0.035161
Context	0.0320674
disc	0.0319087
erick_oliv	0.00202396
Cibal	0.0237294
PwrInfZC	0.0130255
ibayer	0.036774
Labic	0.037668
persona-non-data	0.00429523
Prefix	0.0202982
uefs.br	0.0440161
thalesfc	0.0252773
TomFu   0.0308609

We are terribly sorry about this! Nevertheless: Keep on crunching! Meanwhile: Why not play around with the short coming name recommendation feature in Nameling: http://beta.nameling.net/name/John (look at the dynamically loaded recommendation box on the sidebar). Currently, there is a NameRank-Based recommender and a dummy recommender integrated – which one did you get? ;-)

I’m finishing the UI integration of the recommender during this and the next week – and I’m looking forward to integrate your recommendations in the system!

by Juergen

15th Leaderboard

This is almost the last leaderboard. Keep in mind that the next will be the last public one. So, submit till Friday 2:00 PM if you want to know the performance of your recommender!

Pos Diff Team Name Score
1

uefs.br 0,0440
2

all your base 0,0405
3

Context 0,0322
4

disc 0,0319
5

cadejo 0,0311
6

TomFu 0,0309
7

Labic 0,0298
8

ibayer 0,0259
9

Cibal 0,0254
10

thalesfc 0,0253
11

TeamUFCG 0,0156
12

PwrInfZC 0,0130
13

Prefix 0,0118
14

persona-non-data 0,0043
15

erick_oliv 0,0020
by Juergen

14th Leaderboard

The leader is dead, long live the leader!

The final phase of our offline challenge is thrilling. There is a new leader just three days after the last board. Team “uefs.br” ditched team “all your base” from the throne with an incredible 18.9 % increase of their last score. That is event 9.2 % more than the last winning score. Com on teams, give your best in this last week of our offline challenge and submit more winning results!

Breaking news: As of today you can read the new description of our online challenge starting at 15th of July.

Pos Diff Team Name Score
1

uefs.br 0,0440
2

all your base 0,0405
3

Context 0,0322
4

disc 0,0319
5

cadejo 0,0311
6

TomFu 0,0309
7

Labic 0,0298
8

ibayer 0,0259
9

Cibal 0,0254
10

thalesfc 0,0253
11

TeamUFCG 0,0156
12

PwrInfZC 0,0130
13

Prefix 0,0118
14

persona-non-data 0,0043
15

erick_oliv 0,0020
by Juergen

13th Leaderboard

During this week, we announced that there will be a new leader. This tweet referred to team “uefs.br”, which did an awesome job with their recommendation. However, the prediction of a new leader was based on the submission that we received till Wednesday, but team “all your base” managed to improve their result even more.

As the deadline of the offline challenge steadily approaches, we will publish additional leaderboards within the next ten days. Altogether, four leaderboards will be published until the end of the offline challenge:

  • Friday, June 21st
  • Monday, June 24th
  • Wednesday, June 26th
  • Friday, June 28th

The leaderboard will be based on the latest submissions until 14:00h (CET) of the respective date. Your final submission is due on July 1st, 23:59h (HAST – Hawaii-Aleutian Standard Time).

Pos Diff Team Name Score
1

all your base 0,0406
2

uefs.br 0,0370
3

Context 0,0325
4

TomFu 0,0309
5

cadejo 0,0300
6

Labic 0,0296
7

disc 0,0290
8

ibayer 0,0259
9

thalesfc 0,0199
10

TeamUFCG 0,0156
11

PwrInfZC 0,0130
12

Prefix 0,0048
13

persona-non-data 0,0043
14

erick_oliv 0,0020
by Juergen

12th Leaderboard

It is very exciting. All top three teams have improved their scores. In the middle, team Labic and cadejo move upwards as well. We also welcome a new team at the bottom of our board: Prefix! We are looking forward to next weeks leaderboard.

Your 20DC13 team.

Pos Diff Team Name Score
1

all your base 0,0362
2

disc 0,0325
3

Context 0,0325
4

TomFu 0,0309
5

Labic 0,0296
6

sertão 0,0296
7

cadejo 0,0259
8

ibayer 0,0259
9

thalesfc 0,0199
10

TeamUFCG 0,0156
11

PwrInfZC 0,0130
12

Prefix 0,0048
13

persona-non-data 0,0043