15th Discovery Challenge

We are happy to announce the winners of the first part of 15th ECML PKDD Discovery Challenge. In total 17 teams participated in the competition, setting new standards for the new recommendation task of recommending given names. A broad variety of recommendation techniques has been applied and adapted to this new kind of data, ranging from classical collaborative filtering approaches and association rule mining to advanced factorization machines.

Although the challenge’s evaluation scores indicate a leadership, the results are very close. At the workshop we will present and discuss a thorough evaluation and comparison of the different recommendations.

We are looking forward to see different recommender systems in the online challenge!

There it is, our last public leaderboard. Team ‘uefs.br’ did an awesome job again and increased its score by 12 %! The other teams did also a good job increasing their scores and, who knows, maybe they are on top on the final non-public leaderboard. So, who dares to submit new results? Faites vos jeux!

P.S.: The submission for your workshop paper is open!
P.P.S.: Don’t miss the chance to test your recommender in the online challenge!

The first version of the 15th leaderboards was calculated witch switched results. The current scores where handles as the recent ones and vise versa. This was the reason why no score has changed, but the rank arrows indicated change.
We apologize for this inconvenience and wish you good luck for the board of tomorrow (which will be handled with maximum care of course).

We too are nervous due to the approaching end of the offline challenge… So please excuse us that the 15th Leaderboard was somehow buggy.

As every minute counts, I quickly list the raw (unsorted) evaluation results:

TeamUFCG	0.0155641
all your base	0.0419351
cadejo	0.035161
Context	0.0320674
disc	0.0319087
erick_oliv	0.00202396
Cibal	0.0237294
PwrInfZC	0.0130255
ibayer	0.036774
Labic	0.037668
persona-non-data	0.00429523
Prefix	0.0202982
uefs.br	0.0440161
thalesfc	0.0252773
TomFu   0.0308609

We are terribly sorry about this! Nevertheless: Keep on crunching! Meanwhile: Why not play around with the short coming name recommendation feature in Nameling: http://beta.nameling.net/name/John (look at the dynamically loaded recommendation box on the sidebar). Currently, there is a NameRank-Based recommender and a dummy recommender integrated – which one did you get?

I’m finishing the UI integration of the recommender during this and the next week – and I’m looking forward to integrate your recommendations in the system!

This is almost the last leaderboard. Keep in mind that the next will be the last public one. So, submit till Friday 2:00 PM if you want to know the performance of your recommender!

The leader is dead, long live the leader!

The final phase of our offline challenge is thrilling. There is a new leader just three days after the last board. Team “uefs.br” ditched team “all your base” from the throne with an incredible 18.9 % increase of their last score. That is event 9.2 % more than the last winning score. Com on teams, give your best in this last week of our offline challenge and submit more winning results!

Breaking news: As of today you can read the new description of our online challenge starting at 15th of July.

Our online recommender challenge: Read the technical docu and test your recommender in a live system http://t.co/C6zRtf3fCT #RecSys #20DC13

— ECML PKDD DC13 (@20DC13) June 24, 2013

During this week, we announced that there will be a new leader. This tweet referred to team “uefs.br”, which did an awesome job with their recommendation. However, the prediction of a new leader was based on the submission that we received till Wednesday, but team “all your base” managed to improve their result even more.

Sneak preview: Based on the current submissions, there will be a new leader on next week’s leaderboard. @ECMLPKDD #RecSys

— ECML PKDD DC13 (@20DC13) June 19, 2013

As the deadline of the offline challenge steadily approaches, we will publish additional leaderboards within the next ten days. Altogether, four leaderboards will be published until the end of the offline challenge:

• Friday, June 21st
• Monday, June 24th
• Wednesday, June 26th
• Friday, June 28th

The leaderboard will be based on the latest submissions until 14:00h (CET) of the respective date. Your final submission is due on July 1st, 23:59h (HAST – Hawaii-Aleutian Standard Time).

It is very exciting. All top three teams have improved their scores. In the middle, team Labic and cadejo move upwards as well. We also welcome a new team at the bottom of our board: Prefix! We are looking forward to next weeks leaderboard.

Your 20DC13 team.

We enter the last month for the offline challenge a bit later, but with a leaderboard full of changes. First of all, we welcome the new team Labic, which rushed up to the 3rd place. Team disc was also successful, improving their score from 0.0242 to 0.0261. We are waiting the next recommender result submission for the coming leaderboard.