To contribute to this blog please write

Wednesday, July 11, 2007

Who wants to be a millionaire?? CMDS team forming now!

It's a PR promotion...but still,... Netflix is prepared to pay out a million dollars to any analytics team that can beat their movie recommendation engine by 10%. I downloaded the data...lots and lots of ratings at the customer id level, in many separate files. Some of the details posted at follow...

We’re quite curious, really. To the tune of one million dollars.

Netflix is all about connecting people to the movies they love. To help customers find those movies, we’ve developed our world-class movie recommendation system: CinematchSM. Its job is to predict whether someone will enjoy a movie based on how much they liked or disliked other movies. We use those predictions to make personal movie recommendations based on each customer’s unique tastes. And while Cinematch is doing pretty well, it can always be made better.

Now there are a lot of interesting alternative approaches to how Cinematch works that we haven’t tried. Some are described in the literature, some aren’t. We’re curious whether any of these can beat Cinematch by making better predictions. Because, frankly, if there is a much better approach it could make a big difference to our customers and our business.

So, we thought we’d make a contest out of finding the answer. It’s "easy" really. We provide you with a lot of anonymous rating data, and a prediction accuracy bar that is 10% better than what Cinematch can do on the same training data set. (Accuracy is a measurement of how closely predicted ratings of movies match subsequent actual ratings.) If you develop a system that we judge most beats that bar on the qualifying test set we provide, you get serious money and the bragging rights. But (and you knew there would be a catch, right?) only if you share your method with us and describe to the world how you did it and why it works.

Serious money demands a serious bar. We suspect the 10% improvement is pretty tough, but we also think there is a good chance it can be achieved. It may take months; it might take years. So to keep things interesting, in addition to the Grand Prize, we’re also offering a $50,000 Progress Prize each year the contest runs....

Labels: , ,


At July 16, 2007 7:16 AM , Blogger Clayton Roche said...

Is anyone planning on looking into this?

It started in 06, and seems to have some pretty active teams. The last progress payment was made to a team that made a 1% improvement.

I don't have any statistical software other than excel--any recommendations for free packages, or a 'way' to get one for free?


Post a Comment

<< Home