Tuesday, September 22, 2009

Netflix found a cheap fix for innovation

Netflix started its business as a DVD rental company a couple of years back. They cleverly combine a net-based ordering system with a well thought-out physical distribution approach for the flicks on DVD. You select your movies from their website and put them in a queue. Every time you send a DVD back, by dropping it in a pre-addressed, pre-paid envelop in your mailbox, you get a new one. No late fees. Great for people like me who want to bring DVDs on a trip or just forget about them. Last year they introduced movies online to watch either on your PC or TV, via a small WiFi connected box. Guess what? They actually have old Dutch favorites like Soldier of Orange and countless other non-mainstream movies.


When you log on the first screen that comes up is “Movies you’ll love”. I have rated around 400 movies so far (nowhere near the guy who rated 5,000 movies in one day). The ratings vary from 1 to 5 and I generously bestowed Ben Hur, Citizen Kane and The Godfather with the maximum number of stars. My ratings are continually compared with people who have similar tastes and by applying some complex algorithm they predict which movies I might be interested in. They show both the overall rating and the one they believe I will give the movies I am considering for watching. Interestingly these two are rarely the same and my ratings are consistently close to their predictions.


A while back Netflix invited anyone with a beautiful mind to participate in a contest with $ 1 million prize money to come up with an algorithm that would improve the accuracy of their current system by more than 10%. In order to do so they made millions of data records available and tested the algorithms submitted against the actual ratings submitted by customers. According to Business Week, the winning team, which includes scientists from AT&T (T) Research, Yahoo's (YHOO) Israel lab, and computer scientists from Austria and Canada, blended more than 700 different statistical models into their formula. The next contest will be for algorithms that predict the popularity of new movies, based on your rental history, demographics and other profile attributes.


Netflix has stared into the future and seen what is happening in the media world. As content proliferates and the lines between user and producer blur, it will get harder and harder to separate the wheat from the chaff. While the studios will continue to generate blockbusters with big stars and maybe even come up with an original plot, instead of a comic book rewrite, we can expect more and more interesting low budget movies for smaller audiences. Movie business is even worse than the fashion industry and the few hits have to make up for multiple misses. But Netflix has something the studios don’t: a thorough understanding of their customers’ tastes and interests down to the individual level. Shortly, they will have a way to predict whether a movie will make it or flop. And they pay only $500K to get there, while the big studios keep shooting in the dark.


Netflix has understood that they don’t need to hire armies of PhD’s in statistical analysis to get what they need. They just “crowd source” their innovation. According to the New York Times, thousands of teams from 186 countries made submissions. The winning group is a merger of different smaller teams, who initially competed against each other. A Survivor-like situation emerged with different individuals and groups trying to form alliances to beat the others.


Google, Amazon and Netflix run highly profitable, multi-billion businesses based on a simple principle: attract as many users as possible and have them interact on your site, gain a detailed understanding of their needs and interests and analyze this against huge quantities of data on their peers to create the best value propositions. There are some lessons here.

3 comments:

  1. This is an amazing story! Kept kicking myself for not taking statistics in school! :-)

    I also believe that Netflix would have spent more money and time, to achieve weaker quality algorithms, if they had in-sourced this.

    This model also fostered collaboration between unknown individuals...but point to note is that hundreds of such collaborations failed and only 2 teams succeeded. Collaboration is another area that needs innovation - more on the social, human interaction side than technology.

    Definitely, for Netflix, this was innovation on the cheap! Million dollar well spent...

    Looking forward to watching movies, which otherwise would never hear about....

    ReplyDelete
  2. Certainly Jeroen, there are lessons to be learned, although I still think it will be hard to predict the succes of a movie...

    ReplyDelete
  3. Yes..some human beings are erratic and unpredictable, others fit nicely with behavioral patterns. Or maybe as someone said: "there are two types of people; those who believe that there two types of people and those who believe that is is a bit more nuanced."

    Collaboration remains a tough one. Someone asked me "how can open source work, while I can not even get the guys sitting across the hall working together?". If you look at what makes open source tick, there are a couple of ingredients:
    - Mutual respect of the participants
    - Sense of belonging to a team which is on a quest to deliver something of substance
    - Friendly competition (in this case to show who is the smartest)
    - Compulsion to keep at it until the job is done

    As always, technology can be an enbabler, but will never be the cause of people working together well.

    ReplyDelete