Great Recommendations Are Half Placebo

Great Recommendations Are Half Placebo(scoopinion.com)

27 points by villesundberg 13 years ago | 14 comments

nathan_long 13 years ago |

A great recommendation engine should incorporate explicit feedback from users.

For example, Netflix knows what I've watched and how I've rated things. But it doesn't let me tell it things like "I categorically dislike horror movies", so it sometimes recommends those.

It's trying to guess something that I'd rather just tell it.

eli 13 years ago | |

Isn't that what this does? http://movies.netflix.com/TastePreferences

nathan_long 13 years ago | | |

Oh, I never saw that! Thanks!

biscarch 13 years ago | |

Wouldn't the problem then be what you consider horror vs what other people consider horror?

What if it's labeled as horror and comedy because it's a parody?

villesundberg 13 years ago | |

Agreed. I've been wondering how to do that so that it doesn't get tedious but stays effective. Blacklisting categories or sources works to an extent.

pinko 13 years ago |

Interestingly, I've found an opposite effect -- people tend to oversell their favorite movies, restaurants, etc., so a person's strong recommendation will often lead to disappointment, not because the movie/food isn't good but because my expectations were set too high.

villesundberg 13 years ago | |

This is a good point, and happens to me sometimes too in real life.

I've also found that some people read way too much into how well an automatic recommendation system should work. There have been a couple of angry feedback messages due to a guess being off.

1rs 13 years ago |

I think the 'black swan' is important in recommendations as well. There's stuff that will blow your mind because it's something you think about and is somehow connected to something you've done. It might not be relevant at all to most people who read the same stuff as you do. So it's very unlikely it will be recommended to you. Recommendations increase 'groupthink' and you find interesting stuff but not a lot that's outside of your comfort zone. Humans are still better at connecting dots and giving recommendations than machines. I guess it's difficult to teach a machine to make great surprises?

shokwave 13 years ago |

The author writes as if, when a 'real person' makes a recommendation, they aren't just making a prediction from data. The difference is that we can see how the algorithm works, whereas our picture of what the human brain does when it thinks about what someone might like is very murky.

And even if trusting a recommendation causes a placebo effect that increases the perceived quality (as others have pointed out, it seems plausible that a hyped recommendation may cause disappointment instead), why on Earth would we trust a process we don't understand, but mistrust a process we do?

obviouslygreen 13 years ago |

At the same time, it's hard for me to trust algorithmic recommendations. I don't trust them because I know they're from a computer, and I find it difficult to believe that a computer program can "know" who I am.

Determining something that's likely to suit your tastes based on your browsing/buying/watching/reading/etc. habits isn't "knowing" you and doesn't require such a thing. I don't know if this is some sort of accidental anthropomorphism or what, but I've seen this in more than one place and it just doesn't follow.

eurleif 13 years ago | |

The whole point was that there's an emotional component to how good recommendations seem.

calhoun137 13 years ago |

This article made me laugh, let's review.

Computer predictions seems to work, but only get you half way there. I don't trust them because they are from a computer, but if I wrote the program myself I would trust it 100 times less. As with baseball, guessing the home team will win works at least half the time. Our recommendation engine works, and people read articles we recommend 4 times longer.

Conclusion: computer based recommendation engines are 50% placebo.

gnosis 13 years ago |

The only thing that ultimately matters to me as far as recommendators (whether human or algorithmic) are concerned is whether their recommendations turn out to be valuable to me in some way.

That's how you build trust: by making good recommendations. Everything else is secondary.

patdennis 13 years ago |

> All additional information will make your prediction better

I don't think this is true... I find that there's a point where additional information becomes noise, and can make your prediction less useful.