Show HN: Bandit Algorithm for iOS, Android and Unity

Show HN: Bandit Algorithm for iOS, Android and Unity(splitforce.com)

24 points by splitforce 11 years ago | 10 comments

orasis 11 years ago |

For the DIY crowd, implementing this on your own is a straightforward (and fun) exercise.

I used the Javascript Bayesian Bandit library found here:

https://github.com/omphalos/bayesian-bandit.js/blob/master/b...

I then used it to create a job that runs every 5 minutes on parse.com that updates an 'order' field based on the 5 minute sample.

Then, from the client side, I simply do a query sorted by the 'order' field and I get the top variant for that 5 minute interval. Works like a charm!

ikura 11 years ago |

Have seen a lot of these services, but this is definitely worth checking out. I think Multi-armed bandits are the way to go with optimisation, and just won Startup Asia's hackathon using this technique for a tinder-style app. A lot of people talk about learning from their customers, but few know how to really do it - understanding the math behind what's going on gives me much better confidence when deploying this type of service... Great work sharing it in this way.

iosnoob 11 years ago |

As a splitforce user this is pretty cool.. biggest issue is having to wait for conclusive results, whatever speeds this up and auto prunes away the losing options is welcome.

splitforce 11 years ago | |

Thanks, we think it's pretty cool too! And you've totally hit on why this is awesome - by automatically funneling users towards better-performing variations you can focus your resources on validating what matters and cut down on the deadweight loss associated with a traditional A/B. For more on this here's a recommended read: http://stevehanov.ca/blog/index.php?id=132?utm_medium=referr...

orasis 11 years ago | | |

Do you guys do any sort of logistic regression for optimizing numeric values? That would be really cool.

broodsugar 11 years ago |

Getting Splitforce already at the test stages of development is one of the smartest things a game studio can do.

splitforce 11 years ago | |

True, but why? Activision spends over $10M annually on employing an analytics team of about a dozen PhDs to build Rubin causal models to be able to show the right thing at the right time to players. That kind of budget makes sense for a $1 billion title like Call of Duty, but where does that leave the other 99%? The fact is that even for the companies that don't employ a full-time team of statisticians, if you're running your app or game like a true business you should be leveraging data to make better business decisions. Bandit algorithms like those we're proposing just let you do that at a fraction of the cost ;-)

0x0 11 years ago |

That custom scroll handler which overrides the native ios mobilesafari scroll handler is quite the annoying distraction. :-/

splitforce 11 years ago | |

Thanks for the heads up - looking into it...