Sibyl – Prediction Service at DoorDash (2020)

Sibyl – Prediction Service at DoorDash (2020)(doordash.engineering)

27 points by bothra90 4 years ago | 36 comments

People are commenting on the quality of Door Dash predictions, but that isn’t what the article is about. The article is just about the architecture for high speed/throughput of prediction requests.

I would be interested in knowing how much improvement they saw by using C++ or Kotlin. Also, I don’t really understand what compute service is actually used to run the model predictions in this framework.

tyingq 4 years ago |

The "Shadow predictions" bit is interesting. They could set that up in a way to score it versus actuals...where the shadow implementation automatically becomes the live one once it's better than the incumbent.

wdb 4 years ago |

Sibyl, was also the name of the Delphi clone for OS/2 :)

monkeydust 4 years ago |

I'm yet to have the 'wow' moment from any recommendation service.... Netflix, Amazon, Deliveroo... At best I get the 'meh why not'. It's obviously a hard problem to solve.

chrisjarvis 4 years ago | |

What about Youtube? Im surprised to not see them mentioned in any of the comments under yours. For all their faults, I regularly am recommended amazing(ly interesting to me) videos.

vernie 4 years ago | | |

I read that something like 60 hours of video are uploaded to YouTube every second, so I find it hard to believe that the best stuff they can recommend is the same handful of 9 year old videos I've already watched sprinkled with dogshit right wing American political content.

Zababa 4 years ago | |

My view on this is that recommendation services are made to try to funnel people to the same thing. While they sell some kind of "hyper personalization", they're just another kind of classic marketing. Especially for Netflix. Talking about series you watched seems to be a big part of watching series, so pushing people to watch the same stuff works better.

Hokusai 4 years ago | |

> It's obviously a hard problem to solve.

Or maybe that is not the problem they are trying to solve. They optimize to sell as much as possible, not to get you the best experience.

It's like asking for the most shopped articles that are the ones farther away. Is it difficult to design better supermarkets? Or are they just optimizing for you to spend more time and money inside?

loceng 4 years ago | |

If they had the full catalogue of all movies and series ever made then it'd easily be much easier to actually make more relevant recommendations, but their catalogue is actually shrinking as they have less old content they've been able to renew since those content owners have been starting their own streaming services.

postexitus 4 years ago | | |

Amazon, the book store has everything published under the sun and still cannot recommend something better than "oh, here you go, this is sci-fi as well!".

o_____________o 4 years ago | |

Try TikTok for a few weeks, genuinely

ec109685 4 years ago | | |

TikTok is optimized to get as much signal as possible from users, as well as they were smart about getting some signal from the videos themselves: https://www.eugenewei.com/blog/2020/9/18/seeing-like-an-algo...

Something like Amazon gets very little signal after you bought something whether you really liked it or not.

octodog 4 years ago | |

Soundcloud has amazing recommendations, which is the best feature of the platform in my view. It's so easy to find great music that's related to tracks you already like. I have found literally thousands of new tracks from its 'Station' feature.

fmakunbound 4 years ago | |

I feel like Netflix gave up. All I get is shit I already saw.

clevergadget 4 years ago | |

tiktok is the only one i think

hobs 4 years ago |

I see posts like this and just think that as far as I can tell DD's recommendations are:

  Ads
  Ads
  Ads
  Shitty place nobody would want to eat
  Shitty place nobody would want to eat
  Shitty place nobody would want to eat
  Shitty place nobody would want to eat
  Oh look something interesting

woodruffw 4 years ago | |

I have the same experience as you, and it's one of the main reasons why I try to call places for takeout instead (or use a local app).

I (idly) wonder whether they're optimizing for the wrong(?) things: throwing a bunch of garbage up front maximizes the amount of time that I spend in-app, which is probably one of their key metrics. What they don't(?) realize is that I'm spending all that time filtering through the dreck, and so the metric is really measuring my frustration and not my engagement.

netizen-936824 4 years ago | |

Doordash: Hey try this new place! lists taco bell

luxurytent 4 years ago | |

Relevancy is hard!

Forge36 4 years ago |

I just cancelled my membership (was free with a credit card i already had).

They offered a "free membership" for 10 months "at a $120 value" (which used to be $60 a year), however I couldn't figure out how to activate it.

I can't figure out what the value is over other services/direct from restaurant. Like another poster, most of the suggestions were bad. "Do you want dairy queen?" Or "quick you can order free from Kwik Trip in the next 10 minutes".

The post makes the suggestions look good. My top recommendation is the cheesecake factory. Followed by McDonalds. Who are they targeting? Who is getting McDonalds delivered?

jorblumesea 4 years ago | |

McDonalds is one of the most popular restaurants in all of America. Forget DD, probably 10% of America orders McDonald's every day. It's not that surprising. It probably keeps pretty well during delivery because it's designed to be under a warmer for long periods of time.

withinboredom 4 years ago | |

We get McDonalds delivered all the time. We don’t have a car.

iratewizard 4 years ago | |

One of my wife's assistants likes McDonald's. A weekly reward for no products breaking in shopping when she does packaging is lunch. The cost of having McDonald's delivered is far less than the opportunity cost for her to pick it up (and obviously for us too).

decremental 4 years ago | |

I get McDonald's delivered all the time. Can't beat 13 minute delivery for coffee in the morning.

vorpalhex 4 years ago | | |

My coffee routine only takes 8 mins from whole beans to v60 pour over, most of that the kettle warming.

woodruffw 4 years ago | | |

Do you order anything besides coffee? Maybe I'm misunderstanding, but why would you wait 13 minutes for someone to drop off $1 of distinctly average coffee?

(I say this as someone who has ordered McDonald's through DoorDash before.)

dangrossman 4 years ago | |

I get McDonalds delivered. Why not?

bastardoperator 4 years ago |

I predict they'll get my order wrong or leave something off despite charging me and deliver my food cold.

bradknowles 4 years ago |

Wait, so they are actively encouraging Sybil attacks?

See https://en.wikipedia.org/wiki/Sybil_attack

woodruffw 4 years ago | |

I assume it's a reference to the ancient Greek prophetesses[1].

[1]: https://en.wikipedia.org/wiki/Sibyl

iratewizard 4 years ago | |

I think it's a coincidence. Sybil is reference to the book / movie about multiple personality disorder. Both deal with multiple personality systems.

Ads Ads Ads Shitty place nobody would want to eat Shitty place nobody would want to eat Shitty place nobody would want to eat Shitty place nobody would want to eat Oh look something interesting