Ask HN: What are the hard problems when building apps with a realtime back end?

5 points by daleksti 4 years ago | 5 comments

Hi!

What are the hard problems I can expect if I try to build realtime features into our product?

Should I even try to build it or look at third party suppliers? I've seen various articles that compare DIY with buying it in, but they're from those suppliers and I wonder how neutral they are.

It's obviously complex, but what are the primary engineering challenges? Message delivery ordering/duplication and missing messages? Is it security/authentication or problems with debugging and observability? Or should I worry most about infrastructure, scaling and performance?

pingsl 4 years ago |

I think it depends on the development stage of your product.

If you just get some amazing idea you want to quickly lauch and see the result, then the best way is to adpot 3rd parties as much as possible (as long as those stuff could work together).

Then your product receives the momentum, exciting. But you start to have all kinds of issues because you don't spend much effort on the stuff, the initial version. It's not about your capability. You just don't need a perfect design in the very early stage of the product. You might only need 1 or 2 people in order to get all the SaaS work together, although it's not optimal from system and computer resources perspectives.

Then you start to think about refactor the product, a better design, a decent system which means you have to worry about everything. And the first problem is do you have adequate engineers to do that work.

Some startups died in the refactor...

For realtime features, it's hard to build since you have to worry all the infrastructure, scaling and performance. And the even harder part is to run the realtime features smoothly and stably. So I would recommend to use 3rd parties SaaS until you have enough resources and time.

stichers 4 years ago |

This was a great blog post from some reddit engineers a few months ago https://www.reddit.com/r/RedditEng/comments/pfgz4r/reddits_n... which talks about how they added a realtime feature, how they did it and how long it took. There was a big fail the first time they rolled it out too...this stuff isn't easy.

Of course, reddit is a huge company and has loads of established engineers. YMMV.

kasey_junk 4 years ago |

Can you clarify whether you mean if you are building a real time system? That is one that has hard latency requirements: https://en.m.wikipedia.org/wiki/Real-time_computing

Or do you mean an event driven web based system? The term realtime has become overloaded and your answer changes the challenges… a lot.

daleksti 4 years ago | |

Thanks for asking! I mean the latter: an event-driven system where users and devices can send reactions/chat messages and these are displayed as updates in realtime.

flipperstick 4 years ago |

Maybe look into WebSockets?