Ask HN: How to get experience with scale as an engineer? Hey everyone. Feedback that I frequently receive from prospective employers is that I don’t have experience dealing with scaling an app for many users, presumably concurrent users. This feedback comes from video streaming startups, primarily. I apply for full-stack positions, mostly. How do I get this experience without being in a situation where I have many users at my disposal? |
I'll suggest a couple of things to try (not necessarily any order or preference). Do what most current people have done, get in on a small startup/company that hasn't yet scaled and scale up with the team. At the same time you should study up on scale problems so that you know the issues/answers even though you haven't dealt with them yet yourself. The study part will help with interviews until you have the experience to point at -- but even then you still need to understand the problems.
One other idea which is a little more involved, but pretty fun too. Create your own public experiment using one of the cloud providers where you build an endpoint/site that does some complex problem (pick something in the area you want to get a job) concurrently and then load test it and work through issues so that you can point someone to that repository as part of your learning experience. I have actually done this myself a number of times experimenting, not really for showing anyone but so I could understand issue(s) better. You might blow a few bucks (nothing crazy) on AWS or GCP/Azure to experiment but it will be invaluable for your knowledge.
As a hiring tech mgr when I am hiring for scale I look at people who have the experience first, those who have attempted and have the fundamentals second and lastly I'll consider someone smart who has the education (informal or formal) but lacks the experience if they have the enthusiasm and right attitude. I don't think I am unique in that thought process, maybe that helps you think through it.