Ask HN: How does your company balance test coverage and deploy speed?

1 points by jlos 2 years ago | 2 comments

On one side good test coverage on PR's going into master and again when master goes live helps reduce incidents. But with enough tests, they become a bottle neck for releasing quickly.

So just curious what strategies you've seen in the wild for balancing test coverage* and deploy speed?

* By test coverage here, I mean how often to run the tests you have, not avoiding writing the tests in the first place.

furkansahin 2 years ago |

At Ubicloud, we have 100% line and branch coverage that is mandated on every PR (https://github.com/ubicloud/ubicloud). We also have an E2E test suite that we run periodically and with every commit. We did not really feel like our tests are slowing us down, it actually makes us faster since we have a higher trust to the payload and many manual checks that would need to be done is safely skipped.

rewmie 2 years ago |

I think this is a false dilemma. If your tests can be parallelized then adding more doesn't necessarily result in longer deployments.