If you're maintaining performance benchmarks for your web site, how are you doing it?

Software, services, automation, real browser vs. pinging, and alerting - it'd be interesting to see how HN is doing it, from one-person web apps to the big guys with dedicated performance teams.