I’ve worked in both environments, those that tracked and those that didn’t. In my experience, overall productivity was higher in the non-tracking environment. When working salaried positions, I would sometimes track my time to find time wasting activities, etc. But, generally, only for identifying and correcting problems

I don't have to; it's "my entire waking life". ;D