fprof, recon trace, observer have proved to be the holy trifecta for me for debugging challenging production issues. I miss these deeply when working in other languages.