How much do language models memorize?

How much do language models memorize?(arxiv.org)

58 points by mhmmmmmm 349 days ago | 1 comment

bytepoet 346 days ago |

I enjoyed reading this paper. The experiments are well-designed and it's well-written.

Much work on generalization of ML models deals with asymptotic bounds. Here, there's a precise way of measuring these, even for relatively large models with millions of parameters.

bytepoet 346 days ago |

I enjoyed reading this paper. The experiments are well-designed and it's well-written.

Much work on generalization of ML models deals with asymptotic bounds. Here, there's a precise way of measuring these, even for relatively large models with millions of parameters.