Language Modeling in the Limit of Infinite Data(matthewfl.com) |
Language Modeling in the Limit of Infinite Data(matthewfl.com) |
A much better formulation is "Search the internets of an infinite collection of earths until you have found the exact prompt 100 times (this will require looking at an exponentially growing number of earths as the prompt grows) and then return the frequencies of the next word."