Autoregressive Language Model on the 6502 Processor(mattbeton.com) |
Autoregressive Language Model on the 6502 Processor(mattbeton.com) |
Wouldn’t it be era-appropriate to allow relying on banked memory? You’d still need to hold the inference code, but you could effectively stream(ing page) the weights as you compute on them.
But with substantial additional effort, maybe some banked ROMs could be added..?
https://www.youtube.com/watch?v=lT07uPRRPfU
A few games required some extra RAM.
Update: Actually, there were other boards. I remember one particular advert for a board that could handle 256KB of RAM/ROM. I'm now actually curious if adding too many ROMs would make the * commands noticeably slower (the OS would look for the commands in the ROMs, one by one, until it found the code to handle them).