Presumably, yes. It essentially boils down to a high capacity flash drive that is just used to store weights with a fast path to the GPU. It's interesting because I had this same idea last week and had been doing some tests and then this Register article rolls around and it is pretty much in the pipeline. Oh well, one day I'll have an original idea.