It does not run locally for now. Distillation of models is not enough to run at 7-15 FPS in terms of throughput—also, battery life suffers too. |
No comments yet
It does not run locally for now. Distillation of models is not enough to run at 7-15 FPS in terms of throughput—also, battery life suffers too. |