Data movement bottlenecks to large-scale model training: Scaling past 1e28 FLOP

12 points by jasondavies 1 year ago | 1 comment

howdyhowdy 1 year ago |

It would be really amazing for ai folks if they would crack a book on HPC open every now and then.

howdyhowdy 1 year ago |

It would be really amazing for ai folks if they would crack a book on HPC open every now and then.