Fighting the chip shortage with old school cooperative multitasking on GPUs

Fighting the chip shortage with old school cooperative multitasking on GPUs(muna.ai)

2 points by floathub 4 days ago | 1 comment

floathub 4 days ago |

The thesis being that if you can pack multiple models onto a single GPU, you can actually increase processing capacity with a fixed amount of hardware.

floathub 4 days ago |

The thesis being that if you can pack multiple models onto a single GPU, you can actually increase processing capacity with a fixed amount of hardware.