Dark Hacker News
new
|
best
|
ask
|
show
|
jobs
Multi-GPU Inference with Accelerate
(bengubler.com)
14 points
by
nebrelbug
2 years ago
| 1 comment
Multi-GPU Inference with Accelerate | Dark Hacker News
nebrelbug
2 years ago
|
next
[−]
Quick tutorial on how to use Accelerate to run inference on LLMs in parallel