AMD GPU LLM Performance Testing

AMD GPU LLM Performance Testing(github.com)

4 points by xlayn 40 days ago | 1 comment

xlayn 40 days ago |

I had a 6950 on my pc from when I built the thing... and then bought the 7900 for $5xx, that allows me to run more models, and then I saw the "Radeon AI PRO" and after a couple of frustrating talks with certain LLM to try to get an idea on what the speed of the card is I decided to go, buy it and test it to check what's the actual speed.

xlayn 40 days ago |

I had a 6950 on my pc from when I built the thing... and then bought the 7900 for $5xx, that allows me to run more models, and then I saw the "Radeon AI PRO" and after a couple of frustrating talks with certain LLM to try to get an idea on what the speed of the card is I decided to go, buy it and test it to check what's the actual speed.