Where did my 128GB of video RAM go? AMD GPU BIOS gotcha for LLM builders

Where did my 128GB of video RAM go? AMD GPU BIOS gotcha for LLM builders(patrickmccanna.net)

2 points by 0o_MrPatrick_o0 75 days ago | 2 comments

Adding amdgpu.gttsize=126976 and ttm.pages_limit=32505856 to the kernel parameters, while setting the VRAM in the BIOS to the minimum value, enables unified memory to work as expected on AMD Strix Halo running Linux.

The https://strixhalo.wiki has most of the info you need to get LLMs running on these machines.

0o_MrPatrick_o0 74 days ago | |

Thank you for the pointers!!