I'm building a home AI rig and need some helps

2 points by brody_slade_ai 1 year ago | 2 comments

Not sure what to do next. I'm building a home setup to test various LLMs and gain hands-on experience with custom built gear. I want to run Llama 3.1, Hermes 3, Qwen 2.5 Coder

My specs:

- Intel Core i7 13700

- RTX 4090

- SSD NVMe 1TB

Any other options I should be aware of? And how much did you invest in your current setup?

petercooper 1 year ago |

Check out https://www.reddit.com/r/LocalLLaMA/ if you want to socialise with other people doing this and see their setups, etc :)

not_your_vase 1 year ago |

  > Not sure what to do next.

What do you mean? Setup the models themselves on your machine, and do what you wanted to do with them. If you see any bottlenecks during the process, then address them.