Llama.cpp with CUDA Support on Original Jetson Nano (4GB)

2 points by Abishek_Muthian 51 days ago | 2 comments

Original title: Llama.cpp with CUDA support on a Jetson Nano

Editorialization: Added 'Original' and (4GB) to highlight that this project adds support to the long abandoned Nvidia Jetson Nano.

politelemon 51 days ago |

Nice work, the benchmarks don't look terrible for what it is, especially the prompt processing.

Abishek_Muthian 51 days ago |

Original title: Llama.cpp with CUDA support on a Jetson Nano

Editorialization: Added 'Original' and (4GB) to highlight that this project adds support to the long abandoned Nvidia Jetson Nano.

politelemon 51 days ago |

Nice work, the benchmarks don't look terrible for what it is, especially the prompt processing.