More Low-Bit LLMs

2 points by sailajohn 2 years ago | 1 comment

sailajohn 2 years ago |

This community has launched over 200 low-bit LLMs on Huggingface and they provide tools for full parameter fine-tuning of the LLaMA-3 8B model using a single GTX 3090 GPU with 24GB of graphics memory. Github: https://github.com/GreenBitAI/green-bit-llm

sailajohn 2 years ago |

This community has launched over 200 low-bit LLMs on Huggingface and they provide tools for full parameter fine-tuning of the LLaMA-3 8B model using a single GTX 3090 GPU with 24GB of graphics memory. Github: https://github.com/GreenBitAI/green-bit-llm