Qwen3.5 Small: 0.8B, 2B, 4B, 9B Released(huggingface.co) |
Qwen3.5 Small: 0.8B, 2B, 4B, 9B Released(huggingface.co) |
These new ones are very much punching above their weights.
[0] https://www.reddit.com/r/LocalLLaMA/comments/1rivckt/visuali...
Take Qwen/Qwen3.5-35B-A3B for example. It's 72 GB. While unsloth/Qwen3.5-35B-A3B-GGUF has quantizations from 9-38 GB.