Qwen3.8-Flash-Next non-uniform quantization runs on 2 RTX3090s

Qwen3.8-Flash-Next non-uniform quantization runs on 2 RTX3090s(huggingface.co)

9 points by pfeifferj 35 days ago | 2 comments

NICE

rcbdev 35 days ago |

Didn't expect to see the 180B model running on two 3090s so fast. The open model space is moving crazy fast, improvements like always remind me of Google's 2023 memo 'We Have No Moat', which looks to be more right every day.

omarhawwash058 34 days ago |

NICE

rcbdev 35 days ago |

Didn't expect to see the 180B model running on two 3090s so fast. The open model space is moving crazy fast, improvements like always remind me of Google's 2023 memo 'We Have No Moat', which looks to be more right every day.