LFM2.5-350M: No Size Left Behind(liquid.ai) |
LFM2.5-350M: No Size Left Behind(liquid.ai) |
Comparing the architecture to Qwen3.5, it seems:
- fewer, wider layers
- mixing full attention and conv's, instead of the full+linear attention of Qwen3.5
- the vocab is about 1/4 the size