That is very disappointing.
That's it right there. Show the others how it's done. Can see going forward most model training being done in winter, making for a proper resource recycling ecosystem.
- https://huggingface.co/spaces/Soofi-Project/Pretraining-Tech...
Either way, happy to see two open models from outside the us-cn duopoly in the same week.
Nice trick to be not comparable with most other LLMs on the market, open weight or proprietary.
But I think, that's the right way.