Soofi – Sovereign Open Source Foundation Models

Soofi – Sovereign Open Source Foundation Models(soofi.info)

50 points by Fake4d 15 hours ago | 14 comments

gmerc 12 hours ago |

This is the Nvidia engagement team coaching various countries (See also Malaysia) how to train a Nemotron and add the benchmark questions to the training set so you get that nice PR splash of pretending it’s the best in its language.

It’s just nemotron with benchmark juicing and the sovereign smokescreen on good old Nvidia hardware chain remains intact.

MSkill1 13 hours ago |

I'm not seeing how this project is open source exactly. It says license free, but that's just like ChatGPT. I wouldn't call that transparent. Maybe I'm missing something. Google had some difficulty translating the site from German.

spmurrayzzz 13 hours ago | |

They've open sourced some of the training and inference code: https://github.com/soofi-project

Their work is based on the nemotron arch (so far).

zurfer 13 hours ago | |

https://github.com/soofi-project/Soofi-Pretraining https://huggingface.co/Soofi-Project/Soofi-S-Base > "The final model will be released openly under a permissive license, without gated access. We will share access details as soon as it is ready."

not open weight yet

karussell 12 hours ago |

Previous interesting discussion 3 days ago: https://news.ycombinator.com/item?id=48937756

ronef 10 hours ago |

Asking this with a bias since I work on Nixos.org and Flox.dev - How is the team thinking about the infra layers underneath these models? Any priority or reason to imbed determinism/reproducibility at the bottom of the stack?

kvisner 9 hours ago |

A note on your website, when I hit the EN button in the top right, it presents a pop-up in German, which I can't read, so I can't change it to be in English.

sajithdilshan 9 hours ago | |

It’s a pop up saying that they use a third party service to translate the website and they collect the activity of the user( which I don’t understand, why would they collect any user data to translate a static website). But it’s typical German like data protection and all the shenanigans.

Also the UI of the buttons on the popup is terrible both accept and reject buttons looks the same

burgerone 8 hours ago | | |

You should be glad that the popup isn't using any dask patterns to coerce you into choosing an option you wouldn't otherwise agree with

myshapeprotocol 12 hours ago |

Love seeing more emphasis on sovereign open-source models. The shift away from centralized, static credential/identity layers toward self-contained architectures is definitely where the ecosystem needs to head.

Incipient 11 hours ago | |

But can it, really? It takes a huge amount of time, resources, and knowledge to train a highly capable model. It also takes a huge amount of the same to run them.

Is it ever going to not be centralised?

23ah-qwd 13 hours ago |

https://www.soofi.info/soofi-s/

"digitalen Wertschöpfung" (digital value creation)

Please Jörg Bienert, fuck off. You have never created anything in your life so you do not see or care about the theft. All you do is grin on a photo.

JSR_FDED 10 hours ago | |

Is there a story behind this?

zurfer 13 hours ago |

more interesting link: https://arxiv.org/html/2607.09424v2 and > Long-context serving efficiency. Soofi S combines frontier-level capability with the highest measured aggregate long-context decode TPS, and unlike full-attention dense baselines maintains high throughput as context grows. Panel (1(a)) plots Capability Index versus measured aggregate decode TPS/GPU at 40K context and batch 32. The Capability Index averages five benchmark groups, i.e., Code, GSM8K, GPQA-Diamond, English aggregate, and German aggregate, after normalizing each group to the best plotted model. Aggregate decode TPS/GPU is measured with a TP=1, one-B200 vLLM latency-subtraction protocol. Panel (1(b)) shows measured aggregate decode TPS/GPU as a function of input context length under the same batch-32 protocol.

it's a small win in the small model class