Soofi: European sovereign LLM trained in 2 months

Soofi: European sovereign LLM trained in 2 months(huggingface.co)

17 points by hibijibies 72 days ago | 4 comments

davidos 72 days ago |

one of the authors here, AMA.

fragmede 72 days ago | |

What sort of regulations did you run into while gathering training data?

davidos 72 days ago | | |

The main constraint was licensing rather than regulations like GDPR. To ensure compliance, we restricted ourselves to datasets with permissive licenses.

The one exception was the Genios dataset (a high-quality German corpus), which we used during pretraining under a separate licensing agreement. Beyond that, the growing availability of high-quality permissive datasets meant we could assemble sufficient training data without compromising on quality.