Dark Hacker News
new
|
best
|
ask
|
show
|
jobs
Compressor "firn" improves ZSTD by 13%
(github.com)
3 points
by
seccode
1 year ago
| 3 comments
Compressor "firn" improves ZSTD by 13% | Dark Hacker News
themerone
1 year ago
|
next
[−]
This works by text substitution, I imagine that you could get similar or better gains using zstd custom dictionaries.
seccode
1 year ago
|
parent
|
next
[−]
This is a direct comparison to zstd with a dictionary actually
seccode
1 year ago
|
root
|
parent
|
next
[−]
Methodology for comparison: train zstd dictionary on enwik9. Then build my dictionary as most common words in enwik9. Mine does 13% better because of the way I discovered how you can generate dictionary replacement symbols