Hy4 Preview

14 points by cmitsakis 6 days ago | 2 comments

RMPR 6 days ago |

At first I thought it was this Hy[1], oh well one can dream.

> Hy4 preview came out slightly ahead of both GLM 5.3 (2.99 vs. 2.92 average, 46.8% wins / 12.8% ties / 40.4% losses) and Kimi K3 (2.99 vs. 2.94, 51.2% wins / 7.9% ties / 40.9% losses).

This is extremely impressive if true that they are able to beat both K3 and HLM 5.3 however an someone who doesn't know anything about this space. How much better is 2.99 compared to 2.94 or 2.92? This difference to me seems very marginal. Or is only meant to say that they are in the same "category"?

1: https://hylang.org/

WASDx 6 days ago | |

I would guess such a small difference is within the error margin so "roughly equal" I think is fair to say but different models are good at difference things in practice. It is about the same size as GLM 5.3 at about half the price (cached price even less). I believe it's on the intelligence/price pareto frontier.

I have tested their Hy3 a bit and it feels okay. That one went from preview to release in less than three months with a substantial increase in benchmarks. But who knows how this space looks like in three months from now.