hey hn, I'm the lead engineer on this project. This was a super fun feature to build, and was incredibly challenging at a technical level.
Lots of fun stuff to figure out, from wrangling structured data, working around limited context sizes, and figuring out how to even write down sensible metrics to determine how well the models are doing.