SmartGPT: Major Benchmark Broken – 89.0% on MMLU and Exam Errors [video]

SmartGPT: Major Benchmark Broken – 89.0% on MMLU and Exam Errors [video](youtube.com)

4 points by pps 2 years ago | 5 comments

kristianp 2 years ago |

Anyone have a textual version of this content? I'm not keen on watching unknown YouTube videos.

kristianp 2 years ago | |

This may be the system it's referring to: https://github.com/Cormanz/smartgpt

RossBencina 2 years ago | | |

No, it is definitely not. The AI Explained YouTube channel (and their "SmartGPT" which they described months ago) is by someone named Philip. The link you gave is by someone named Corman.

RossBencina 2 years ago | |

FWIW, AI Explained seems like a well regarded channel. I agree that a paper would have been nice.