Can LLM be trained like training Go AI? Such as alphago

2 points by hxypqr 2 years ago | 3 comments

The ability of GPT-4 is not so much "figuring out" as it is "already knowing." Currently it seems.

mindwok 2 years ago |

AlphaGo is also “already knowing” the same way LLMs are. At the end of the day they are just neural nets trained for different tasks. The training process is the “figuring out” part in both cases.

Jax_Hax 2 years ago |

There are models trained via RNN, but LLMs usually use Transformer architecture with a bit of human feedback on top which sort of uses reinforcement learning like AlphaGo

verdverm 2 years ago |

LLM and AlphaGo (DRNN) are different architectures, training regimes, and optimizers. They are not designed for the same inputs & outputs