We still fine-tune, because our problems aren't covered by existing models, proprietary tagged images. But not on mixture of experts models. This is only needed for text, not images

I really enjoyed this blog, well written and takes the time to describe technical aspects of LLMs that I wasn't familiar with (noob here).