Colab Notebook for finetuning Gemma 2 2B IT model(colab.research.google.com) |
Colab Notebook for finetuning Gemma 2 2B IT model(colab.research.google.com) |
Gemma 2 2B from @Google @GoogleDeepMind is quite an interesting model as it's only 2 billion parameters in size and is able to beat a variant of GPT 3.5 Turbo. That's not a small feat. If a base model is good at majority of tasks then fine-tuning it for domain specific use-case provides a massive boost up.
And with Monster Tuner, fine-tuning LLMs like Gemma 2 2B is just a couple of clicks and the tuner comes auto-integrated with optimized frameworks like Unsloth, SDPA and FA 2 to fasten up the token processing.
This notebook has a complete workflow where it also formats the provided dataset to suit the EOS token formatting required by Gemma 2 2B IT model to deliver better fine-tuning results with a complete token distribution chart to help us get better insights about our data.
Get started with fine-tuning Gemma 2 2B on this colab notebook https://colab.research.google.com/drive/1FeFeM1viF6jNJDYgUXf...