Tool calling at Q8 for this model is kinda impressive. It's doing patch edits like a champ. It gets stuck looping and doing the wrong things though as the context window grows.
Hi! This is a common issue regarding sampling parameters that are off. I imagine though that you are a smart cookie and read the model card, where it spoon feeds you the sampling parameters lol, so if it isn't this, could you please share more? I am one of the creators of this model :)