Can LLMs recognise ASCII images?(docs.thestage.ai) |
Can LLMs recognise ASCII images?(docs.thestage.ai) |
If we think about it, attention scores will look like a heatmap of the original image. So, transformers have an internal representation of the image inside, and if they can recognize images by default, it's some sort of image classifier which provides token ID as an image class. The tests are, to be honest, trivial, but anyway funny :)
Try Deepseek-Qwen-14B in our tutorial - running at 120 tok/s on H100 and 40 tok/s on L40s, up to 3x faster than the original implementation! Fully free, get your API token and start!