Flex Attention – How to Scale Attention Models to a Billion Users?

Flex Attention – How to Scale Attention Models to a Billion Users?(yash-sri.xyz)

2 points by yash-sri19 1 year ago | 1 comment

yash-sri19 1 year ago |

The title is a clickbait. I don’t actually know how to scale attention to serve billion users, but I feel Flex Attention is a great step in this direction.

yash-sri19 1 year ago |

The title is a clickbait. I don’t actually know how to scale attention to serve billion users, but I feel Flex Attention is a great step in this direction.