How to Optimize Scaled Dot Product Attention?

2 points by yash-sri19 1 year ago | 1 comment

yash-sri19 1 year ago |

In this worklog, I explore how to optimize SDPA across cache, quantization and device specific optimizations.

yash-sri19 1 year ago |

In this worklog, I explore how to optimize SDPA across cache, quantization and device specific optimizations.