An Intuition for Attention (from the seminal Attention Is All You Need Paper)

An Intuition for Attention (from the seminal Attention Is All You Need Paper)(jaykmody.com)

2 points by ankushio 2 years ago | 1 comment

teleforce 2 years ago |

Fun facts, the Attention paper has recently surpassed more than 10K citation milestone, probably the fastest paper ever to reach the milestone just within six years of publication and on course to surpass the seminal paper on CRISPR CA9 [1],[2]:

[1] Attention is All You Need (2017):

https://research.google/pubs/attention-is-all-you-need/

[2] RNA-guided human genome engineering via Cas9 (2013):

https://www.science.org/doi/abs/10.1126/science.1232033