I wrote a simple transformer implementation in pytorch, aimed at readability rather than efficiency. This was mostly for learning purposes. Let me know what you think!