Matrix Orthogonalization Improves Memory in Recurrent Models

Matrix Orthogonalization Improves Memory in Recurrent Models(ayushtambde.com)

27 points by at2005 2 hours ago | 2 comments

I can't help but think of orthogonal frequency-division multiplexing and it's use in encoding data on multiple carrier frequencies, and it makes me wonder what other parallels we will discover between digital transmission technology for cross-domain stuff like this.

dapperdrake 1 hour ago | |

Not even cross-domain. (Nor cross-co-domain.)

Trigonometric polynomials are also polynomials. And linear spaces are all "the same". That is what the definition is for. Even the transpose-mapping is linear.