Ask HN: Are there any research using chaos theory to study Deep neural network?

2 points by ghosthamlet 4 years ago | 2 comments

I just know and reading this book: Emergence: From Chaos To Order (https://www.amazon.com/Emergence-Chaos-Order-Helix-Books/dp/0738201421),

but it just studied simple shadow neural network,

Are there any research using chaos theory to study Deep neural network?

veaxvoid 4 years ago |

Also try to search for chaos in reinforcement learning. Hope it will help

PaulHoule 4 years ago |

Chaotic systems are iterative, that is, you keep data through the same function over and over again.

As usually used, neural networks run in a single pass, you get data in and get data out.

If you iterated a deep neural network you'd probably find chaos and other dynamic phenomena. But if you just run it once, nope.