Ask HN: Why doesn't AI use dynamical neurons instead of static activations?

1 points by tonii141 263 days ago | 7 comments

Why doesn’t AI use dynamical neurons instead of static activations even when it is known that biological neurons are dynamical systems?

rini17 263 days ago |

I guess it's impossible to simulate billions of dynamical neurons with current computer architecture, it is limited by memory bandwidth.

tonii141 263 days ago | |

I agree, but maybe there is no need for billions of neurons to be simulated right away. Artificial neural networks were pretty small at the time.

rini17 263 days ago | | |

and they did not do much

nialse 263 days ago |

Dynamical neurons are not used because they add enormous computational cost and instability for limited practical gain.

tonii141 263 days ago | |

What do you mean by "they add instability"?

nialse 262 days ago | | |

Neural nets are unstable during training and dynamic weights amplifies the problem. Thus, the neural networks could end up in totally unusable states at inference time.