Dynamic Automatic Differentiation of GPU Broadcast Kernels

Dynamic Automatic Differentiation of GPU Broadcast Kernels(arxiv.org)

5 points by jrevels 7 years ago | 1 comment

wallnuss 7 years ago |

One of the author here. Working on this paper was fun, one of the most interesting lessons I learned was that divergence on GPUs has dramatically fallen in cost on modern architectures.

wallnuss 7 years ago |

One of the author here. Working on this paper was fun, one of the most interesting lessons I learned was that divergence on GPUs has dramatically fallen in cost on modern architectures.