Programatically Understand Gaussian Processes: Part 1

Programatically Understand Gaussian Processes: Part 1(nipunbatra.github.io)

50 points by nipun_batra 7 years ago | 4 comments

ovi256 7 years ago |

There's also "A Visual Exploration of Gaussian processes".

https://distill.pub/2019/visual-exploration-gaussian-process...

Everything from distill.pub is great.

nipun_batra 7 years ago | |

I agree that distill.pub is great and so is the article you've mentioned. I did seek inspiration from the linked article amongst many others.

mcphage 7 years ago |

I'm kinda confused by the graphs like this: https://nipunbatra.github.io/blog/2019/20d-conditional.gif

I would expect the graphs to curve (somewhat) smoothly between the 3rd and 4th known points, but instead the 4th point shows up as this weird discontinuity—the graphs are far above it, and then spike down to the 4th point only very close to that point. Why is that? The result doesn't seem (to my untrained eyes) to be very satisfactory.

nipun_batra 7 years ago | |

Good questions. A few quick thoughts. These may not be enough though!

First, the mean function specified in the prior is zero for all the points. Thus, points would have a high density near zero.

I have a strong hunch that choosing a "smoother" kernel would not lead to this discontinuity.