Ask HN: What deep learning papers should I implement to learn?

5 points by pandeykartikey 7 years ago | 4 comments

I have been wanting to implement a Deep Learning Paper to get some hands on the current state of the art model or current field of research. But, generally the paper I pickup is a bit tough to understand. So, I was looking if anyone could suggest me a paper which would be some latest research but slightly easier to grasp?

malux85 7 years ago |

Pushing the barriers or independent validation on the latest research is not a good place to start if you're new to the area.

Go and implement an image classifier, tweak the parameters and the topology and see how the results and training changes.

Switch to a time series model / text model, and learn the difference between convolution / recurrent networks.

Start playing with non-sequential topologies, custom objective functions, Q-Learning,

Once you have a grasp of these basics go back and read the papers, and you'll find that you understand them a lot more, and you'll see where they're pushing the boundaries.

ck_one 7 years ago | |

If he wants to focus on Deep Learning I wouldn't touch Reinforcement Learning (you mentioned Q-learning). Lots of hours can be wasted on RL.

malux85 7 years ago | | |

Agreed!

ck_one 7 years ago |

That's actually a pretty good idea to improve your skills. I would highly recommend to implement one of the semantic segmentation papers. Perhaps start with a simple FCN (with and without a pretrained encoder).