设为首页收藏本站

VALSE

查看: 6456|回复: 2

深度学习资料:Learning Deep Learning

[复制链接]
发表于 2015-5-16 13:19:22 | 显示全部楼层 |阅读模式
http://rt.dgyblog.com/ref/ref-learning-deep-learning.html

Learning Deep Learning

[NOTICE] I'm in the middle of adding NLP and Speech Recognition key references.

There are lots of awesome reading lists or posts that summarized materials related to Deep Learning. So why would I commit another one? Well, the primary objective is to develop a complete reading list that allows readers to build a solid academic and practical background of Deep Learning. And this list is developed while I'm preparing my Deep Learning workshop. My research is related to Deep Neural Networks (DNNs) in general. Hence, this posts tends to summary contributions in DNNs instead of generative models.

For Novice

If you have no idea about Machine Learning and Scientific Computing, I suggest you learn the following materials while you are reading Machine Learning or Deep Learning books. You don't have to master these materials, but basic understanding is important. It's hard to open a meaningful conversation if the person has no idea about matrix or single variable calculus.

Theory of Computation, Learning Theory, Neuroscience, etcFundamentals of Deep LearningTutorials, Practical Guides, and Useful SoftwareLiterature in Deep Learning and Feature Learning

Deep Learning is a fast-moving community. Therefore the line between "Recent Advances" and "Literature that matter" is kind of blurred. Here I collected articles that are either introducing fundamental algorithms, techniques or highly cited by the community.

Recent Must-Read Advances in Deep Learning

Most of papers here are produced in 2014 and after. Survey papers or review papers are not included.

Podcast, Talks, etc.Amazon Web Service Public AMI for Deep Learning

I configured 2 types of GPU instances that are available in AWS and installed necessary software for Deep Learning practice. The first one is DGYDLGPUv4. It is a machine that provides 8-core CPU, 15GB RAM, 500GB SSD and 1 NVIDIA Grid K520 GPU, you can use it to learn Deep Learning or conduct normal size experiment. If you need even more computing resources, you can choose DGYDLGPUXv1. This new released GPU instance offered a 32-core CPU, 60GB RAM, 500GB SSD and 4 NVIDIA Grid K520 GPUs.

NVIDIA Driver, CUDA Toolkit 7.0, cuDNNv2, Anaconda, Theano are preinstalled.

Currently they are only available at Asia Pacific (Singapore). You can copy the instance to your close region.

If you are doing analysis or experiments, I suggest you to request spot instance instead of on-demand instance. This will save you a lot of costs.

  • DGYDLGPUv4 (ami-ba516ee8) [Based on g2.2xlarge]
  • DGYDLGPUXv1 (ami-52516e00) [Based on g2.8xlarge]

Currently, my build of Caffe in the instance is failed. You can use the AMI that is provided by Caffe community. You can get more details from here

So far the instance is only available at US East (N. Virginia)

  • Caffe/CuDNN built 2015-05-04 (ami-763a331e) [For both g2.2xlarge and g2.8xlarge]
Practical Deep Neural Networks - GPU computing perspective

The following entries are materials I use in the workshop.

SlidesPractical tutorialsCodes
  • Telauges
    • A new deep learning libraries for education
    • Right now implements MLP Hidden Layer, Softmax Layer, Auto-encoder, ConvNet Layer
    • In the middle of transforming coding style, I suggest you explore it, but do not use it seriously.

回复

使用道具 举报

0

主题

2

帖子

14

积分

新手上路

Rank: 1

积分
14
发表于 2015-5-19 08:32:59 | 显示全部楼层
很好的资料,感谢分享!
回复 支持 反对

使用道具 举报

1

主题

5

帖子

37

积分

新手上路

Rank: 1

积分
37
发表于 2015-5-19 09:42:30 | 显示全部楼层
资料很全,总结的很好,多谢分享!
回复 支持 反对

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

Archiver|手机版|小黑屋|Vision And Learning SEminar    

GMT+8, 2020-8-11 12:12 , Processed in 0.057148 second(s), 25 queries .

Powered by Discuz! X3.2

© 2001-2013 Comsenz Inc.

快速回复 返回顶部 返回列表