查看原文
其他

【AlphaGoZero核心技术】深度强化学习知识资料全集(论文/代码/教程/视频/文章等)

2017-10-20 钱胜胜/Quan 专知

点击上方“专知”关注获取更多AI知识!


【导读】昨天 Google DeepMind在Nature上发表最新论文,介绍了迄今最强最新的版本AlphaGo Zero,不使用人类先验知识,使用纯强化学习,将价值网络和策略网络整合为一个架构,3天训练后就以100比0击败了上一版本的AlphaGo。Alpha Zero的背后核心技术是深度强化学习,为此,专知特别收录整理聚合了关于强化学习的最全知识资料,欢迎大家查看!


先看下Google DeepMind 研究人员David Silver介绍 AlphaGo Zero:

https://v.qq.com/txp/iframe/player.html?vid=g0562traocj&width=500&height=375&auto=0


专知 -Deep Reinforcement Learning 最全资料集合:


  • Nature 论文

    Mastering the game of Go without human knowledge

    Nature 550, 7676 (2017). doi:10.1038/nature24270

    Authors: David Silver, Julian Schrittwieser, Karen Simonyan, Ioannis Antonoglou, Aja Huang, Arthur Guez, Thomas Hubert, Lucas Baker, Matthew Lai, Adrian Bolton, Yutian Chen, Timothy Lillicrap, Fan Hui, Laurent Sifre, George van den Driessche, Thore Graepel & Demis Hassabis

    网址:https://www.nature.com/nature/journal/v550/n7676/full/nature24270.html

    请下载pdf查看!

Mastering the game of Go with deep neural networks and tree search

David Silver, Aja Huang, Chris J. Maddison, Arthur Guez, Laurent Sifre, George van den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Vedavyas Panneershelvam, Marc Lanctot, Sander Dieleman, Dominik Grewe, John Nham, Nal Kalchbrenner, Ilya Sutskever, Timothy P. Lillicrap, Madeleine Leach, Koray Kavukcuoglu, Thore Graepel, Demis Hassabis:
 Nature 529(7587): 484-489 (2016)


  • Papers

          

Mastering the Game  of Go without Human Knowledge

https://deepmind.com/documents/119/agz_unformatted_nature.pdf

Human level control with deep  reinforcement learning

http://www.nature.com/nature/journal/v518/n7540/full/nature14236.html

Play Atari game with deep reinforcement  learning

https://www.cs.toronto.edu/%7Evmnih/docs/dqn.pdf

Prioritized experience replay

https://arxiv.org/pdf/1511.05952v2.pdf

Dueling DQN

https://arxiv.org/pdf/1511.06581v3.pdf

Deep reinforcement learning with double Q  Learning

https://arxiv.org/abs/1509.06461 

Deep Q learning with NAF

https://arxiv.org/pdf/1603.00748v1.pdf 

Deterministic policy gradient

http://jmlr.org/proceedings/papers/v32/silver14.pdf

Continuous control with deep  reinforcement learning) (DDPG)

https://arxiv.org/pdf/1509.02971v5.pdf

Asynchronous Methods for Deep  Reinforcement Learning

https://arxiv.org/abs/1602.01783

Policy distillation

https://arxiv.org/abs/1511.06295

Control of Memory, Active Perception, and  Action in Minecraft

https://arxiv.org/pdf/1605.09128v1.pdf

Unifying Count-Based Exploration and  Intrinsic Motivation

https://arxiv.org/pdf/1606.01868v2.pdf 

Incentivizing Exploration In  Reinforcement Learning With Deep Predictive Models

https://arxiv.org/pdf/1507.00814v3.pdf

Action-Conditional Video Prediction using  Deep Networks in Atari Games

https://arxiv.org/pdf/1507.08750v2.pdf

Control of Memory, Active Perception, and  Action in Minecraft

https://web.eecs.umich.edu/~baveja/Papers/ICML2016.pdf

PathNet

https://arxiv.org/pdf/1701.08734.pdf


  • Papers for NLP

 

Coarse-to-Fine  Question Answering for Long Documentshttps://homes.cs.washington.edu/~eunsol/papers/acl17eunsol.pdf
A Deep Reinforced Model for Abstractive  Summarizationhttps://arxiv.org/pdf/1705.04304.pdf
Reinforcement Learning for Simultaneous  Machine Translationhttps://www.umiacs.umd.edu/~jbg/docs/2014_emnlp_simtrans.pdf
Dual Learning for Machine Translationhttps://papers.nips.cc/paper/6469-dual-learning-for-machine-translation.pdf
Learning to Win by Reading Manuals in a  Monte-Carlo Frameworkhttp://people.csail.mit.edu/regina/my_papers/civ11.pdf
Improving Information Extraction by  Acquiring External Evidence with Reinforcement Learninghttp://people.csail.mit.edu/regina/my_papers/civ11.pdf
Deep Reinforcement Learning with a  Natural Language Action Spacehttp://www.aclweb.org/anthology/P16-1153
Deep Reinforcement Learning for Dialogue  Generationhttps://arxiv.org/pdf/1606.01541.pdf
Reinforcement Learning for Mapping  Instructions to Actionshttp://people.csail.mit.edu/branavan/papers/acl2009.pdf
Language Understanding for Text-based  Games using Deep Reinforcement Learninghttps://arxiv.org/pdf/1506.08941.pdf
End-to-end LSTM-based dialog control  optimized with supervised and reinforcement learninghttps://arxiv.org/pdf/1606.01269v1.pdf
End-to-End Reinforcement Learning of  Dialogue Agents for Information Accesshttps://arxiv.org/pdf/1609.00777v1.pdf
Hybrid Code Networks: practical and  efficient end-to-end dialog control with supervised and reinforcement  learninghttps://arxiv.org/pdf/1702.03274.pdf
Deep Reinforcement Learning for  Mention-Ranking Coreference Modelshttps://arxiv.org/abs/1609.08667
  • 精选文章

wikihttps://en.wikipedia.org/wiki/Reinforcement_learning
Deep Reinforcement Learning: Pong from  Pixelshttp://karpathy.github.io/2016/05/31/rl/
CS 294: Deep Reinforcement Learninghttp://rll.berkeley.edu/deeprlcourse/
强化学习系列之一:马尔科夫决策过程http://www.algorithmdog.com/%E5%BC%BA%E5%8C%96%E5%AD%A6%E4%B9%A0-%E9%A9%AC%E5%B0%94%E7%A7%91%E5%A4%AB%E5%86%B3%E7%AD%96%E8%BF%87%E7%A8%8B
强化学习系列之九:Deep Q Network (DQN)http://www.algorithmdog.com/drl
强化学习系列之三:模型无关的策略评价http://www.algorithmdog.com/reinforcement-learning-model-free-evalution
【整理】强化学习与MDPhttp://www.cnblogs.com/mo-wang/p/4910855.html
强化学习入门及其实现代码http://www.jianshu.com/p/165607eaa4f9
深度强化学习系列(二):强化学习http://blog.csdn.net/ikerpeng/article/details/53031551
采用深度 Q  网络的 Atari 的 Demo:
 Nature 上关于深度 Q 网络 (DQN) 论文:
http://www.nature.com/articles/nature14236
David视频里所使用的讲义pdfhttps://pan.baidu.com/s/1nvqP7dB
什么是强化学习?http://www.cnblogs.com/geniferology/p/what_is_reinforcement_learning.html
DavidSilver  关于 深度确定策略梯度 DPG的论文 http://www.jmlr.org/proceedings/papers/v32/silver14.pdf
Nature 上关于 AlphaGo 的论文:http://www.nature.com/articles/nature16961
AlphaGo 相关的资源deepmind.com/research/alphago/
What’s the Difference Between Artificial  Intelligence, Machine Learning, and Deep Learning?https://blogs.nvidia.com/blog/2016/07/29/whats-difference-artificial-intelligence-machine-learning-deep-learning-ai/
Deep Learning in a Nutshell:  Reinforcement Learninghttps://devblogs.nvidia.com/parallelforall/deep-learning-nutshell-reinforcement-learning/
Bellman equationhttps://en.wikipedia.org/wiki/Bellman_equation
Reinforcement learninghttps://en.wikipedia.org/wiki/Reinforcement_learning
Mastering the Game of Go without Human  Knowledgehttps://deepmind.com/documents/119/agz_unformatted_nature.pdf
Reinforcement Learning(RL) for Natural  Language Processing(NLP)https://github.com/adityathakker/awesome-rl-nlp


  • 视频教程


强化学习教程(莫烦)https://morvanzhou.github.io/tutorials/machine-learning/reinforcement-learning/
强化学习课程 by David Silverhttps://www.bilibili.com/video/av8912293/?from=search&seid=1166472326542614796
CS234: Reinforcement Learninghttp://web.stanford.edu/class/cs234/index.html
什么是强化学习? (Reinforcement Learning)https://www.youtube.com/watch?v=NVWBs7b3oGk
什么是 Q Learning (Reinforcement Learning  强化学习)https://www.youtube.com/watch?v=HTZ5xn12AL4
强化学习-莫烦https://morvanzhou.github.io/tutorials/machine-learning/ML-intro/
David Silver深度强化学习第1课 - 简介 (中文字幕)https://www.bilibili.com/video/av9831889/
David Silver的这套视频公开课(Youtube)https://www.youtube.com/watch?v=2pWv7GOvuf0&list=PL7-jPKtc4r78-wCZcQn5IqyuWhBZ8fOxT
David Silver的这套视频公开课(Bilibili)http://www.bilibili.com/video/av9831889/?from=search&seid=17387316110198388304 
Deep Reinforcement Learninghttp://videolectures.net/rldm2015_silver_reinforcement_learning/


  • Tutorial

    Reinforcement  Learning for NLPhttp://www.umiacs.umd.edu/~jbg/teaching/CSCI_7000/11a.pdf
    ICML 2016, Deep Reinforcement Learning tutorialhttp://icml.cc/2016/tutorials/deep_rl_tutorial.pdf 
    DQN tutorialhttps://medium.com/@awjuliani/simple-reinforcement-learning-with-tensorflow-part-4-deep-q-networks-and-beyond-8438a3e2b8df#.28wv34w3a
  • 代码

    OpenAI Gymhttps://github.com/openai/gym
    GoogleDeep Mind 团队深度 Q 网络 (DQN) 源码:http://sites.google.com/a/deepmind.com/dqn/
    ReinforcementLearningCodehttps://github.com/halleanwoo/ReinforcementLearningCode
    reinforcement-learninghttps://github.com/dennybritz/reinforcement-learning
    DQNhttps://github.com/devsisters/DQN-tensorflow
    DDPGhttps://github.com/stevenpjg/ddpg-aigym
    A3C01https://github.com/miyosuda/async_deep_reinforce
    A3C02https://github.com/openai/universe-starter-agent 


特注:


请登录www.zhuanzhi.ai或者点击阅读原文,

顶端搜索“强化学习” 主题直接获取查看获得全网收录资源进行查看, 涵盖论文等资源下载链接,并获取更多与强化学习的知识资料!如下图所示。


此外,请关注专知公众号(扫一扫最下面专知二维码,或者点击上方蓝色专知),后台回复“强化学习” 就可以获取全部知识资料的pdf文档集合下载链接!


 欢迎转发到你的微信群和朋友圈,分享专业AI知识!


获取更多关于机器学习以及人工智能知识资料,请访问www.zhuanzhi.ai, 或者点击阅读原文,即可得到!

-END-

欢迎使用专知

专知,一个新的认知方式!目前聚焦在人工智能领域为AI从业者提供专业可信的知识分发服务, 包括主题定制、主题链路、搜索发现等服务,帮你又好又快找到所需知识。


使用方法>>访问www.zhuanzhi.ai, 或点击文章下方“阅读原文”即可访问专知


中国科学院自动化研究所专知团队

@2017 专知


专 · 知


关注我们的公众号,获取最新关于专知以及人工智能的资讯、技术、算法、深度干货等内容。扫一扫下方关注我们的微信公众号。


点击“阅读原文”,使用专知

您可能也对以下帖子感兴趣

文章有问题?点此查看未经处理的缓存