深度强化学习进展:从AlphaGo到AlphaGo Zero

2023-01-17 15:55:13 文档大全网 [ 字体：小中大 ] [ 阅读： ]

【#文档大全网# 导语】以下是®文档大全网的小编为您整理的《深度强化学习进展:从AlphaGo到AlphaGo Zero》，欢迎阅读！
AlphaGo,深度,进展,强化,学习
深度强化学习进展：从AlphaGo到AlphaGo Zero

唐振韬;邵坤;赵冬斌;朱圆恒

【期刊名称】《控制理论与应用》【年(卷),期】2017(034)012

【摘要】2016年初,AlphaGo战胜李世石成为人工智能的里程碑事件.其核心技术深度强化学习受到人们的广泛关注和研究,取得了丰硕的理论和应用成果.并进一步研发出算法形式更为简洁的AlphaGo Zero,其采用完全不基于人类经验的自学习算法,完胜AlphaGo,再一次刷新人们对深度强化学习的认知.深度强化学习结合了深度学习和强化学习的优势,可以在复杂高维的状态动作空间中进行端到端的感知决策.本文主要介绍了从AlphaGo到Alpha-Go Zero的深度强化学习的研究进展.首先回顾对深度强化学习的成功作出突出贡献的主要算法,包括深度Q网络算法、A3C算法、策略梯度算法及其他算法的相应扩展.然后给出AlphaGo Zero的详细介绍和讨论,分析其对人工智能的巨大推动作用.并介绍了深度强化学习在游戏、机器人、自然语言处理、智能驾驶、智能医疗等领域的应用进展,以及相关资源进展.最后探讨了深度强化学习的发展展望,以及对其他潜在领域的人工智能发展的启发意义.%In the early 2016,the defeat of Lee Sedol by AlphaGo became the milestone of artificial intelligence.Since then,deep reinforcement learning(DRL),which is the core technique of AlphaGo,has received widespread attention,and has gained fruitful results in both theory and applications.In the sequel,AlphaGo Zero,a simplified version of AlphaGo, masters the game of Go by self-play without human knowledge.As a result,AlphaGo Zero completely surpasses AlphaGo, and enriches

humans'understanding of DRL.DRL combines the advantages of deep learning and reinforcement learning, so it is able to perform well in high-dimensional state-action space, with an end-to-end structure combining perception and decision together.In this paper, we present a survey on the remarkable process made by DRL from AlphaGo to AlphaGo Zero.We first review the main algorithms that contribute to the great success of DRL,including DQN,A3C, policy-gradient,and other algorithms and their extensions.Then,detailed introduction and discussion on AlphaGo Zero are given and its great promotion on artificial intelligence is also analyze.The progress of applications with DRL in such areas as games,robotics,natural language processing,smart driving,intelligent health care,and related resources are also presented.In the end,we discuss the future development of DRL,and the inspiration on other potential areas related to artificial intelligence.

【总页数】18页(P1529-1546) 【作者】唐振韬;邵坤;赵冬斌;朱圆恒

【作者单位】中国科学院自动化研究所复杂系统管理与控制国家重点实验室,北京100190;中国科学院大学,北京100190 【正文语种】中文【中图分类】TP273 【相关文献】

1.Where Does AlphaGo Go: From Church-Turing Thesis to AlphaGo Thesis and Beyond [J], Fei-Yue Wang;Jun Jason Zhang;Xinhu Zheng;Xiao Wang;Yong Yuan;Xiaoxiao Dai;Jie Zhang;Liuqing Yang; 2.AlphaGo Zero来了 [J], ; 3.AlphaGo Zero来了 [J], ;

4.最强AlphaGo Zero横空出世 [J], ;

5.先天综合判断观照下的深度增强学习:以AlphaGo Zero为例 [J], 郑炳楠;贺威

因版权原因，仅展示原文概要，查看原文内容请购买