专栏名称: 机器学习研究会
机器学习研究会是北京大学大数据与机器学习创新中心旗下的学生组织,旨在构建一个机器学习从事者交流的平台。除了及时分享领域资讯外,协会还会举办各种业界巨头/学术神牛讲座、学术大牛沙龙分享会、real data 创新竞赛等活动。
目录
相关文章推荐
宝玉xp  ·  回复@oO支离破碎Oo:编程用Cursor、 ... ·  昨天  
黄建同学  ·  OpenAI 11 日全球宕机 5 ... ·  昨天  
爱可可-爱生活  ·  【ComfyUI-IF_MemoAvatar ... ·  2 天前  
爱可可-爱生活  ·  「AI说:对话的背后到底是什么?」当我们说“ ... ·  3 天前  
林小奇笔记  ·  强者心态 ·  4 天前  
林小奇笔记  ·  强者心态 ·  4 天前  
51好读  ›  专栏  ›  机器学习研究会

【论文】FlowNet 2.0:利用深度网络进行光流估计的演进

机器学习研究会  · 公众号  · AI  · 2017-02-05 17:13

正文


点击上方“机器学习研究会”可以订阅哦
摘要
 

转自:视觉机器人

论文《FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks》,提出了光流的端到端学习的概念。 质量和速度的巨大提高是由三个主要贡献造成的:
1.我们专注于训练数据,并表明训练期间呈现数据的调度非常重要。
2.我们开发了一种堆叠架构,其包括具有中间光流的第二图像的翘曲。
3.我们通过引入一个专门针对小运动的子网络。 


摘要:

The FlowNet demonstrated that optical flow estimation can be cast as a learning problem. However, the state of the art with regard to the quality of the flow has still been defined by traditional methods. Particularly on small displacements and real-world data, FlowNet cannot compete with variational methods. In this paper, we advance the concept of end-to-end learning of optical flow and make it work really well. The large improvements in quality and speed are caused by three major contributions: first, we focus on the training data and show that the schedule of presenting data during training is very important. Second, we develop a stacked architecture that includes warping of the second image with intermediate optical flow. Third, we elaborate on small displacements by introducing a sub-network specializing on small motions. FlowNet 2.0 is only marginally slower than the original FlowNet but decreases the estimation error by more than 50%. It performs on par with state-of-the-art methods, while running at interactive frame rates. Moreover, we present faster variants that allow optical flow computation at up to 140fps with accuracy matching the original FlowNet.


链接:

http://lmb.informatik.uni-freiburg.de/Publications/2016/IMKDB16/


原文链接:

http://weibo.com/5501429448/Eu6KR0X8F?ref=collection&type=comment

“完整内容”请点击【阅读原文】

↓↓↓