专栏名称: 机器学习研究会

机器学习研究会是北京大学大数据与机器学习创新中心旗下的学生组织，旨在构建一个机器学习从事者交流的平台。除了及时分享领域资讯外，协会还会举办各种业界巨头/学术神牛讲座、学术大牛沙龙分享会、real data 创新竞赛等活动。

【论文】卡内基梅隆大学CVPR 2017论文：单个图像中的手部关键点检测，使用多视图自举技术(附代码和数据)

机器学习研究会 · 公众号 · AI · 2017-05-31 19:58

正文

点击上方“机器学习研究会”可以订阅哦

摘要

转自：视觉机器人

卡内基梅隆大学CVPR 2017论文《Hand Keypoint Detection in Single Images using Multiview Bootstrapping》，手势识别技术。单个图像中的手部关键点检测，使用多视图自举技术。

摘要：

We present an approach that uses a multi-camera system to train fine-grained detectors for keypoints that are prone to occlusion, such as the joints of a hand. We call this procedure multiview bootstrapping: first, an initial keypoint detector is used to produce noisy labels in multiple views of the hand. The noisy detections are then triangulated in 3D using multiview geometry or marked as outliers. Finally, the reprojected triangulations are used as new labeled training data to improve the detector. We repeat this process, generating more labeled data in each iteration. We derive a result analytically relating the minimum number of views to achieve target true and false positive rates for a given detector. The method is used to train a hand keypoint detector for single images. The resulting keypoint detector runs in realtime on RGB images and has accuracy comparable to methods that use depth sensors. The single view detector, triangulated over multiple views, enables 3D markerless hand motion capture with complex object interactions.