Authors
Hyung-il Kim, Juyoung Lee, Hui Shyong Yeo, Aaron John Quigley, Woontack Woo
Publication date
2019/4/25
Journal
Adjunct Proceedings-2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018
Publisher
Institute of Electrical and Electronics Engineers Inc.
Description
In this demonstration, we will show a prototype system with sensor fusion approach to robustly track 6 degrees of freedom of hand movement and support intuitive hand gesture interaction and 3D object manipulation for Mixed Reality head-mounted displays. Robust tracking of hand and finger with egocentric camera remains a challenging problem, especially with self-occlusion – for example, when user tries to grab a virtual object in midair by closing the palm. Our approach leverages the use of a common smart watch worn on the wrist to provide a more reliable palm and wrist orientation data, while fusing the data with camera to achieve robust hand motion and orientation for interaction.
Total citations
2020202120222023113
Scholar articles
H Kim, J Lee, HS Yeo, AJ Quigley, W Woo - … Proceedings-2018 IEEE International Symposium on …, 2019