: Andrea Fossati, Juergen Gall, Helmut Grabner, Xiaofeng Ren, Kurt Konolige
: Andrea Fossati, Juergen Gall, Helmut Grabner, Xiaofeng Ren, Kurt Konolige
: Consumer Depth Cameras for Computer Vision Research Topics and Applications
: Springer-Verlag
: 9781447146407
: Advances in Computer Vision and Pattern Recognition
: 1
: CHF 87.00
:
: Anwendungs-Software
: English
: 220
: Wasserzeichen/DRM
: PC/MAC/eReader/Tablet
: PDF
The potential of consumer depth cameras extends well beyond entertainment and gaming, to real-world commercial applications. This authoritative text reviews the scope and impact of this rapidly growing field, describing the most promising Kinect-based research activities, discussing significant current challenges, and showcasing exciting applications. Features: presents contributions from an international selection of preeminent authorities in their fields, from both academic and corporate research; addresses the classic problem of multi-view geometry of how to correlate images from different viewpoints to simultaneously estimate camera poses and world points; examines human pose estimation using video-rate depth images for gaming, motion capture, 3D human body scans, and hand pose recognition for sign language parsing; provides a review of approaches to various recognition problems, including category and instance learning of objects, and human activity recognition; with a Foreword by Dr. Jamie Shotton.

Dr. Andrea Fossati andDr. Helmut Grabner are post-doctoral researchers in the Computer Vision Laboratory at ETH Zurich, Switzerland.

Dr. Juergen Gall is a Senior Researcher at the Max Planck Institute for Intelligent Systems, Tübingen, Germany.

Dr. Xiaofeng Ren is a Research Scientist at the Intel Science and Technology Center for Pervasive Computing, Intel Labs, and an Affiliate Assistant Professor at the Department of Computer Science and Engineering of the University of Washington, Seattle, WA, USA.

Dr. Kurt Konolige is a Senior Researcher at Industrial Perception Inc., Palo Alto, CA, USA.

Consumer Depth Cameras for Computer Vision3
Foreword5
Working on Human Pose Estimation for Kinect6
Beyond Entertainment7
Looking to the Future8
Preface9
Contents12
Acronyms14
Part I: 3D Registration and Reconstruction16
Chapter 1: 3D with Kinect18
1.1 Introduction18
1.2 Kinect as a 3D Measuring Device19
1.2.1 IR Image20
1.2.2 RGB Image21
1.2.3 Depth Image21
1.2.4 Depth Resolution21
1.3 Kinect Geometrical Model23
1.3.1 Shift Between IR Image and Depth Image24
1.3.2 Identi?cation of the IR Projector Geometrical Center25
1.3.3 Identi?cation of Effective Depth Resolutions of the IR Camera and Projector Stereo Pair26
1.4 Kinect Calibration29
1.4.1 Learning Complex Residual Errors30
1.5 Validation31
1.5.1 Kinect Depth Models Evaluation on a 3D Calibration Object34
1.5.2 Comparison of Kinect, SLR Stereo and 3D TOF35
1.5.3 Combining Kinect and Structure from Motion36
1.6 Conclusion39
References39
Chapter 2: Real-Time RGB-D Mapping and 3-D Modeling on the GPU Using the Random Ball Cover41
2.1 Introduction42
2.2 Related Work43
2.3 Methods45
2.3.1 Data Preprocessing on the GPU46
Nomenclature46
Landmark Extraction47
2.3.2 Photogeometric ICP Framework47
2.3.3 6-D Nearest Neighbor Search Using RBC48
2.4 Implementation Details50
2.4.1 Details Regarding the ICP Framework50
2.4.2 RBC Construction and Queries on the GPU51
RBC Construction51
RBC Nearest Neighbor Queries53
2.5 Experiments and Results53
2.5.1 Qualitative Results53
2.5.2 Performance Study56
Preprocessing Pipeline56
ICP Using RBC56
2.5.3 Approximate RBC57
2.6 Discussion and Conclusions59
References60
Chapter 3: A Brute Force Approach to Depth Camera Odometry63
3.1 Introduction63
3.2 Related Work64
3.3 Proposed Method65
3.3.1 Algorithm Overview66
3.3.2 Practical Issues67
Feature Extraction67
Score Evaluation67
3.3.3 Implementation Details67
3.4 Experimental Results68
3.4.1 Qualitative Evaluation68
3.4.2 Precision Analysis69
3.4.3 Comparison with the ICP Method72
3.5 Conclusion and Future Work73
References73
Part II: Human Body Analysis75
Chapter 4: Key Developments in Human Pose Estimation for Kinect77
4.1 Introduction: The Challenge77
4.2 Body Part Classi?cation-The Natural Markers Approach78
4.2.1 Generating the Training Data79
4.2.2 Randomized Forests for Classi?cation79
4.3 Random Forest Regression-The Voting Approach80
4.4 Context-Sensitive Pose Estimation-Conditional Regression Forests81
4.5 One-Shot Model Fitting: The Vitruvian Manifold82
4.6 Directions for Future Work83
References83
Chapter 5: A Data-Driven Approach for Real-Time Full Body Pose Reconstruction from a Depth Camera85
5.1 Introduction86
Contributions87
5.2 Related Work88
Intensity-Image-Based Tracking88
Depth-Image-Based Tracking88
5.3 Acquisition and Data Preparation90
5.3.1 Depth Data90
5.3.2 Model of the Actor91
5.3.3 Pose Database92
5.3.4 Normalization93
5.4 Pose Reconstruction Framework94
5.4.1 Local Optimization95
5.4.2 Feature Computation95
5.4.3 Database Lookup101
5.4.4 Hypothesis Selection102
5.5 Experiments103
5.5.1 Feature Extraction103
5.5.2 Quantitative Evaluation103
5.5.3 Run Time105
5.5.4 Qualitative Evaluation105
5.5.5 Limitations108
5.6 Conclusions109
References109
Chapter 6: Home 3D Body Scans from a Single Kinect113
6.1 Introduction114
6.2 Related Work116
6.3 Sensor and Preprocessing117
Intrinsic Calibration118
Stereo Calibration118
Depth Calibration118
Ground Plane118
Segmentation118
6.4 Body Model and Fitting119
6.4.1 SCAPE Body Model119
6.4.2 Pose Initialization120
6.4.3 Depth Objective121
6.4.4 Silhouette Objective121
6.4.5 Optimization124
6.5 Results124
From Bodies to Measurements127
Accuracy Relative to Laser Scans127
Linear Measurement Accuracy129
6.6 Conclusions129
References130
Chapter 7: Real Time Hand Pose Estimation Using Depth Sensors132
7.1 Introduction132
7.1.1 Related Work134
7.1.1.1 Hand Pose Estimation134
7.1.1.2 Hand Shape Recognition