Fusion of multiple sensor types in computer vision systems

Download
Author
Mayo, Donald R.
Date
2007-09Advisor
Kolsch, Mathias
Squire, Kevin
Metadata
Show full item recordAbstract
This research provides analysis of several approaches to the fusion of multiple dissimilar sensors to supplement simple color vision detection and recognition. Non-visible sensor systems can enhance computer vision systems. Our research investigates using thermal infrared (IR) sensors in combination with color data for object detection and recognition. We analyze several types of high-level and low-level sensor fusion to compare error rates with raw color and raw IR error rates in detection and recognition of vehicles in a scene. Principal components analysis is used to reduce the dimensionality of sensor input data in order to discard non-essential data, while preserving data important to classification. One recognition method showing promise is to exploit the strength of non-visible information (low light, shadows, etc.) to reduce the search space for color data by replacing the V channel in the HSV color sensor data with IR. For detection, one method showing promise is replacement or averaging of the dominant color channel with IR.
Collections
Related items
Showing items related by title, author, creator and subject.
-
Psychophysical Assessments of Image-Sensor Fused Imagery
Krebs, William K.; Sinai, Michael J. (Sage Journals, 2002-06-01);The goal of this study was to determine the perceptual advantages of multiband sensor-fused (achromatic and chromatic) imagery over conventional single-band nighttime (image-intensified and infrared) imagery for a wide ... -
Comparing human target detection with multidimensional matched filtering methods
Krebs, W.K.; Scribner, D.A.; McCarley, J.S.; Ogawa, J.S.; Sinai, M.J. (RTO MP-45, 1999-06);Recent technological advances in sensor manufacturing enable the use of separate spectral bands; e.g., MWIR and LWIR, to generate spatially registered imagery. Human factors experiments can be used to test whether a ... -
ROBOTIC NAVIGATION AND MAPPING IN GPS-DENIED ENVIRONMENTS WITH 3D LIDAR AND INERTIAL NAVIGATION UTILIZING A SENSOR FUSION ALGORITHM
Caspers, Matthew G. (Monterey, CA; Naval Postgraduate School, 2021-09);Global Navigation Satellite Systems (GNSS) do not currently offer viable solutions for autonomous robotic navigation in a tactical scenario, as GNSS networks are susceptible to enemy jamming and loss of coverage within ...