Fusion of multiple sensor types in computer vision systems
Mayo, Donald R.
MetadataShow full item record
This research provides analysis of several approaches to the fusion of multiple dissimilar sensors to supplement simple color vision detection and recognition. Non-visible sensor systems can enhance computer vision systems. Our research investigates using thermal infrared (IR) sensors in combination with color data for object detection and recognition. We analyze several types of high-level and low-level sensor fusion to compare error rates with raw color and raw IR error rates in detection and recognition of vehicles in a scene. Principal components analysis is used to reduce the dimensionality of sensor input data in order to discard non-essential data, while preserving data important to classification. One recognition method showing promise is to exploit the strength of non-visible information (low light, shadows, etc.) to reduce the search space for color data by replacing the V channel in the HSV color sensor data with IR. For detection, one method showing promise is replacement or averaging of the dominant color channel with IR.
Showing items related by title, author, creator and subject.
Krebs, William K.; Sinai, Michael J. (Sage Journals, 2002-06-01);The goal of this study was to determine the perceptual advantages of multiband sensor-fused (achromatic and chromatic) imagery over conventional single-band nighttime (image-intensified and infrared) imagery for a wide ...
Krebs, W.K.; Scribner, D.A.; McCarley, J.S.; Ogawa, J.S.; Sinai, M.J. (RTO MP-45, 1999-06);Recent technological advances in sensor manufacturing enable the use of separate spectral bands; e.g., MWIR and LWIR, to generate spatially registered imagery. Human factors experiments can be used to test whether a ...
ROBOTIC NAVIGATION AND MAPPING IN GPS-DENIED ENVIRONMENTS WITH 3D LIDAR AND INERTIAL NAVIGATION UTILIZING A SENSOR FUSION ALGORITHM Caspers, Matthew G. (Monterey, CA; Naval Postgraduate School, 2021-09);Global Navigation Satellite Systems (GNSS) do not currently offer viable solutions for autonomous robotic navigation in a tactical scenario, as GNSS networks are susceptible to enemy jamming and loss of coverage within ...