Scene Recognition with Infrared, Low-Light, and Sensor-Fused Imagery
Sinai, Michael J.
McCarley, Jason S.
Krebs, William K.
MetadataShow full item record
The goal of this study was to evaluate the information conveyed by single- and dual-band sensor imagery by assessing performance on a scene recognition task. An experiment tested immediate recognition for pictures following an initial brief viewing. Images were taken with an uncooled LIMIRS long-wave infrared sensor and a Fairchild image intensified low-light CCD, and were compared against fused, false-color images created by remapping both spectral bands into a two-dimensional color space (Scribner et al., 1996). In each trial, an image was presented for 100 msec and followed immediately by a 300-msec checkerboard mask. A second image, of the same or of a different sensor format, was then displayed and remained visible until a response was made. The observer’s task was to indicate whether the first and second image depicted the same scene, regardless of which sensor format the scenes were displayed in. All possible permutations of sensor formats were used. It was hypothesized that colorfusion, which combined and potentially enhanced information contained in the single-band images, would allow more accurate scene recognition. Performance was best when the first and second images were presented in the same format. When format changed between the presentation of the two images, performance deteriorated, but more so when the second image was of a single band format. Format of the first image itself had little effect, indicating that the primary benefits of sensor fusion were in matching the content of the second image to a stored representation of the first, and not in processing the briefly viewed first image. These results suggest that fusion can allow information from multiple singleband sensors to be effectively combined and presented within a single image, within which component information remains perceptually accessible.
RightsThis publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.
Showing items related by title, author, creator and subject.
Johnson, Bonnie Worth; Green, John M. (2002-04);The benefits of implementing a network-centric Navy lie in the new capabilities made possible by enhanced information sharing between Navy platforms. Foremost is the potential to enable, enhance, and automate dispersed ...
Swan, William D. (Monterey, California: Naval Postgraduate School, 2016-12);A Micro Electro Mechanical System (MEMS) directional acoustic sensor has been developed based on the coupled eardrums of the Ormia ochracea fly. Previous versions exploited the bending resonance of the sensor and have ...
Single-ended mid-infrared laser-absorption sensor for time-resolved measurements of water concentration and temperature within the annulus of a rotating detonation engine Peng, Wen Yu; Cassady, Séan J.; Strand, Christopher L.; Goldenstein, Christopher S.; Spearrin, R. Mitchell; Brophy, Christopher M.; Jeffries, Jay B.; Hanson, Ronald K. (Elsevier, 2018-06-22);A novel single-ended mid-infrared laser-absorption sensor for time-resolved measurements of water mole fraction and temperature was developed and deployed within the annulus of a hydrogen/air-fed rotating detonation engine ...