PNNU: parallel nearest-neighbor units for learned dictionaries
MetadataShow full item record
We present a novel parallel approach, parallel nearest neigh- bor unit (PNNU), for finding the nearest member in a learned dictionary of high-dimensional features. This is a computation fundamental to machine learning and data analytics algorithms such as sparse coding for feature extraction. PNNU achieves high performance by using three techniques: (1) PNNU employs a novel fast table look up scheme to identify a small number of atoms as candidates from which the nearest neighbor of a query data vector can be found; (2) PNNU reduces computation cost by working with candidate atoms of reduced dimensionality; and (3) PNNU performs computations in parallel over multiple cores with low inter-core communication overheads. Based on e cient computation via techniques (1) and (2), technique (3) attains further speed up via parallel processing. We have implemented PNNU on multi-core ma- chines. We demonstrate its superior performance on three application tasks in signal processing and computer vision. For an action recognition task, PNNU achieves 41x overall performance gains on a 16-core compute server against a conventional serial implementation of nearest neighbor computation. Our PNNU software is available online as open source.
RightsCopyright is reserved by the copyright owner.
Showing items related by title, author, creator and subject.
Nearest neighbor classification using a density sensitive distance measurement [electronic resource] Burkholder, Joshua Jeremy (Monterey, California. Naval Postgraduate School, 2009-09);This work proposes a density sensitive distance measurement that takes into account the density of an underlying dataset to better represent the shape of the data when measuring distance. Kernel density estimation, using ...
Thon, Scott R. (Monterey, California. Naval Postgraduate School, 1993-12);As a consequence of recent Defense Management Review Decisions the Department of Defense (DoD) has consolidated the physical distribution functions for wholesale consumable materiel under the management of the Defense ...
USING A K-NEAREST NEIGHBORS MACHINE LEARNING APPROACH TO DETECT CYBERATTACKS ON THE NAVY SMART GRID Chan, Vincent C. (Monterey, CA; Naval Postgraduate School, 2020-09);In 2019, the Naval Facilities Engineering Command (NAVFAC) deployed the Navy smart grid across multiple bases in the United States. The smart grid can improve the reliability, availability, and efficiency of electricity ...