Naval Postgraduate School
Language identification by statistical analysis.
languageidentifi00raum.pdf (6.734Mb)Abstract
An analysis was conducted of English and Spanish text. The statistical analysis determined the independent probability of letters and the joint probability of various letter combinations for large samples of each language. Various methods were tested in an attempt to utilize these characteristics to identify the language of a short sample text. By use of the joint probability of various vowel-consonant relationships and the Kolmogorov-Smirnov Goodness of Fit Test an identification system was defined that provided a significance level of .0077 for a sample of 107 letters (approximately 21 words). Investigation also showed that the space rate or the interword structure in each language contains a measure of intelligence and was useful in identification
Description
Approved for public release; distribution is unlimited.
Collections
Related items
Showing items related by title, author, creator and subject.
-
Language Translation for File Paths
(Monterey, California. Naval Postgraduate School, 2013);Forensic examiners are frequently confronted with content in languages that they do not understand, and they could benefit from machine translation into their native language. But automated translation of file paths is a ... -
Bi-spectral method for radar target recognition
(Monterey California. Naval Postgraduate School, 2006-12);Target recognition and identification in battlefields has been a crucial determinant to the ultimate success or failure of modern military campaigns. Since World War II, the Identification of Friend or Foe (IFF) systems ... -
The quantitative risk of oil tanker groundings
(Monterey, California. Naval Postgraduate School, 1996);The culture, design, and operation of the maritime industry all contribute to create an error-inducing system. As oil tankers have become larger, the tolerance for error has decreased as the consequences have increased. ...
