An analysis of data validity for measures of effectiveness of information systems.

Abstract

This thesis examines validity issues associated with the use of data collection techniques in information systems research. It presents an analysis of 37 studies that purported to empirically assess the effectiveness of information systems . These studies were evaluated to determine the validity of measures of effectiveness of information systems. Each study was reviewed to identify (1) data collection techniques used, (2) purported measures of the techniques, (3) ways in which the techniques were administered, and (4) discussions of validity issues arising from the use of the techniques. Findings indicate that information systems researchers have adopted data collection techniques commonly used by social scientists; however, they largely ignore or are unaware of associated validity issues . Over three-quarter of the studies involved questionnaires and fewer than a quarter addressed validity issues. Consequently, the credibility of information systems research is vulnerable to challenge.