Abstract

The authors would like to thank the participants of the 1991 Queen's-HEC workshop and two anonymous reviewers and the Editor in chief of JMIS for their helpful comments on an earlier version of this paper. This study was supported financially by École des Hautes Études Commerciales de Montréal and the University of California at Irvine. Survey research is believed to be well understood and applied by MIS scholars. It has been applied for several years, it is well defined, and it has precise procedures which, when followed closely, yield valid and easily interpretable data. Our assessment of the use of survey research in the MIS field between 1980 and 1990 indicates that this perception is at odds with reality. Our analysis indicates that survey methodology is often misapplied and is plagued by five important weaknesses: (1) single method designs where multiple methods are needed, (2) unsystematic and often inadequate sampling procedures, (3) low response rates, (4) weak linkages between units of analysis and respondents, and (5) over reliance on cross-sectional surveys where longitudinal surveys are really needed. Our assessment also shows that the quality of survey research varies considerably among studies of different purposes: explanatory studies are of good quality overall, exploratory and descriptive studies are of moderate to poor quality.

Citations