Where the creation, understanding, and assessment of software testing and regression testing techniques are concerned, controlled experimentation is an indispensable research methodology. Obtaining the infrastructure necessary to support such experimentation, however, is difficult and expensive. As a result, progress in experimentation with testing techniques has been slow, and empirical data on the costs and effectiveness of techniques remains relatively scarce. To help address this problem, we have been designing and constructing infrastructure to support controlled experimentation with testing and regression testing techniques. This paper reports on the challenges faced by researchers experimenting with testing techniques, including those that inform the design of our infrastructure. The paper then describes the infrastructure that we are creating in response to these challenges, and that we are now making available to other researchers, and discusses the impact that this infrastructure has and can be expected to have.

Software maintenance and evolution are the dominant activities in the software lifecycle. Modularization can separate design decisions and allow them to be independently evolved, but modularization often breaks down and complicated global changes are required. Tool support can reduce the costs of these unfortunate changes, but current tools are limited in their ability to manage information for large-scale software evolution. In this paper we argue that the map metaphor can serve as an organizing principle for the design of effective tools for performing global software changes. We describe the design of Aspect Browser, developed around the map metaphor, and discuss a case study of removing a feature from a 500,000 line program written in Fortran and C. 1

Abstract: The case for combining research methods generally, and more specifically that for combining qualitative and quantitative methods, is strong. Yet, research designs that extensively integrate both fieldwork (e.g. case studies) and survey research are rare. Moreover, some journals tend tacitly to specialize by methodology thereby encouraging purity of method. The multi-method model of research while not new, has not been appreciated. In this respect it is useful to articulate and describe its usage through example. By reference to a recently completed study of IS consultant engagement success factors this paper presents an analysis of the benefits of integrating case study and survey research methods. The emphasis is on the qualitative case study method and how it can compliment more quantitative survey research. Benefits are demonstrated through specific examples from the reference study.

practitioners and their customers who are familiar with the effects of large deviations between planned time for delivery and the actual one. Time is often estimated based on the size of the software to build and it is therefore interesting to investigate how well experienced software developers predict change.

This paper discusses findings from case studies of six organizations using or attempting to use the Answer Garden, a type of organizational memory system. Two major issues in the implementation of such systems are examined: (1) the gap between the idealized definition of organizational memory and the constrained realities of organizational life, and (2) the effects of reducing contextual information in computer-based memory. 1. Introduction Organizational memory is an evocative metaphor, suggesting the promise of infinitely retrievable knowledge and experience. Organizational memory systems (OMS) offer the possibility that computer systems can better serve the information storage and retrieval needs of an organization's memory than can present technical and social methods. But in order to augment organizational memory with computer systems, we need to better understand the critical organizational issues facing such augmentation efforts. Many of these critical issues will be standard information technology issues: the nature of performance improvement with new types of systems, the political nature of information systems, and so on. Some of these issues, however, have a unique "spin" resulting from the organizational and technical questions inherent in organizational memory systems. This paper examines two major issues that have an additional emphasis in organizational memory systems. Author's address: ackerman@ics.uci.edu. The discussion is based on case studies of organizations using a specific OMS, Answer Garden. Following a brief discussion of the Answer Garden and the study sites, I examine the first organizational issue, the tension between an idealized conception of organizational memory in most study sites and the constraints that exist within organizations. Sinc...

Abstract not found

Where the development, understanding, and assessment of software testing and regression testing techniques are concerned, controlled experimentation is an indispensable research methodology. Obtaining the infrastructure necessary to support rigorous controlled experimentation with testing techniques, however, is difficult and expensive. As a result, progress in experimentation with testing techniques has been slow, and empirical data on the costs and effectiveness of testing techniques remains relatively scarce. To help address this problem, we have been designing and constructing infrastructure to support controlled experimentation with software testing and regression testing techniques. This paper reports on the challenges faced by researchers experimenting with testing techniques, including those that inform the design of our infrastructure. The paper then describes the infrastructure that we are creating in response to these challenges, and that we are now making available to other researchers, and discusses the impact that this infrastructure has and can be expected to have on controlled experimentation with testing techniques.

The empirical study described in this paper addresses software reading for construction: how application developers obtain an understanding of a software artifact for use in new system development. This study focuses on the processes that developers would engage in when learning and using object-oriented frameworks. We analyzed 15 student software development projects using both qualitative and quantitative methods to gain insight into what processes occurred during framework usage. The contribution of the study is not to test predefined hypotheses but to generate well-supported hypotheses for further investigation. The main hypotheses we produce are that example-based techniques are well suited to use by beginning learners while hierarchy-based techniques are not because of a larger learning curve. Other more specific hypotheses are proposed and discussed.

suggestions. We are also deeply indebted to the many administrators, scientists, managers, and entrepreneurs who agreed to be interviewed. Martha Cobb and Melissa

This paper presents a methodological framework, structured-case, that assists IS researchers to undertake and assess theory building research within the interpretive paradigm, and explains its value in achieving convincing explanations that are strongly linked to both the research themes and data collected in the field.