Two of the most important and most difficult questions one can ask about a new software development technique are whether the technique is useful and whether the technique is usable. Various flavours of empirical study are available to evaluate these questions, including surveys, case studies, and experiments. These different approaches have been used extensively in a number of domains, including management science and human-computer interaction. A growing number of software engineering researchers are using experimental methods to statistically validate hypotheses about relatively mature software development aids. Less guidance is available for a developer of a new and evolving software development technique who is attempting to determine, within some cost bounds, if the technique shows some usefulness. We faced this challenge when assessing a new programming technique called aspect-oriented programming. To assess the technique, we chose to apply both a case study approach and a serie...
|
1446
|
The Java Language Specification
– Gosling, Joy, et al.
|
|
1078
|
Aspect-oriented programming
– Kiczales, Lamping, et al.
- 1997
|
|
715
|
A spiral model of software development and enhancement
– Boehm
- 1986
|
|
360
|
A field study of the software design process for large systems
– Curtis, Krasner, et al.
- 1988
|
|
141
|
Object Structure in the Emerald System
– Black, Hutchinson, et al.
- 1986
|
|
115
|
Designing the user interface: Strategies for effective human-computer interaction” (3 rd edition
– Schneiderman
- 1997
|
|
113
|
Applications of case study research
– Yin
- 1993
|
|
112
|
Experimentation in software engineering
– Basili, Selby, et al.
- 1986
|
|
85
|
Science and substance: A challenge to software engineers
– Fenton, Pfleeger, et al.
- 1994
|
|
85
|
Experimental Models for Validating Technology
– Zelkowitz, Wallace
- 1998
|
|
65
|
A Scientific Methodology for MIS Case Studies
– Lee
- 1989
|
|
52
|
unknown title
– YIN
- 1994
|
|
43
|
An Initial Assessment of Aspect-oriented Programming
– Walker, Baniassad, et al.
- 1999
|
|
39
|
Identification of Dynamic Comprehension Processes During Large Scale Maintenance
– Mayrhauser, Vans
- 1996
|
|
37
|
RG: A Case-Study for AspectOriented Programming
– Mendhekar, Kiczales, et al.
- 1997
|
|
36
|
An experiment to assess the cost-benefits of code inspections in large scale software development
– Porter, Toman, et al.
- 1995
|
|
36
|
Evaluating Usability of HumanComputer Interfaces: A Practical Method, Ellis Horwood
– Ravden, Johnson
- 1989
|
|
35
|
Methodology Matters: Doing Research in the Behavioral and Social Sciences
– McGrath
- 1995
|
|
30
|
Emerald: A General-Purpose Programming Language
– Raj, Tempero, et al.
- 1991
|
|
29
|
Breakdown and processes during early activities of software design by professionals
– Guindon, Krasner, et al.
- 1987
|
|
26
|
Experimental design and analysis in software engineering. Annals of Software Engineering 1
– Pfleeger
- 1995
|
|
25
|
The Reuses of Uses in Smalltalk Programming
– Rosson, Carroll
- 1996
|
|
24
|
On designing an Experiment to Evaluate a Reverse Engineering Tool
– Storey, Wong, et al.
- 1996
|
|
22
|
process improvement
– Perry, Staudenmayer, et al.
- 1994
|
|
17
|
The Role of Experimentation
– Basili
- 1996
|
|
16
|
Experimental evaluation of software documentation formats
– Curtis, Sheppard, et al.
- 1989
|
|
13
|
process improvement
– People
- 1994
|
|
9
|
How software tools organize programmer behavior during the task of data encapsulation
– Bowdidge, Griswold
- 1997
|
|
9
|
Getting the Most from Paired-User Testing
– Wildman
- 1995
|
|
6
|
Bridging the theory-practice gap in corporate finance: a survey of chief financial officers
– Trahan, Gitman
- 1995
|
|
6
|
Experimental Models for Validating
– Zelkowitz, Wallace
- 1998
|
|
6
|
Systematic observational methods
– Weick
- 1968
|
|
4
|
Design and analysis in software engineering, part 1: The language of case studies and formal experiments
– Pfleeger
- 1994
|
|
4
|
An Initial Assessment of Aspect-Oriented
– Walker, Baniassad, et al.
- 1999
|
|
4
|
Deborah Boehm-Davis. Experimental evaluation of software documentation formats
– Curtis, Sheppard, et al.
- 1989
|
|
4
|
ªExperimental Models for Validating Technology,º
– Zelkowitz, Wallace
- 1998
|
|
3
|
The role of experimentation: Past, current, and future
– Basili
- 1996
|
|
3
|
Assessing aspect-oriented programming and design: Preliminary results
– Walker, Baniassad, et al.
- 1998
|
|
3
|
Methodology Matters: Doing Research
– McGrath
- 1994
|
|
3
|
Designing the User Interface: Strategies for E ective HumanComputer Interaction, chapter 10: Iterative Design, Testing, and Evaluation
– Schneiderman
- 1987
|
|
3
|
On designing an experiment toevaluate a reverse engineering tool
– Storey, Wong, et al.
- 1996
|
|
3
|
Identi cation of dynamic comprehension processes during large scale maintenance
– Mayrhauser, Mans
- 1996
|
|
3
|
ªExperimentation in Software Engineering,º
– Basili, Selby, et al.
- 1986
|
|
3
|
Breakdown and Processes during Early
– Guindon, Krasner, et al.
- 1987
|
|
2
|
Aspect-oriented programming OS sparse matrix code
– Irwin, Loingtier, et al.
- 1997
|
|
2
|
An experiment to assess the costbene ts of code inspections in large scale software development
– Porter, Siy, et al.
- 1997
|
|
2
|
ªA Scientific Methodology for MIS Case Studies,º MIS Quarterly
– Lee
- 1989
|
|
2
|
ªExperimental Evaluation of Software Documentation Formats,º
– Curtis, Sheppard, et al.
- 1989
|
|
2
|
ªPeople, Organizations, and Process Improvement,º
– Perry, Staudenmayer, et al.
- 1994
|
|
1
|
A scienti c methodology for MIS case studies
– Allen
- 1989
|