Experimental Software Engineering - Glossary of Terms
Contents
Terms
A
- Action Elements
- Action Research
- Action Researcher
- Activity
- Aggregation
- Alternative Hypothesis (H1)
- Analytical Generalization
- Analytical Method
- Applied Research
- Assertions
- Assessment
- Assumption
- Attribute
- Axiom
B
C
- Case Study
- Causality Question
- Causality
- Central Limit Theory
- Characterization
- Checklist
- Closed Question
- CMD (Cooperative Method Development)
- Conclusion Validity
- Concurrent Triangulation Strategy
- Confounding Factor
- Construct Validity
- Constructivism
- Context of Study
- Continuous Simulation
- Continuous Variables
- Control Object
- Controlled Experiment
- Convenience Sampling
- Critical Region
- Critical Theory
- Cross-over Design
- Cross-sectional Survey Design
D
- Data
- Data Analysis Process
- Data Collection
- Data Collection Form
- Defect Model
- Dependent Variable
- Design of Experiment
- Deterministic Simulation
- Discrete Variable
- Domain Dependability
- Dynamic Analysis
- Dynamic Simulation
E
- Embedded Case Study
- Empirical
- Empirical Method
- Empirical Software Engineering
- Empirical Study
- Empirical Validity
- Engineering Method
- Engineering
- Entity
- Epistemology
- Error
- Error Types
- Ethnography
- Event
- Event-driven Simulation
- Evidence
- Evidence Based Software Engineering
- Executable Model
- Execution Control
- Experiment Design
- Experiment
- Experimental
- Experimental Environment
- Experimental Error
- Experimental Object or Unit
- Experimental Package
- Experimental Process
- Experimental Software Engineering
- Experimental Study
- Exploratory Question
- Exploratory Study
- External Attribute
- External Quality
- External Replication
- External Validity
F
- Fact
- Factorial Design
- Factors
- Failure
- Feasibility Study
- Feature Analysis
- Field Study
- Focus Group
- Form Data Collection
- Formal Experiment
- Formal Hypotheses
- Framework of Ideas
G
H
- Hawthorne Effect
- Historical Data Analysis
- Holistic Case Study
- Hybrid Simulation
- Hypothesis
- Hypothesis Testing
I
- In the Field
- In the Field Study
- In-silico Study
- In-virtuo Study
- In-vitro Study
- In-vivo Study
- Independent Variable
- Indicator
- Inductive/Deductive
- Industrial Study
- Inference
- Input Data Analysis
- Instrument
- Instrumentation
- Internal Attribute
- Internal Quality
- Internal Replication
- Internal Validity
- Interpretation
- Interrupted Time-series Designs
- Interview
- Interviewer Specification
J
K
L
- Laboratory Package
- Laboratory Study
- Law
- Legacy Data
- Lessons Learned
- Level of Factor
- Level of Significance
- Life Cycle Models
- Literal Replication
- Literature Search
- Local Contingency
- Longitudinal Survey Design
M
- Material
- Meaningful Measure
- Measure
- Measurement Control
- Measurement
- Meta Analysis
- Method
- Methodology
- Metric
- Model Calibration
- Model Concept
- Model
- Multiple-case Design
N
O
- Object of Study
- Objective Data
- Objective Measure
- Observation
- Observational Study
- Observer
- Ontology
- Open Question
- Outlier
- Output Data Analysis
P
- Package
- Packing
- Paradigm
- Parameters
- Participant
- Perspective
- Philosophical Stance
- Pilot Study
- Population
- Positivism
- Power of Test
- Pragmatism
- Precision
- Predictor Variables
- Pre-Experimental
- Pre-Test
- Primary Study
- Problem Statement
- Process
- Project Monitoring
- Proof of Concept
- Proposition
- Protocol
- Purpose
Q
- QIP (Quality Improvement Paradigm)
- Qualitative Analysis
- Qualitative Data
- Qualitative Research
- Qualitative Simulation
- Qualitative Study
- Quality Focus
- Quality
- Quantitative Analysis
- Quantitative Data
- Quantitative Research
- Quantitative Simulation
- Quantitative Study
- Quasi-experiment
- Quasi-systematic Review
- Questionnaire Specification
- Questionnaire
- Quota Sampling
R
- Random Assignment
- Randomization
- Randomized Experiment
- Raw Data
- Reference Behavior
- Regression
- Relationship Question
- Replicated Experiment
- Replication
- Report
- Reporting Guidelines
- Research Design
- Research Hypothesis
- Research Question
- Research Strategy
- Resource
- Respondent
- Response Rate
- Response Variable
- Result
- Review
- Review Protocol
- RSD (Reflective Systems Development)
S
- Sample
- Sampling Bias
- Scientific Method
- Scientific Theory
- Scientific Workflow Concepts
- Scope of Survey
- Secondary Study
- Self-administered Questionnaire
- Semi-quantitative
- Sequential Explanatory Strategy
- Simple Random Sampling
- Simulation Results
- Simulation Technique
- Simulation
- Single-case Study
- Statistical Concepts
- Stochastic Simulation
- Stratified Random Sampling
- Structured Interviews
- Study Planning
- Subject
- Subjective Data
- Subjective Measure
- Survey Design
- Survey Evaluation
- Survey Instrument
- Survey Objective
- Survey Reliability
- Survey Validity
- Survey
- Systematic Sampling
- Systematic Reviews Studies
T
- Target Population
- Test
- Theoretical Analysis
- Theoretical Replication
- Theory Building
- Theory
- Toy Study
- Treatment
- Trial
- Triangulation
U
V
W
X
Y
Z
References
Books
- Wohlin, C.; Runeson, P.; Höst, M. et al. (2000) Experimentation in Software
Engineering: An Introduction. Kluwer Academic Publishers
- Juristo, N. and Moreno, A. (2000). Basics of Software Engineering Experimentation,
Kluwer Academic Publishers.
- van Solingen & Berghout (1999). The Goal/Question/Metric Method, McGraw Hil
- Berk, K. N. and Carey, P. (2004). Data Analysis with Microsoft Excel Updated for
Office XP. Thomson Brooks/Cole.
- Fenton, N.E. and Pfleeger S.L. (1997). Software Metrics: A Rigorous and Practical
Approach, (2nd edition), International Thomson Press.
- Oman , P. and Pfleeger S.L. (1997). Applying Software Metrics, IEEE Computer Society
Press.
Technical Reports
- ISERN Basic Terminology (1998). http://wwwagse.informatik.uni-
kl.de/research/isern/experiment/isern.definitions%20010829.html
- Travassos, G.H. , Gurov, D. and Amaral, G. (2002) Introdução a Engenharia de Software
Experimental, Relatório Técnico PESC 590/02 - COPPE/UFRJ
http:/cronos.cos.ufrj.br/publicacoes/reltec/es59002.pdf
- KITCHENHAM, B. (2004b) Procedures for performing Systematic Reviews , Joint
Technical Report Software Engineering Group, Department of Computer Science Keele
University, United King and Empirical Software Engineering, National ICT Australia
Ltd, Australia.
- Biolchini, J.; Mian, P.G.; Natali, A.C. and Travassos, G.H. (2005) Systematic Review
in Software Engineering, Technical Report ES-679/05, COPPE/UFR
htp:/cronos.cos.ufrj.br/publicacoes/reltec/es67905.pdf
Thesis and Dissertations
- Amaral, E.A. G. (2003) Empacotamento de Experimentos em Engenharia de Software.
Dissertação (Mestrado em Engenharia de Sistemas e Computação) - Universidade Federal
do Rio de Janeiro
- Mendonça, C. (2005) Ambientes para Planejamento e Execução de Surveys na Web.
Dissertação (Mestrado em Engenharia de Sistemas e Computação) - Universidade Federal
do Rio de Janeiro
- Mafra, S.N. (2006) Definição de uma Técnica de Leitura Baseada em Perspectiva (OO-
PBR) Apoiada por Estudos Experimentais. Dissertação (Mestrado em Engenharia de
Sistemas e Computação) - Universidade Federal do Rio de Janeiro
- Silva Filho, R. C. (2006) Em Busca de uma Abordagem baseada em Experimentação para
Avaliação da Efetividade de Propostas de Melhoria de Processos de Software.
Dissertação (Mestrado em Engenharia de Sistemas e Computação) - Universidade Federal do Rio de Janeiro.
- Silva, L.F.S. (2004). Apoio Feramental para Aplicação de Técnicas de Leitura Baseada
em Perspectiva (PBR). Dissertação (Mestrado em Engenharia de Sistemas e Computação) -
Universidade Federal do Rio de Janeiro.
Papers
- Seaman, C. B. "Qualitative Methods in Empirical Studies of Software
Engineering." IEEE Transactions on Software Engineering . 25(4): 557-572. 1999.
- Zelkowitz, M. and Walace, D. Experimental Validation in Software Engineering.
This paper was presented at the Conference of Empirical Assessment & Evaluation in
Software Engineering, Keele University, Stafordshire, U.K., 24-26 March 1997.
htp:/hissa.nist.gov/exper/ease.html
- Jedlitschka, A.; Pfahl, D.; Reporting Guidelines for Controled Experiments in
Software Engineering; ; In Proc. of ACM/IEEE Intern. Symposium on Software Engineering
2005 (ISESE2005), Noosa Heads, Australia, Nov 2005, IEEE CS, 2005, pp. 95-104.
- Biolchini, J. ; Mian, P. ; Natali, A. C. C. ; Conte, T. U. ; Travassos, G. H. .
Scientific research ontology to support systematic review in Software Engineering.
Advanced Engineering Informatics Aei Journal, Elsevier, 2006.
- Pfleeger, S. L. (1999), Albert Einstein and Empirical Software Engineering, IEEE
Computer, 0018-9162/99.
- Kitchenham, B.A.; Pfleeger, S.L.; Pickard, L.M.; Jones, P.W.; Hoaglin, D.C.; El Emam,
K.; Rosenberg, J. (2002).
- Preliminary guidelines for empirical research in software engineering; Software
Engineering, IEEE Transactions on , Volume: 28 Issue: 8 , August Page(s): 721 734.
- Tichy, W. F. (1998). Should Computer Scientists Experiment More?, IEEE Computer,
0018-9162/98.
- Zelkowitz, M. V., Walace, D. R., Binkley, D. W. (2003), Experimental Validation of
New Software Technology, Lectures Notes on Empirical Software Engineering.
- Houdek, F. (2003). External Experiments A Workable Paradigm for Colaboration Between
Industry and Academia, Lecture Notes on Empirical Software Engineering, pg 133-166.
- Shul,F., Carver, J., Travassos, G.H., Maldonado, J.C., Conradi, R., Basili, V.R.
(2003). Replicated Studies: Building a Body of Knowledge about Software Reading
Techniques, Lecture Notes on Empirical Software Engineering, pg 39-84.
- Basili,V., Shul, F., Lanubile, F.(1999). Building Knowledge through Families of
Experiments, IEEE Transactions on Software Engineering, Vol 25, no. 4, July/August.
- Shul, F., Carver, J., Travassos, G.H. (2001), An Empirical Methodology for
Introducing Software Processes, 8th European Software Engineering Conference (ESEC)
and 9th ACM SIGSOFT Symposium on the Foundations of Software Engineering (FSE-9),
Vienna. ACM Press, 2001. p.288 296
- Seaman, C.B. (1999) Qualitative Methods in Empirical Studies of Software Engineering,
IEEE Transactions on Software Engineering, Vol 25, no. 4, July/August.
- Tori, K., Matsumoto, K., Nakakoji, K., Takada, S., Shima, K.(1999). Ginger2: An
Environment for Computer-Aided Empirical Software Engineering, IEEE Transactions on
Software Engineering, Vol 25, no. 4, Julho/Agosto.
- Shul, F.;Mendonça, M.; Basili, V.; Carver, J.; Maldonado, J.; Fabbri, S.; Travassos,
G.H.; Fereira, M.C.(2004). Knowledge-Sharing Issues in Experimental Software
Engineering. Empirical Software Engineering, 9, 111-137. Kluwer Academic Publishers.
- Pfleeger S.L., Fenton N.E. and Page S. (1994). Evaluating software engineering
standards, IEEE Computer, pp. 71-79, September.
- Pfleeger S.L. and Haton L. (1997) Investigating the influence of formal methods, IEEE
Computer, February.
- Pfleeger S.L., Fitzgerald J.C. Jr. and Rippy D.A. (1992). Using multiple metrics for
analysis of improvement, Software Quality Journal, 1(1), pp. 27-36.
- Kitchenham B.A., Pickard L. and Pfleeger S.L. (1995). Case studies for method and
tool evaluation, IEEE Software, 12(4), pp. 52-62, July.
- Pfleeger, S.L. (1995). Experimental design and analysis, Annals of Software
Engineering, November.
- Travassos, G.H. and Baros, M.O. (2003). Contributions of In Virtuo and In Silico
Experiments for the Future of Empirical Studies in Software Engineering, Workshop
Series on Empirical Software Engineering, WSESE, ESERNET, ISBN 3-8167-6418-5
- TRAVASSOS, G.H.; SHULL, F.; FREDERICKS, M.; BASILI, V. R. (1999) Detecting Defects in
Object Oriented Designs: Using Reading Techniques to increase Software Quality. ACM
SIGPLAN Notices, USA, v. 34, n. 10, p. 47-56.
- TRAVASSOS, G.H. ; SHULL, F.; CARVER, J. (2001). Working with UML: A software design
process based on inspections for the unified modeling language. Advances in Computers,
San Diego, v. 54, n. 1, p. 35-97.
- MARUCCI, R.A.; FABBRI, S.; MALDONADO, J.C.; TRAVASSOS, G.H. (2002). OORTs/ProDeS:
Definição de Técnicas de Leitura para um Processo de Sofwtare Orientado a Objetos. In:
SIMPOSIO BRASILEIRO DE QUALIDADE DE SOFTWARE, Gramado. SBC v. 1.
- CONRADI, R., MOHAGNEGHI, M.; ARIF, T.;HEDGE L.C.;BUNDE, G.A.;PENDERSEN, A. (2003).
Object-Oriented Reading Techniques for Inspection of UML Models An Industrial
Experiment. In: Proceedings of ECOOP´03, Darmstadt, Germany, July, No 2473, pp. 483-
501
- V.R. Basili, `The experimental paradigm in software engineering`, Experimental
Software Engineering Issues: A critical Assesment and future directions, pp3-12,
Lecture Notes in Computer Science Nr. 706, Springer-Verlag, 1993
- V. R. Basili, G. Caldiera and H. D. Rombach, `Measurement`,in Encyclopedia of
Software Engineering (John J. Marciniak, Ed.), Vol. 1, pp.646-661.John Wiley & Sons,
2001.
- Basili, V.R.; Caldiera, G.; Rombach, H.D.: Experience Factory; in: Marciniak JJ
(ed.), Encyclopedia of Software Engineering, Vol. 1, pp. 511-519, John Wiley & Sons,
2001.
- Basili, V.R., Caldiera, G., and Rombach, H.D.: Goal Question Metric Paradigm; in:
Marciniak JJ (ed.), Encyclopedia of Software Engineering, Vol. 1, pp. 528 532, John
Wiley & Sons, 2001.
- Mackenzie, Noella and Knipe, Sally. Research dilemmas: Paradigms, methods and methodology.
Issues In Educational Research, Vol 16, 2006.
Japanese Translation Aids
- http://www.excite.co.jp/world/english/web/ provides translation of web pages between
English and Japanese
- http://www.excite.co.jp/world/english/?before=&wb_lp=ENJA translates copy-and-paste
text between English and Japanese
- http://www.csse.monash.edu.au/~jwb/cgi-bin/wwwjdic.cgi?9T translates Japanese into
English (using a dictionary)
dictionary of project management terms in English and Japanese
Citation Formats
Citation styles
IEEE
[x] ISERN "Experimental Software Engineering - Glossary of Terms," [Online document]
Oct. 2007 [cited date] Available at http://lens-ese.cos.ufrj.br/wikiese/index.php/Main_Page
APA
ISERN (2007). Experimental Software Engineering - Glossary of Terms. Retrieved date
from http://lens-ese.cos.ufrj.br/wikiese/index.php/Main_Page