Experimental Software Engineering - Glossary of Terms

Terms

A

• Action Elements
• Action Research
• Action Researcher
• Activity
• Aggregation
• Alternative Hypothesis (H1)
• Analytical Generalization
• Analytical Method
• Applied Research
• Assertions
• Assessment
• Assumption
• Attribute
• Axiom

B

• Basic Research
• Balancing
• Base-rate Question
• Blocking Variables
• Blocking

C

• Case Study
• Causality Question
• Causality
• Central Limit Theory
• Characterization
• Checklist
• Closed Question
• CMD (Cooperative Method Development)
• Conclusion Validity
• Concurrent Triangulation Strategy
• Confounding Factor
• Construct Validity
• Constructivism
• Context of Study
• Continuous Simulation
• Continuous Variables
• Control Object
• Controlled Experiment
• Convenience Sampling
• Critical Region
• Critical Theory
• Cross-over Design
• Cross-sectional Survey Design

D

• Data
• Data Analysis Process
• Data collection
• Data Collection Form
• Defect Model
• Dependent Variable
• Design of Experiment
• Deterministic Simulation
• Discrete Variable
• Domain Dependability
• Dynamic Analysis
• Dynamic Simulation

E

• Embedded Case Study
• Empirical
• Empirical Method
• Empirical Software Engineering
• Empirical Study
• Empirical Validity
• Engineering Method
• Engineering
• Entity
• Epistemology
• Error
• Error Types
• Ethnography
• Event
• Event-driven Simulation
• Evidence
• Evidence Based Software Engineering
• Executable Model
• Execution Control
• Experiment Design
• Experiment
• Experimental
• Experimental Environment
• Experimental Error
• Experimental Error
• Experimental Object or Unit
• Experimental Package
• Experimental Process
• Experimental Software Engineering
• Experimental Study
• Exploratory Question
• Exploratory Study
• External Attribute
• External Quality
• External Replication
• External Validity

F

• Fact
• Factorial Design
• Factors
• Failure
• Feasibility Study
• Feature Analysis
• Field Study
• Focus Group
• Form Data Collection
• Formal Experiment
• Formal Hypotheses
• Framework of Ideas

G

• Generalization
• GQM (Goal-Question-Metric)
• Grounded Theory

H

• Hawthorne Effect
• Historical Data Analysis
• Holistic Case Study
• Hybrid Simulation
• Hypothesis
• Hypothesis Testing

I

• In the Field
• In the Field Study
• In-silico Study
• In-virtuo Study
• In-vitro Study
• In-vivo Study
• Independent Variable
• Indicator
• Inductive/Deductive
• Industrial Study
• Inference
• Input Data Analysis
• Instrument
• Instrumentation
• Internal Attribute
• Internal Quality
• Internal Replication
• Internal Validity
• Interpretation
• Interrupted Time-series Designs
• Interview
• Interviewer Specification

J

• Justified True Belief

K

• Knowledge

L

• Laboratory Package
• Laboratory Study
• Law
• Legacy Data
• Lessons Learned
• Level of Factor
• Level of Significance
• Life Cycle Models
• Literal Replication
• Literature Search
• Local Contingency
• Longitudinal Survey Design

M

• Material
• Meaningful Measure
• Measure
• Measurement Control
• Measurement
• Meta Analysis
• Method
• Methodology
• Metric
• Model Calibration
• Model Concept
• Model
• Multiple-case Design

N

• Negative Result
• Noise
• Nonequivalent Group Design
• Null Hypothesis (H0)

O

• Object of Study
• Objective Data
• Objective Measure
• Observation
• Observational Study
• Observer
• Ontology
• Open Question
• Outlier
• Output Data Analysis

P

• Package
• Packing
• Paradigm
• Parameters
• Participant
• Perspective
• Philosophical Stance
• Pilot Study
• Population
• Positivism
• Power of Test
• Pragmatism
• Precision
• Predictor Variables
• Pre-Experimental
• Pre-Test
• Primary Study
• Problem Statement
• Process
• Project Monitoring
• Proof of Concept
• Proposition
• Protocol
• Purpose

Q

• QIP (Quality Improvement Paradigm)
• Qualitative Analysis
• Qualitative Data
• Qualitative Research
• Qualitative Simulation
• Qualitative Study
• Quality Focus
• Quality
• Quantitative Analysis
• Quantitative Data
• Quantitative Research
• Quantitative Simulation
• Quantitative Study
• Quasi-Experiment
• Quasi-systematic Review
• Questionnaire Specification
• Questionnaire
• Quota Sampling

R

• Random Assignment
• Randomization
• Randomized Experiment
• Raw Data
• Reference Behavior
• Regression
• Relationship Question
• Replicated Experiment
• Replication
• Report
• Reporting Guidelines
• Research Design
• Research Hypothesis
• Research Question
• Research Strategy
• Resource
• Respondent
• Response Rate
• Response Variable
• Result
• Review
• Review Protocol
• RSD (Reflective Systems Development)

S

• Sample
• Sampling Bias
• Scientific Method
• Scientific Theory
• Scientific Workflow Concepts
• Scope of Survey
• Secondary Study
• Self-administered Questionnaire
• Semi-quantitative
• Sequential Explanatory Strategy
• Simple Random Sampling
• Simulation Results
• Simulation Technique
• Simulation
• Single-case Study
• Statistical Concepts
• Stochastic Simulation
• Stratified Random sampling
• Structured Interviews
• Study Planning
• Subject
• Subjective Data
• Subjective Measure
• Subjects
• Survey Design
• Survey Evaluation
• Survey Instrument
• Survey Objective
• Survey Reliability
• Survey Validity
• Survey
• Systematic Sampling
• Systematic Reviews Studies

T

• Target Population
• Test
• Theoretical Analysis
• Theoretical Replication
• Theory Building
• Theory
• Toy Study
• Treatment
• Trial
• Triangulation

U

• Undesired Variations
• Unit of Analysis
• Unit

V

• Viable Research Strategy

References

Books

• Wohlin, C.; Runeson, P.; Höst, M. et al. (2000) Experimentation in Software

Engineering: An Introduction. Kluwer Academic Publishers

• Juristo, N. and Moreno, A. (2000). Basics of Software Engineering Experimentation,

Kluwer Academic Publishers.

• van Solingen & Berghout (1999). The Goal/Question/Metric Method, McGraw Hil

• Berk, K. N. and Carey, P. (2004). Data Analysis with Microsoft Excel Updated for

Office XP. Thomson Brooks/Cole.

• Fenton, N.E. and Pfleeger S.L. (1997). Software Metrics: A Rigorous and Practical

Approach, (2nd edition), International Thomson Press.

• Oman , P. and Pfleeger S.L. (1997). Applying Software Metrics, IEEE Computer Society

Press.

Technical Reports

• ISERN Basic Terminology (1998). http://wwwagse.informatik.uni-

kl.de/research/isern/experiment/isern.definitions%20010829.html

• Travassos, G.H. , Gurov, D. and Amaral, G. (2002) Introdução a Engenharia de Software

Experimental, Relatório Técnico PESC 590/02 - COPPE/UFRJ

http:/cronos.cos.ufrj.br/publicacoes/reltec/es59002.pdf

• KITCHENHAM, B. (2004b) Procedures for performing Systematic Reviews , Joint

Technical Report Software Engineering Group, Department of Computer Science Keele

University, United King and Empirical Software Engineering, National ICT Australia

Ltd, Australia.

• Biolchini, J.; Mian, P.G.; Natali, A.C. and Travassos, G.H. (2005) Systematic Review

in Software Engineering, Technical Report ES-679/05, COPPE/UFR

htp:/cronos.cos.ufrj.br/publicacoes/reltec/es67905.pdf

Thesis and Dissertations

• Amaral, E.A. G. (2003) Empacotamento de Experimentos em Engenharia de Software.

Dissertação (Mestrado em Engenharia de Sistemas e Computação) - Universidade Federal

do Rio de Janeiro

• Mendonça, C. (2005) Ambientes para Planejamento e Execução de Surveys na Web.

Dissertação (Mestrado em Engenharia de Sistemas e Computação) - Universidade Federal

do Rio de Janeiro

• Mafra, S.N. (2006) Definição de uma Técnica de Leitura Baseada em Perspectiva (OO-

PBR) Apoiada por Estudos Experimentais. Dissertação (Mestrado em Engenharia de

Sistemas e Computação) - Universidade Federal do Rio de Janeiro

• Silva Filho, R. C. (2006) Em Busca de uma Abordagem baseada em Experimentação para

Avaliação da Efetividade de Propostas de Melhoria de Processos de Software.

Dissertação (Mestrado em Engenharia de Sistemas e Computação) - Universidade Federal do Rio de Janeiro.

• Silva, L.F.S. (2004). Apoio Feramental para Aplicação de Técnicas de Leitura Baseada

em Perspectiva (PBR). Dissertação (Mestrado em Engenharia de Sistemas e Computação) -

Universidade Federal do Rio de Janeiro.

Papers

• Seaman, C. B. "Qualitative Methods in Empirical Studies of Software

Engineering." IEEE Transactions on Software Engineering . 25(4): 557-572. 1999.

• Zelkowitz, M. and Walace, D. Experimental Validation in Software Engineering.

This paper was presented at the Conference of Empirical Assessment & Evaluation in

Software Engineering, Keele University, Stafordshire, U.K., 24-26 March 1997.

htp:/hissa.nist.gov/exper/ease.html

• Jedlitschka, A.; Pfahl, D.; Reporting Guidelines for Controled Experiments in

Software Engineering; ; In Proc. of ACM/IEEE Intern. Symposium on Software Engineering

2005 (ISESE2005), Noosa Heads, Australia, Nov 2005, IEEE CS, 2005, pp. 95-104.

• Biolchini, J. ; Mian, P. ; Natali, A. C. C. ; Conte, T. U. ; Travassos, G. H. .

Scientific research ontology to support systematic review in Software Engineering.

Advanced Engineering Informatics Aei Journal, Elsevier, 2006.

• Pfleeger, S. L. (1999), Albert Einstein and Empirical Software Engineering, IEEE

Computer, 0018-9162/99.

• Kitchenham, B.A.; Pfleeger, S.L.; Pickard, L.M.; Jones, P.W.; Hoaglin, D.C.; El Emam,

K.; Rosenberg, J. (2002).

• Preliminary guidelines for empirical research in software engineering; Software

Engineering, IEEE Transactions on , Volume: 28 Issue: 8 , August Page(s): 721 734.

• Tichy, W. F. (1998). Should Computer Scientists Experiment More?, IEEE Computer,

0018-9162/98.

• Zelkowitz, M. V., Walace, D. R., Binkley, D. W. (2003), Experimental Validation of

New Software Technology, Lectures Notes on Empirical Software Engineering.

• Houdek, F. (2003). External Experiments A Workable Paradigm for Colaboration Between

Industry and Academia, Lecture Notes on Empirical Software Engineering, pg 133-166.

• Shul,F., Carver, J., Travassos, G.H., Maldonado, J.C., Conradi, R., Basili, V.R.

(2003). Replicated Studies: Building a Body of Knowledge about Software Reading

Techniques, Lecture Notes on Empirical Software Engineering, pg 39-84.

• Basili,V., Shul, F., Lanubile, F.(1999). Building Knowledge through Families of

Experiments, IEEE Transactions on Software Engineering, Vol 25, no. 4, July/August.

• Shul, F., Carver, J., Travassos, G.H. (2001), An Empirical Methodology for

Introducing Software Processes, 8th European Software Engineering Conference (ESEC)

and 9th ACM SIGSOFT Symposium on the Foundations of Software Engineering (FSE-9),

Vienna. ACM Press, 2001. p.288 296

• Seaman, C.B. (1999) Qualitative Methods in Empirical Studies of Software Engineering,

IEEE Transactions on Software Engineering, Vol 25, no. 4, July/August.

• Tori, K., Matsumoto, K., Nakakoji, K., Takada, S., Shima, K.(1999). Ginger2: An

Environment for Computer-Aided Empirical Software Engineering, IEEE Transactions on

Software Engineering, Vol 25, no. 4, Julho/Agosto.

• Shul, F.;Mendonça, M.; Basili, V.; Carver, J.; Maldonado, J.; Fabbri, S.; Travassos,

G.H.; Fereira, M.C.(2004). Knowledge-Sharing Issues in Experimental Software

Engineering. Empirical Software Engineering, 9, 111-137. Kluwer Academic Publishers.

• Pfleeger S.L., Fenton N.E. and Page S. (1994). Evaluating software engineering

standards, IEEE Computer, pp. 71-79, September.

• Pfleeger S.L. and Haton L. (1997) Investigating the influence of formal methods, IEEE

Computer, February.

• Pfleeger S.L., Fitzgerald J.C. Jr. and Rippy D.A. (1992). Using multiple metrics for

analysis of improvement, Software Quality Journal, 1(1), pp. 27-36.

• Kitchenham B.A., Pickard L. and Pfleeger S.L. (1995). Case studies for method and

tool evaluation, IEEE Software, 12(4), pp. 52-62, July.

• Pfleeger, S.L. (1995). Experimental design and analysis, Annals of Software

Engineering, November.

• Travassos, G.H. and Baros, M.O. (2003). Contributions of In Virtuo and In Silico

Experiments for the Future of Empirical Studies in Software Engineering, Workshop

Series on Empirical Software Engineering, WSESE, ESERNET, ISBN 3-8167-6418-5

• TRAVASSOS, G.H.; SHULL, F.; FREDERICKS, M.; BASILI, V. R. (1999) Detecting Defects in

Object Oriented Designs: Using Reading Techniques to increase Software Quality. ACM

SIGPLAN Notices, USA, v. 34, n. 10, p. 47-56.

• TRAVASSOS, G.H. ; SHULL, F.; CARVER, J. (2001). Working with UML: A software design

process based on inspections for the unified modeling language. Advances in Computers,

San Diego, v. 54, n. 1, p. 35-97.

• MARUCCI, R.A.; FABBRI, S.; MALDONADO, J.C.; TRAVASSOS, G.H. (2002). OORTs/ProDeS:

Definição de Técnicas de Leitura para um Processo de Sofwtare Orientado a Objetos. In:

SIMPOSIO BRASILEIRO DE QUALIDADE DE SOFTWARE, Gramado. SBC v. 1.

• CONRADI, R., MOHAGNEGHI, M.; ARIF, T.;HEDGE L.C.;BUNDE, G.A.;PENDERSEN, A. (2003).

Object-Oriented Reading Techniques for Inspection of UML Models An Industrial

Experiment. In: Proceedings of ECOOP´03, Darmstadt, Germany, July, No 2473, pp. 483-

501

• V.R. Basili, `The experimental paradigm in software engineering`, Experimental

Software Engineering Issues: A critical Assesment and future directions, pp3-12,

Lecture Notes in Computer Science Nr. 706, Springer-Verlag, 1993

• V. R. Basili, G. Caldiera and H. D. Rombach, `Measurement`,in Encyclopedia of

Software Engineering (John J. Marciniak, Ed.), Vol. 1, pp.646-661.John Wiley & Sons,

2001.

• Basili, V.R.; Caldiera, G.; Rombach, H.D.: Experience Factory; in: Marciniak JJ

(ed.), Encyclopedia of Software Engineering, Vol. 1, pp. 511-519, John Wiley & Sons,

2001.

• Basili, V.R., Caldiera, G., and Rombach, H.D.: Goal Question Metric Paradigm; in:

Marciniak JJ (ed.), Encyclopedia of Software Engineering, Vol. 1, pp. 528 532, John

Wiley & Sons, 2001.

• Mackenzie, Noella and Knipe, Sally. Research dilemmas: Paradigms, methods and methodology.

Issues In Educational Research, Vol 16, 2006.

Japanese Translation Aids

• http://www.excite.co.jp/world/english/web/ provides translation of web pages between

English and Japanese

• http://www.excite.co.jp/world/english/?before=&wb_lp=ENJA translates copy-and-paste

text between English and Japanese

• http://www.csse.monash.edu.au/~jwb/cgi-bin/wwwjdic.cgi?9T translates Japanese into

English (using a dictionary)

• http://pcserver.sel.cs.hiroshima-cu.ac.jp/pmdic/pmdic/index.html provides a

dictionary of project management terms in English and Japanese

Citation Formats

Citation styles

IEEE

[x] ISERN "Experimental Software Engineering - Glossary of Terms," [Online document]

Oct. 2007 [cited date] Available at http://lens-ese.cos.ufrj.br/wikiese/index.php/Main_Page

APA

ISERN (2007). Experimental Software Engineering - Glossary of Terms. Retrieved date

from http://lens-ese.cos.ufrj.br/wikiese/index.php/Main_Page