175914 Scientific Methodology in Computer Science
Exercises 18.9.2009
1.
Explain in your own words the following concepts:
- sample
- response rate
- open-ended question
- Likert scale
- one-tailed hypothesis
- between subjects design
- main effect
2.
Consider the attached questionnaire:
- Classify each question (open-ended, ...).
- Describe how you would change the questionnaire to make it obey the instructions given in lectures.
- What kind of people would probably respond if the questionnaire was
- sent using regular mail,
- a fillable pdf form sent via e-mail, or
- a web page advertised by e-mail.
3.
Suppose you want to study whether syntax
highlighting in program
editors (i.e., use of different colors for different constructs)
accelerates program writing.
- What are the cause construct and effect construct in this study?
- Give two examples of possible treatments and observations.
- Give an example of a one-tailed hypothesis and of a two-tailed hypothesis for this experiment.
Which one would you use? Justify your decision.
- What kind of design (between subjects, ...) would you use? Justify your decision.
- Write a welcome message that you would give to participants at the beginning of experimental sessions.
4.
Consider Dr. Albert Angst's experiment (described in lectures).
What are the pros and cons of using between subjects factorial
design, within subjects factorial design, and mixed model factorial
design in this experiment?