Dear Mailman,
I'm a
graduate student (computer science) in University
of Nebraska-Lincoln. The
Questionnaire for open source testing
below is for a paper I'm working on.
Hope you can spend
five minutes to finish it in your busy time. Any of your
effort will be greatly appreciated!
Luyin
Questionnaire for
Open Source
Testing
****************************************************
1. What
programming language is used in developing your product
"Mailman
1.1":?
****************************************************
2. How
many developers were involved in your
project?
****************************************************
3. When do
you begin to do testing?
a. Requirement Analysis Phase
b. Functional design Phase
c.
Internal Design Phase
d. Implementation Phase
e. After Implementation
Note:
Functional design is to describe the features of a system
from
technique-oriented perspective compared
with the user-oriented
perspective of
requirement analysis. Internal design is to model
the implementation of system, such as class
diagrams.
Answer:
****************************************************
4.
The time you spent in testing compared with the total time of
development?
a. <20% b. 20%-40% c.
40%-60% d. 60-80% e.
>80%
Answer:
****************************************************
5.
How do you prepare for your testing (using plan or schedule)?
a. Written plan which was modified several times
b. One plan draft without further modification
c. I prepare it in my brain
d. I have no
plan
Answer:
****************************************************
6. Do
you inspect the following items?
a. Requirement
Documentation (if you have)
b. Design Documentation
(if you have)
c. Source code (besides relying on
compiler and program execution to
find faults in
code)
Answer:
****************************************************
7.
There are some defects resulted from the unclear definition of
requirements.
In the total defects of this category you found,
approximately what
percentage were found in code inspections,
in unit tests and in system
tests,
respectively?
a. <20% b. 20%-40% c. 40%-60%
d. 60-80% e. >80% f. Not
applicable
Answer:
, ,
****************************************************
8. The percent of
time you spent in document inspection (compared with total
development time) is:
a. <20% b. 20%-40% c.
40%-60% d. 60-80% e. >80% f. Not
applicable
Answer:
****************************************************
9.
How many people did you ask to check your documents or source
code?
Do you think it is useful?
a.
No
b. A little bit
c.
Useful but not necessary
d. They found lots of
defects that I haven’t found
e. Absolutely
necessary
Answer:
****************************************************
10.
Do you use testing tools during your development? The name of
it?
Answer:
****************************************************
11.
What is the basis of your testing?
a. Test whether system
implemented what user need
b. Test whether system
implemented technical features
c. Find faults
d. All the
above.
Answer:
****************************************************
12.
What strategy did you adopt in choosing your test cases? Please list
them
according to the importance of finding defects of
your system (descending)?
a. Choose sample of valid
inputs
b. Choose those inputs most likely to cause
failure
c. Choose inputs according to your
experience
d. Other
(specify
)
Answer:
****************************************************
13. If
you do coverage control, what percent of the code (lines of code) do
you think are covered in your test?
a. <20% b. 20%-40% c. 40%-60% d. 60-80% e.
>80% f. Not
Applicable
Answer:
****************************************************
14.
In defects you found, what percent of the following problem categories
should be found in requirements phase? in design phase? in unit test ?
in
integration test?
a. <20% b. 20%-40% c.
40%-60% d. 60-80% e. >80% F. Not
Applicable
Answer:
****************************************************
15.
In which areas did you find most of the defects when you integrate and
sell products (someone sell open source products such as
RedHat)?
a. User interface-related problems
b. Database-related problems
c. Network-related problems
d. Logical
e. Other(specify )
f.
Not Applicable
Answer:
Luyin Zhao
535 N23 Street, #10
Lincoln, NE
68503
(402)438-9511