Dear Mailman, I'm a graduate student (computer science) in University of Nebraska-Lincoln. The Questionnaire for open source testing below is for a paper I'm working on. Hope you can spend five minutes to finish it in your busy time. Any of your effort will be greatly appreciated! Luyin

Questionnaire for Open Source Testing

1. What programming language is used in developing your product "Mailman 1.1":?

2. How many developers were involved in your project?

3. When do you begin to do testing? a. Requirement Analysis Phase b. Functional design Phase c. Internal Design Phase d. Implementation Phase e. After Implementation Note: Functional design is to describe the features of a system from technique-oriented perspective compared with the user-oriented perspective of requirement analysis. Internal design is to model the implementation of system, such as class diagrams. Answer:

4. The time you spent in testing compared with the total time of development? a. <20% b. 20%-40% c. 40%-60% d. 60-80% e. >80% Answer:

5. How do you prepare for your testing (using plan or schedule)? a. Written plan which was modified several times
   b. One plan draft without further modification
   c. I prepare it in my brain
   d. I have no plan Answer:

6. Do you inspect the following items? a. Requirement Documentation (if you have)
   b. Design Documentation (if you have)
   c. Source code (besides relying on compiler and program execution to find faults in code) Answer:

7. There are some defects resulted from the unclear definition of requirements. In the total defects of this category you found, approximately what percentage were found in code inspections, in unit tests and in system tests, respectively? a. <20% b. 20%-40% c. 40%-60% d. 60-80% e. >80% f. Not applicable Answer: , ,

8. The percent of time you spent in document inspection (compared with total development time) is: a. <20% b. 20%-40% c. 40%-60% d. 60-80% e. >80% f. Not applicable Answer:

9. How many people did you ask to check your documents or source code? Do you think it is useful? a. No
   b. A little bit
   c. Useful but not necessary
   d. They found lots of defects that I haven抰 found
   e. Absolutely necessary Answer:

10. Do you use testing tools during your development? The name of it? Answer:

11. What is the basis of your testing? a. Test whether system implemented what user need
    b. Test whether system implemented technical features
    c. Find faults
    d. All the above. Answer:

12. What strategy did you adopt in choosing your test cases? Please list them according to the importance of finding defects of your system (descending)? a. Choose sample of valid inputs
    b. Choose those inputs most likely to cause failure
    c. Choose inputs according to your experience
    d. Other (specify ) Answer:

13. If you do coverage control, what percent of the code (lines of code) do you think are covered in your test? a. <20% b. 20%-40% c. 40%-60% d. 60-80% e. >80% f. Not Applicable Answer:

14. In defects you found, what percent of the following problem categories should be found in requirements phase? in design phase? in unit test ? in integration test? a. <20% b. 20%-40% c. 40%-60% d. 60-80% e. >80% F. Not Applicable Answer:

15. In which areas did you find most of the defects when you integrate and sell products (someone sell open source products such as RedHat)? a. User interface-related problems
    b. Database-related problems
    c. Network-related problems
    d. Logical
    e. Other(specify ) f. Not Applicable Answer:

Luyin Zhao 535 N23 Street, #10 Lincoln, NE 68503 (402)438-9511