Business Game Evaluation Questionnaire

The following questionnaire is concerned with the Business Game in which you have just taken part. It will address your overall impressions of, and attitudes towards, the desktop conferencing technology you used.

Your answers will help determine the suitability of the technology for this type of activity. All answers you give will be confidential and stored anonymously.

This questionnaire focuses on the technological aspects of your experience.
 
 

We would appreciate it if you could provide the following information :

Name:

Age :

Sex:

Education/career background (e.g. business, computer science, psychology):

 

Have you ever participated in a group task like this before:

In a face to face environment?

In a computer mediated environment similar to the one you experienced today? If you answered yes to either to either of these questions, please briefly describe your experience:

 

 


1. Audio Issues

1.1 Listening effort

In general, how easy was it to hear the other participants in the session? (Please circle one number)
 
 
Very easy
 
Neither easy nor difficult 
 
Very difficult
1
2
3
4
5
 
 

1.1.1.1 If you experienced any difficulty, please describe the problem(s) below:

..........................................................................................................................................................................................

..........................................................................................................................................................................................

..........................................................................................................................................................................................

1.1.2 Did you feel that it required more effort on your behalf to understand what the other participants were saying than it might in a face-to-face setting?

1.1.2.1 If you answered Yes, please explain why:

..........................................................................................................................................................................................

..........................................................................................................................................................................................

..........................................................................................................................................................................................

 
 

1.2 Audio quality

1.2.1 How would you rate the overall quality of the audio in the session?
 
 
Very good 
 
Neither good nor poor 
 
Very poor
1
2
3
4
5
 
 

1.2.2 Did you feel that the quality of the audio varied during the session?

1.2.2.1 If you answered Yes, to what extent did you find this disruptive?:

..........................................................................................................................................................................................

..........................................................................................................................................................................................

..........................................................................................................................................................................................

1.2.2.2 If you answered Yes, did you feel that the audio quality differed according to who was speaking?

 1.2.2.2.1 If the quality was particularly poor from any specific person(s), can you state who, and describe the nature of the poor quality?
..........................................................................................................................................................................................

..........................................................................................................................................................................................

..........................................................................................................................................................................................

 1.2.3 If you were dissatisfied with the audio links in any way, what factors contributed most to this?

Please tick the factors that caused you dissatisfaction, and if possible, rank your selected factors in order of importance, where 1 reflects that the factor caused most dissatisfaction.
 
Tick Rank
___ missing words/incomplete sentences ___
___ background hiss, crackle ___
___ 'unnatural'/metallic sounding voice(s) ___
___ feedback/echo ___
___ variation in quality between different speakers  ___
___ variation in quality from one particular speaker  ___
___ variation in volume between different speakers ___
___ variation in volume from one particular speaker  ___
 
 

 1.2.4 How would you rate the overall adequacy of the audio during the session? For example, if you feel that the audio met none of the needs of the session, you should place a horizontal mark at 1 on the scale below. If you felt the audio met all of the needs of the session, you should place a mark at 100. If you felt the adequacy of the audio was somewhere in between, you should mark accordingly.

Audio met all of the needs of the session
  
Audio met none of the needs of the session
 
2. Video Issues

2.1 Video Use

2.1.1 During the session, how often did you look at the video images of the other participants? (Please circle one number)
 
Never 
Infrequently
Some of the time
A lot of the time 
All of the time
1
2
3
4
5
 

2.1.2 Did you feel that the availability of video images of the other participants helped you to follow the discussion?

2.1.2.1 If you answered either Yes or No, please explain your answer:

..........................................................................................................................................................................................

..........................................................................................................................................................................................

..........................................................................................................................................................................................

2.1.3 How often did you look at YOUR OWN video image?

 
Never
Infrequently
Some of the time 
A lot of the time 
All of the time
1
2
3
4
5
 

2.1.3.1 Please comment e.g. was it distracting or useful? Why?:

..........................................................................................................................................................................................

..........................................................................................................................................................................................

..........................................................................................................................................................................................

2.1.4 Did you feel that you were missing certain non-verbal behaviours made by the other participants e.g. gestures or facial expressions which would have been available face to face?

2.1.4.1 If you answered Yes, to what extent do you think the ease of communication between you and the others was affected by this?
..........................................................................................................................................................................................

..........................................................................................................................................................................................

..........................................................................................................................................................................................

 
2.1.5 The statements below are about the benefits (or not) of the video images of the other group members.
Please indicate whether you agree or disagree with the statements:
 
Agree 
Disagree 
 
___
___
The video images were not beneficial as I found them too slow
___
___
The video images were beneficial as they allowed me to see who was talking 
___
___
The video images were not beneficial as I found them distracting 
___
___
The video images were beneficial as I could tell if there were technical problems at the other sites 
___
___
The video images were not beneficial as audio-only was sufficient for communication purposes 
___
___
The video images were not beneficial as they were out of sync with the sound
___
___
The video images were beneficial as they increased my feeling of being part of a group 
___
___
The video images were not beneficial as I found them too small 
___
___
The video images were beneficial as they allowed me to see if the other participants were listening to what I was saying 
 

2.2 Video Quality

2.2.1 Did you feel that the quality of the video images varied during the session?

2.2.1.1 If you answered Yes, to what extent did you find this disruptive?:

..........................................................................................................................................................................................

..........................................................................................................................................................................................

..........................................................................................................................................................................................

2.2.2 Was the quality of the video images that you received from the different participants the same, or did it vary?

2.2.2.1 If you answered Different, please explain how it differed:
..........................................................................................................................................................................................

..........................................................................................................................................................................................

..........................................................................................................................................................................................

2.2.3 How would you rate the overall quality of the video in the session (Please circle)
 
 
Very good 
 
Neither good nor poor 
 
Very poor
1
2
3
4
5
 

2.2.4 How would you rate the overall adequacy of the video throughout the session? For example, if you feel that the video met none of the needs of the session, you should place a horizontal mark at 1 on the scale below. If you felt the video met all of the needs of the session, you should place a mark at 100. If you felt the adequacy of the video was somewhere in between, you should mark accordingly.

Video met all of the needs of the session
 
Video met none of the needs of the session
 
 
3. Shared workspace

3.1 How difficult or easy did you find it to use the shared workspace?

 
Very easy to use
 
Neither easy nor difficult 
 
Very difficult to use
1
2
3
4
5
 
 3.1.1 If you experienced any difficulties, please describe them:
..........................................................................................................................................................................................

..........................................................................................................................................................................................

..........................................................................................................................................................................................

3.1.2 If you have any suggestions about how the shared workspace could have been made easier to use, or any other comments about the shared workspace, please write them below:
..........................................................................................................................................................................................

..........................................................................................................................................................................................

..........................................................................................................................................................................................

 
4. Further issues

4.1 Please indicate how satisfied you were with this way of taking part in the Business Game.
 
Very satisfied 
 
Neither satisfied nor dissatisfied 
 
Very dissatisfied
1
2
3
4
5
 

4.2 How satisfied were you with the outcome of the game?

..........................................................................................................................................................................................

..........................................................................................................................................................................................

..........................................................................................................................................................................................

4.3 What impact do you think the technology had on the overall outcome of the game?

..........................................................................................................................................................................................

..........................................................................................................................................................................................

..........................................................................................................................................................................................

4.4 Did you feel the technology allowed you to get to know the other group members to the same extent as you might have done in a face to face setting?

4.4.1 If you answered No, please explain your answer:

..........................................................................................................................................................................................

..........................................................................................................................................................................................

..........................................................................................................................................................................................

4.5 How would you rate your level of involvement in the game, compared to how you involved you might have been in a face-to-face (FTF) setting:

 
A lot greater than FTF
 
About the same as FTF
 
A lot less than FTF
1
2
3
4
5
 

4.5.1 If you think your level of involvement in this session was different than it would have been in a face-to-face setting, why do you think this was so?
..........................................................................................................................................................................................

..........................................................................................................................................................................................

..........................................................................................................................................................................................

4.6 Would you have preferred to have participated in a face-to-face setting?

4.6.1 Please explain your answer:

..........................................................................................................................................................................................

..........................................................................................................................................................................................

..........................................................................................................................................................................................

4.7 Any additional comments you might have about any technical aspect of the session would be very useful to us:
..........................................................................................................................................................................................

..........................................................................................................................................................................................

..........................................................................................................................................................................................

 
Thank you very much!