Instructions for Room 100 (for each new group of subjects)



Instructions for Room 100

1. At the beginning / end of the day

At the beginning of the day:

1. Get the key for room 100 and the money for the subjects from Alfred Kobsa, Room 430C in the CS building. From Tue 3/5 11am to Wed 3/6, get these items instead from Ulrik Christensen in the ICS II building, room 264 (across the instructional room of the experiment).

2. Switch on the lights, leave the door open for a while.

3. Switch on the computers if they are not already running. Log in as “105” with password “105”.

4. Have the Training Tasks, Experimental Tasks, Experimental Timesheets, Questionnaires and the Receipt of Payment Forms ready.

At the end of the day

1. Use CD-ROM burners on HCI-CSCW-LAB1 and HCI-CSCW-LAB4 (i.e., “Station 1” and “Station 4”). Files on the two other computers can be accessed through the network (browse local network or by “start->run->\\HCI-CSCW-LAB#”).

2. Use Adaptec Direct CD for making the CDs. A shortcut is available on the desktop. Blank CDs can be found in the shelves in room 100. Put the files of the different groups of the day on different CDs. Follow the recording and verification instructions on the last page.

3. Mark the CD-ROM with the name of the respective group and the date.

4. Make sure that the files have been transferred properly to the CD-ROM, for instance by viewing them with windows media player. Use the version on the desktop - not any of the newer versions that are found on the computer.

5. Clean the room.

6. Bring the key back and the left-over money back to Alfred Kobsa, ICS1, Room 430C.

2. For each new group of subjects

Get started

1. Set the screen resolution to 600 * 800, with 256 colors by using display -> settings, if it is not already set so. THIS IS IMPORTANT.

2. Launch the visualization software of your group. Load the two files DATINGPLUS and population-survey (they are in c:/ics105/105datasets/). Have the file DATINGPLUS in the foreground.

3. Have pens for the subjects and yourself ready.

Switch off your cell phones.

When the subjects arrive

4. Welcome the subjects and tell them that they are now going to receive training tasks and thereafter the tasks of the real experiment.

5. Show them the computers and the video cameras and let them chose the place where they want to sit. If you have three subjects or less, kind of avoid station 3 (the one on the right side in front) since this machine may occasionally get slow.

6. Note down the subjects’ IDs in the Experimental Timesheet as well as the date, time and software. (In this timesheet you should also record unusual occurrences during the one-hour experiment, like when subjects ask for explanations, when subjects seemingly have problems with a question, when there is a technical problem, etc.)

7. Launch Camtasia through the desktop shortcut and start recording. You will be prompted for a file name after the recording. See the attached Recording Procedures for details. [That’s right, you should also record the training session]

8. Launch Encoder through the desktop shortcut and start recording. Save the file as c:/ics105/105students/”group number”/”cam” (subject id number followed by cam for camera; no period in between). It is essential to start the programs in this order since the Camtasia video will show when the video from the camera starts, and this is our key to synchronization. See the attached Recording Procedures for details.

9. Adjust the camera so that it is focussed and records the face, chest and arms of subjects.

Training session

10. Give subjects the training tasks and fill in the Subject ID.

Ask them to read the instructions. Tell them that they have half an hour to work on these tasks.

Tell them they should explore the system and should ask questions while working at the tasks, and that they can take a break afterwards. If subjects ask questions, give them extensive help and also use this opportunity to show them additional features of the system.

After about 20 minutes into the training, check their answers to Question 6 (correct: no), 7 (correct: no), and 9 (correct: neither). If you see a wrong answer, ask the subject to demonstrate to you how they performed the task, and show them the correct way to solve the problem.

If subjects finish earlier, ask them to demonstrate how they arrived at their solutions, show them better ways, new software features, etc. Stop the training after 1/2 hour.

If you have the impression that a subject has not understood the system, you may eliminate them from the experiment. They are entitled to $10. If in doubt, keep them in the experiment but note down your concerns in the Experimental Timesheet.

Collect the Training Questions.

11. Give subjects a break of five minutes, even if they don't want to. Leave the recorders running - the saved disc space will not make up for the potential problems.

Experiment

Make sure the dating window is closed (not only hidden) and the population statistics window is up.

12. Give subjects the experimental tasks and fill in the Subject ID. Give them a few additional sheets of paper for describing their findings.

Tell them that they have 60 minutes for the task. Ask them to read the instructions on the first page of the Experimental Tasks sheet.

Don't try to explain the tasks to subjects and don't explain what findings are. If asked, read the definition in the subjects' instructions: "Your task is to find interesting facts in this database. An interesting fact is one that makes you wonder why what you found is the case."

13. Set the clock to 15 minutes and start it. (If you see 15:00 on the display, just press Start/Stop; otherwise press MIN 15 times, and then press Start/Stop). When 15 minutes are over, set the clock again to 15 minutes and thereafter make a stroke on the subjects' answer sheet to mark how far they have proceeded.

14. If subjects ask questions during the experiments, show them program features that may be helpful for them (but keep your explanations brief). If they have serious troubles with a discovery, note this fact down in the Experimental Timesheet.

Walk around like every 10 minutes (among other reasons, to prevent that subjects go to the web instead of making findings).

15. If subjects want to finish earlier than 60 minutes, note this down in the experimental timesheet but let them wait until the experiment is over. Encourage them to still make findings while they wait.

16. When one hour is up, tell subjects to finish and take away their Experimental Tasks.

17. For each station,

• Go to Encoder and press stop to stop recording the video.

• Go to Camtasia and press stop to stop recording the screen. Save file as c:/ics105/105students/”group number”/”scr” (subject id number followed by scr for screen capture).

Questionnaire

18. Enter the Subject IDs in the questionnaires and ask the subjects to fill them out. Tell them that they should take their time.

Payment

19. When subjects are finished, thank them for their participation.

20. Check their Video Release Forms. If subjects did not sign it or not initial all options ask them whether they would want to give more permissions than they did so far, now that they became familiar with the experiment.

21. Let them fill in the Receipt of Payment Form. (If they are concerned about the fact that this form shows both their Subject ID and their student ID tell them that this is for auditing purposes only. This form will be stored in a safe place, away from all other documentation about the experiment).

Fill in the Certificate of Payment to Anonymous Subjects form (just Date Paid, Amount Paid and Paid By). Forget the rest.

22. Give them $25 in cash. Tell them that they will be notified if they win the prize.

23. Note down approximate begin/end times and unusual events in the Experimental Timesheet.

Clean-up

24. Sort all documents per subject, and put them into your group's space on the shelf.

Tidy up the room a bit, in anticipation of the next group.

If you had to use Station 3, shut it down completely and then start it again.

You may burn your group's files following the instructions in the appendix, but only if this does not interfere with the next group. Burning CDs for all groups of the day is primarily the responsibility of the last group of the day.

Recording procedures

Be sure that the screen is set to 800*600, 256 colors ... really, this is extremely important !

1. start recording with Camtasia:

start by clicking icon on desktop

make sure that the setup is as follows:

capture -> input = screen

capture -> output = file

options -> preferences -> avi : uncheck auto configure

options -> preferences -> avi : choose 3 frames/sec

options -> preferences -> avi -> audio setup = attributes 7kb/sec

options -> preferences -> file = ask for file name

options -> preferences -> program : uncheck play movie after saving

click red circle button to record

minimize Camtasia

2. start recording with Encoder:

start by clicking icon on desktop

open existing encoding session : c:\ics105\software\encodersetup.wme (or equivalent)

session -> properties -> output : change output file name to the desired name in c:\ics105\students\groupname (or equivalent)

click start button in lower right corner to record

minimize Encoder

3. run experiment

4. stop recording with Encoder:

restore Encoder

click stop button in lower right corner to stop recording

5. stop recording with Camtasia:

restore Camtasia from system tray (lower right corner, next to watch)

click black square button to stop

save in c:\ics105\105students\groupname (or equivalent)

Burning and verifying CDs

Use CD-ROM burners on HCI-CSCW-LAB1 and HCI-CSCW-LAB4 (i.e., “Station 1” and “Station 4”). Files on the two other computers can be accessed through the network (browse local network or by “start->run->\\HCI-CSCW-LAB#”).

1. transfer the video recordings to CDs with Adaptec Direct CD wizard:

cd burners are found on HCI-CSCW-LAB1 and HCI-CSCW-LAB4 (i.e. “Station 1” and “Station 4”).

put a new cd in drive - yellowish copper side up

wait for popup menu and choose first option in the list (or start Adaptec Direct CD from system tray in the lower right corner)

next, next, next

name the cd indicating group number and date

finish

wait till popup box disappears - 30 seconds or so

drag the files you need to store to the cd (the D drive)

press the eject button on the cd recorder once (or start adapted direct cd from system tray again and press next, next)

check the "Organize the disc so that it can ..."-option

make it write protected by checking the checkbox under this option

press finish

wait for cd to be done - 2 to 3 minutes

check that the files are there and in the desired condition

2. check files with Media player:

start by clicking icon on desktop

file -> open -> browse : get the file you want

alternatively just double click the video file you wish to open

When analyzing the video data you should set the screen to 1024*768. This is not necessary when just are checking out if the files are ok, so don't change the screen settings if you do not analyze the videos. In that way the chances that the screen is not set right during recording will be a lot smaller.

DON'T DELETE ANYTHING. ULRIK WILL DOUBLECHECK AND DELETE.

................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download