Hci598holeman.weebly.com



HOLEMAN - Milestone 5 Summary The primary users of the OurTime Companion will be adult family members geographically separated from the children/grandchildren they wish to interact with as well as the children themselves. The secondary users of the system will be the adult caregivers of the children/grandchildren who often mediate the interactions between distant family members and children, as well as other relatives or close friends such as Aunts/Uncles/cousins or daycare providers.This iteration is focusing on adults between 30-80 and children between the ages of 3-8. Some of the adults may be retired, but most are still working full or part-time and cannot travel much. The grandparents all have a basic understanding of computers and basic internet and email skills, most of the grandparents still working have smart phones as well as tablets and internet connected televisions. The grandchildren all attend day care or primary school and are exposed to laptops, tablets and smartphones through their parents and other adult caregivers. The children are adept at searching for familiar visual cues and using touch interfaces to start and stop actions on those interfaces.The grandparents or grandchildren will initiate an OurTime connection on their video–enabled touch screen tablet. Once a connection is made, the grandparent will help the grandchild pick a story to read together. When reading the story, either side will see highlights around items touched by the other on the story screen to which they can respond. Evaluation MethodsFirst Click study and SurveyI used IntuitionHQ to create a free, online, unmoderated first click study that I followed up with a verbal survey once the participants notified me they were done. Both the study and the survey were done by the users at home via internet and phone.I started with the first click study in order to gather quantitative data about time and task success, and also because I (and others) have seen a correlation between successful first clicks and overall happiness with a piece of software (1). Using the Google HEART framework (2) to evaluate the most important metrics for a piece of software (and those metrics change based on audience and use context) has been very helpful for evaluating usability test data in all my tests for the past year.Following the first click study I then conducted a verbal survey about the experience to get qualitative feedback.My first click study is in two parts, and Activity session and a Settings session, and can be found online:Activity Session Session interactive wireframes with a list of tasks is also online (although not used for an unmoderated study) and can be accessed here: (password HCI598)The Activity session tasks were:? call Grandma ? open the Curious George book to read with Grandma ? what is Grandma pointing at ?? end call with Grandma The Settings session tasks were:login to configurationturn on automatic access for the jones family networkset a session time limit for automatic access for 30 minutes set automatic recording to overwrite existing files after 30 dayssign out The respondent demographics broken down by age and gender:1 male, under 10 1 female 30-401 female 40-501 female 50-601 female 70-801 male 70-80The followup survey questions:did you understand the activities you were asked to do? how hard were they to do? (1 easy - 5 hard)Are the images big enough?Is the text big enough?did you understand what the icons meant?did you notice the yellow highlights on the story title?what seemed the hardest task to do?what might be missing?ResultsFirst click test results for the Activity session (heatmap and time on task) are published here: click test results for the Settings session (heatmap and time on task) are published here: questions with responses:tester1 (RM)2 (CP)3 (KM)4 (JS)5 (RH)6 (EKD)age8 yrs30+ yrs40+ yrs50+ yrs70+ yrs70+ yrstypeActivity onlyActivty & SettingsActivty & SettingsActivty & SettingsActivty & SettingsActivty & Settings???????did you understand the activities you were asked to do? yesyesyesyessomemostly> commentsits not my grandma so I guessed who it was and my mom helpednothing was rocket scienceseemed simple?I dont mess with the settings on my computer so for the wifi oneI had no idea????????how hard were they to do???????1 easy - 5 hard321234> commentsit would be better if the video ?this would be great with my niecei was wondering how you add in new booksjust doing the call and picking a book to read was easyi had to have my wife help me read the instructions???????Are the images big enough?yesyesyesyesyesyes> comments?????????????Is the text big enough?yesyesyesyes??> comments????not all of itthe Curious George book was too small???????did you understand what the icons meant?someyesyesmostlysomesome> commentsi know the clock and the calendar and the call but not how to hang upthe bookmark is a little obscure for kids but it makes sense for adultsthe icon to end the call seemed odd?the network question and time limit question didn't seem to match up well with the options I see on the pagethey mostly look like ones my phone so that was ok???????did you notice the yellow highlight on the story title?yesnot reallyyesnonono> commentsit seemed weird, I don't know why they showed upwithout live interaction I didn't know what it was supposed to mean, it was the only colored thing in the test but it was hard to seenot sure why it was there?it must have been really light????????what seemed the hardest task to do?hang upwifihangupsession timesession timesession time> comments??not because I didn't understand it, the button was just not working wellI thought the session time setting would be in the same place the automatic connect wasdidn't understand I was supposed to go to permissions to set up session times, maybe use a different word or phrase?i don't think session and permissions go together, you should call it something like limits or boundaries, maybe have the time limits and the location boundaries together???????what might be missing ???????> commentscolorsit would be easier if the wifi and the log out were on the main settings pageturbo-tax style 1 step at a time might be easier for the recording settingslooks cool, can't wait to see it in full colorit's a nice start but I don't think it's ready for testing all the way yetthe idea is nice, i'd like to read stories to my grandson if it ever works??????????????A strong theme present in both the qualitative and quantitative results is that the naming of sections need to be revisited when looking at the wifi automatic connection and the permissions. The majority of the tasks were quick, especially when the common words from the task are also found on the screen, the one surprise was that the hang up icon seemed odd to a few testers.Based on accessibility comments from my milestone 3 reviewer I made sure all the images and text in the wireframes were of a good size, but I did not realize the screenshot pages of the book would be so difficult to read. I will need to revisit that prior to my next usability test.DiscussionBased on the first click data and the survey results I need to make changes in the organization of some of the settings and the words used to describe the settingsI was surprised to learn that the end call/hang up icon seemed so odd to testers, I will need to do some more icon searching for mobile devices to see what is most commonly used. The main implications for this design seem to be that the Activity sessions in the non-logged in state are easy to understand and navigate, despite the actual book text being difficult to read. I believe eBooks are easily resizeable for the text, so I will need to look at adding text size and contrast controls to the user’s screen.As I am used to doing rapid lo-fi wireframe iterations to test and learn (common to both design thinking and Agile methodologies) I am confident that further testing and iteration will lead to an even better product. Once the organization and semantics issues are resolved, adding color and using video clips to do a “wizard of oz” style moderated usability test will provide useful information before deciding on the coding strategies and timelines.CITATIONS1. Bailey, B. (2013, October 28). FirstClick Usability Testing. Retrieved March 22, 2016, from 2. Rodden, K., Hutchinson, H., & Fu, X. (2010). Measuring the User Experience on a Large Scale: User - Centered Metrics for Web Applications (pp. 1-4). AMC CHI. Retrieved March 22, 2016, from ................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download