Phase 5

In this final phase, there are two general requirements. First, analyze the findings of your usability testing and provide recommendations for future work on the Scope interface. Second, reflect on the overall findings of your case and its development process. The first part (Analysis of User Testing) should be a final section within the case structure, while the second part (Overview of the Case) should be something like a cover sheet.

Part 1, Analysis of User Testing (approx 1000 words).

In Phase 4, you collected raw data from user testing. In this phase, you will analyze and interpret the data to make inferences about your testing objectives.

• State your testing results and conclusions: Be clear about the questions you were probing and the meaning of the data you collected. What findings were expected and unexpected? How do your findings relate to your claims? To support your conclusions, use descriptive statistics (averages, counts, differences), as well as inferential statistics (t-tests, correlations).
• Make redesign recommendations: Based on your testing conclusions, if another team were to continue efforts on the Scope, what immediate redesign steps are necessary? What should be the next major phase of development? Should additional scenario-based design and claims analysis be performed, should higher fidelity prototypes be developed, or should additional user testing be conducted? Should your project be considered for extension, or would a new team be better off with another effort or starting from scratch?

Part 2, Overview of the Case (approx 1000 words).

In Phases 1-4, you have developed a retrospective case study and feature extension of the Scope notification system, using the existing project materials as a starting point. In this phase, you are to write a reflection on this process that will help us refine the use of case studies as a teaching tool for HCI. At a minimum, address the following points:

• Analysis of the existing Scope project materials: What was helpful about using the original materials in phases 1-2? Did converting the materials to a case format make some concepts more concrete for you? Did the existing materials give you examples of how to perform various tasks, for example? Did “filling in the gaps” from the existing materials help you in thinking about issues with your new design and practicing methods learned in class? What information was not available in the existing case that would have been useful to you in any of the phases?
• Advantages and disadvantages of using cases as a basis for a new design: Identify and explain at least three advantages (upsides) and three disadvantages (downsides) for converting existing project materials to a formal case as the starting point for a new interface design of the same system. Overall, would you recommend this approach for teaching HCI? If there are differences of opinion within your group, represent all those opinions in this section.
• Analysis of your updated case: You have created a comprehensive case study on the Scope interface. Now think about your case study as a tool for teaching future students about interface design. Do you think that your case study would be beneficial in this way? What key ideas does your case best illustrate? Does your updated case study address any of the deficiencies of the existing project materials that you identified above (not deficiencies in the original interface design, but deficiencies in the presentation, structure, or content of the original design rationale)? Give at least four specific ways that your updated case would need to be changed to make it a more effective teaching tool for HCI.

By midnight on Dec. 11, send a zipped file of project materials from all phases to the TA.