Cost 219ter

5.0 Discussion

Section 4.1 showed that in total 64% of all tested checkpoints matched the results of the end user evaluation.  The only hardware heuristic point of major concern is heuristic number ten (the battery, SIM card and must be easy to use). It is of major concern because only 25% of the checkpoints within this heuristic matched the results from the end user evaluation.  Therefore the checkpoint within this principle needs reviewing further.

Of minor concern is hardware heuristic number four (the buttons, switches, dials and joysticks need to be easy to locate visually) and heuristic seven (the connectors, sockets, battery, battery compartment/back cover, SIM card holders, memory cards, memory card slot need to be easy to locate by touch).  These two heuristics are of minor concern because only 50% and 57% respectively of the checkpoints within these heuristics matched the results from the end user evaluation.  Therefore the checkpoints within these principles need reviewing further.

Section 4.2 showed that 78% of the tested software heuristics matched the results of the end user evaluation. The software heuristic points of major concern are heuristic number four (allow personalisation of the input) and heuristic number five (allow personalisation of the output). They are of major concern because only 25% of the checkpoints within heuristic four and none of the applicable within heuristic five matched the results from the end user evaluation.  Therefore the checkpoints within these principles need reviewing further.  All the other heuristics that were tested had a high majority of matches.

The end user evaluation was designed to pick up as many points as possible. However it is recognised that it would have been impossible to account for each point because the questions and scenarios in the focus groups, questionnaires and interviews would be too long and difficult to complete.