Cost 219ter
Appendix One
Considering users in evaluation
When performing an evaluation, it is vital that the evaluator can communicate effectively information to the participants. When including disabled participants in an evaluation, the evaluator needs to be aware of their needs so that they can contribute fully.
Protocol Considerations
Have a clear protocol of how the evaluation is to be conducted. Therefore any procedure can be adapted if necessary without compromising the validity of the results.
Have an evaluation protocol prepared which you can give to participants. This should highlight what is required and inform participants of their rights.
Provide all written material in an easy to read format
Use practical examples where possible
Book interpreters for participants who are not fluent in the evaluators' language in advance of the day.
If a product or system is to be left with or delivered to a participant make sure it is clear how long it can be trialled for.
Venue Considerations
When conducting group sessions provide housekeeping information. This should include location of toilets, fire exits and the fire procedure for that venue.
When conducting group sessions start with a "welcome" section where each person in the room introduces themselves.
Make sure the venue, includes seating that can be moved so people can sit in different locations if required.
Make sure that you sit in a direct line of sight of the participant(s)
Provide a room with adjustable levels of light.
Inform the venue of any specific requirements when booking the venue.
Participant Considerations
Provide regular breaks for the participants
Provide regular refreshments for the participants
Give participants the option to receive any evaluation documents in advance of the evaluations
Ask participants prior to the evaluation if they have any specific requirements in order for them to fully participate.
Address the participants in a direct, personal and respectful manner, according to their chronological age.
Blind and Partially Sighted Users
This group of users consists of people who have a very low level of residual vision or do may not have any useful vision at all. These users will rely primarily on tactile and audible information in order to use the product or system. To include these users within an evaluation the following points need to be considered and implemented:
The product or system must provide an accessible way for end users to interact with it (e.g. speech output of the display).
The preferred format for receiving information should be obtained for each participant prior to the evaluation.
Instructions must be provided in the users preferred format (e.g. Braille or audio).
The evaluation material (e.g. questionnaire or evaluation protocol) must be provided in the users preferred format (e.g. Braille or audio).
If any of the participants have guide dogs, providing refreshments and breaks for the dog(s) may be required.
This group of users consist of people who have a low level of vision. These users will rely primarily on their vision in order to use products or system but may also need additional tactile and audible information as well. To include these users within an evaluation the following points need to be considered and implemented:
The product or system must provide an accessible way for end users to interact with it (e.g. speech output of the display).
The preferred format for receiving information should be obtained for each participant prior to the evaluation.
Instructions must be provided in the users preferred format (e.g. Braille or audio).
The evaluation material (e.g. questionnaire or evaluation protocol) must be provided in the users preferred format (e.g. Braille or audio).
Task lighting should be available for users.
Deaf and Hard of Hearing Users
This group of users consist of people who have a very low level of hearing or do not have any hearing ability at all. These users may predominately be British Sign Language users if have been deaf from a young age. Audible information may be completely inaccessible to this group. To include these users within an evaluation the following points need to be considered and implemented:
Find out prior to the evaluation the preferred method of communication for each participant (e.g. British Sign Language).
Book the appropriate interpreters well in advance of the day.
If running group sessions discuss with interpreters how many are needed
Discuss with any interpreters how often they will require breaks and factor this in to the evaluation prior to organising a time and date with the participants.
Provide any information that you would say to the participants to the interpreters prior to the day of the evaluation.
Make sure all written information given to the participants is easy to read by using plain language.
Speak directly to the participant and not the interpreter unless the interpreter is addressing you themselves.
Make sure that you sit in a direct line of sight of the users.
Hard of Hearing Users
This group of users consists of people who have a low level of hearing. These users may use British Sign Language to communicate with others but might not rely on it for communication. They may wear hearing aids on either or both ears and will rely on the T-link facility to facilitate as effective hearing as possible where available. To include these users within an evaluation the following points need to be considered and implemented:
Find out prior to the evaluation the preferred method of communication for each participant.
If interpreters are required, book them well in advance of the day.
Speak clearly to the participants.
Make sure the participants can access the product or system before the evaluation takes place.
This group of users will rely on a wheelchair to get about. These users will only have limited reach due to the height they are at. Wheelchair users will have difficulty in getting about where sloped inclines and declines are not available. To include these users within an evaluation the following points need to be considered and implemented:
Make sure the users can gain easy access to the building, to the rooms that you will be using and to any additional facilities such as toilets.
Always talk to the person at eye level.
Provide access information about the venue to the participants prior to the day.
This group of users are able to walk but might only be able walk slowly and/or short distances. These users might have limited reach if they are unsteady on their feet or are carrying walking aids. Climbing stairs, walking long or steep inclines and walking distances may be difficult or impossible to do. To include these users within an evaluation the following points need to be considered and implemented:
Make sure walking distances between rooms are as short as possible.
Provide information to the participants prior to arrival about the venue and walking distances involved.
Allow for additional time for the participants to arrive and get to the room.
This group of users have limited use of their hands or might only be able to use one hand. People in this user group may have difficulty in performing tasks with their hands over time and/or may not be able to perform detailed work. Some users will have involuntary movement of their hands, which might make holding things or pressing buttons in confined spaces difficult. To include these users within an evaluation the following points need to be considered and implemented:
Make tasks that require the use of the hands as short as possible.
Refrain from any complex precision tasks where possible
People with Learning Difficulties
This group of users consists of people who have adaptation problems in their daily life activities, in particular when exposed to new situations and contexts. Usually those problems may influence their behaviour, performance and the ability to make judgments. To include these users within an evaluation the following points need to be considered and implemented:
Have an informal approach to the participants to create a less stressful environment but respecting their chronological age
Use simple language
Be alert to signs of participant fatigue.
Be prepared to interrupt the evaluation as required by the participant.
Allow extra time for participants to respond
Do not assume the participants will have previous knowledge of the product or system is being evaluated.
Provide additional or alternative methods of answering questions (e.g. use a picture based rating system instead of having a numerical rating system)
Provide additional materials to assist users in completing tasks (e.g. provide pictures or drawings which illustrate each step of the task.
Consider interactive interview style methodology over questionnaire based evaluations
Present and instructed each step of a task carefully
Always ask one question at a time and always demand just only one answer
People with multiple disabilities
It is recognised that people who have a disability may have a secondary disability as well. This secondary disability may or may not have a strong influence in the person's life. However for those people who have multiple disabilities, the evaluator should contact them individually to determine their capabilities and needs. By finding this information out, the evaluator will know how to fulfil their needs so they can participate fully.
| Contents |
Last updated: 20.11.2007 © Copyright reserved
