Κατά τη διάρκεια των δοκιμών πρέπει να τηρούνται συστηματικά, προσχεδιασμένα αρχεία με στοιχεία που θα αφορούν τις δοκιμές και τα αποτελέσματά τους. Φυσικά το μεγαλύτερο μέρος των στοιχείων είναι ενσωματωμένα στα αρχεία των Ηλεκτρονικών Φακέλων Υγείας.

Η ανάλυση των αποτελεσμάτων θα επιβεβαιώσει τα θετικά στοιχεία του σχεδιασμού και το γεγονός ότι οι χρήστες είναι ικανοποιημένοι με τις υπηρεσίες.

Οι τεχνικές που μπορούν να χρησιμοποιηθούν είναι πολλές. Τα τελικά αποτελέσματα πρέπει να απαντήσουν με θετικό τρόπο στα θέματα Χρηστικότητας (Usability).

Ο Οδηγός Χρηστικότητας μπορεί να έχει την ακόλουθη μορφή (Πηγή: Ευρωπαϊκό ερευνητικό έργο HERMES)

Telemedicine - Usability

Usability definition of ISO and ETSI – “The effectiveness, efficiency and satisfaction with which specified users can achieve specified goals in particular environments”.

• Effectiveness – “The accuracy and completeness with which specified users can achieve specified goals in particular environments”
• Efficiency – “The resources expended in relation to the accuracy and completeness of goals achieved”
• Satisfaction – “The comfort and acceptability of the work system to its users and other people affected by its use”

Stages

Definition of usability goals

Identification of User’s Population, Tasks and Environmental Characteristics

Specification of usability criteria

Evaluation scenario building

Usability Testing – data capture phase and data analysis and reporting

(A) DESCRIPTIVE ANALYSIS

DEFINITION/DESCRIPTION OF THE USABILITY GOALS

1. USER REQUIREMENTS : (A) description of clinical scenario - including presenting complaint, differential diagnoses, List of care processes, MANAGEMENT guidelines/standards to be followed. (B) DESCRIPTION OF THE USER POPULATION AND THEIR ENVIRONMENT – INCLUDING THE TASKS TO BE PERFORMED – THE PHYSICAL, TECHNICAL AND ORGANISATIONAL STEPS FOR USE OF THE TELEMEDICINE SYSTEM

2. DESCRIPTION OF THE SPECIFICATION AND DESIGN OF THE TELEMEDICINE SYSTEM AND THE USER INTERFACE

3. DESCRIPTION OF THE TECHNICAL TRIALS/IMPLEMENTATIONS OF THE SYSTEMS AND SUBSYSTEMS

(B) USER PROTOCYCLING /TESTING

4. ANALYSIS AND REPORTING : ACCURACY AND COMPLETENESS – SPECIFIED USERS ACHIEVING THEIR SPECIFIED GOALS, RESOURCES EXPENDED – IN RELATION TO ACCURACY AND COMPLETENESS, COMFORT AND ACCEPTABILITY – SATISFACTION OF USERS

5. ADAPTATIONS/RE-ITERATIONS REQUIRED TO FULFILL USER NEEDS : ANY repeats of steps (1-4)

6. PLANS FOR FINAL EVALUATIONS BEFORE UPTAKE : USER INTERFACE – Hierarchical task analysis (Sub-tasks breakdown)

• State transition network (group of tasks that can be performed by the user at each moment)
• Graphical specification (each system state/group of tasks converted into a graphical scenario)
• Implementation (graphical scenarios implemented with a User Interface Management System, UIMS)

4. ANALYSIS AND REPORTING

ACCURACY & COMPLETENESS – SPECIFIED USERS ACHIEVING THEIR SPECIFIED GOALS

(THE LIST OF USERS DEFINED IN 1 (B) AND THEIR GOALS/TASKS SHOULD BE USED)

• A PARAGRAPH SHOULD BE WRITTEN FOR EACH USER STATING THE ACCURACY AND COMPLETENESS WITH WHICH THEY ACHIEVED EACH GOAL/TASK
• THE FOLLOWING TABLE SHOULD BE COMPLETED AS TASKS ARE DONE – A SCORE CAN BE USED BASED ON THE ACCURACY/COMPLETENESS BEING (0 = NONE, 5 = TOTAL)

RESOURCES EXPENDED – IN RELATION TO ACCURACY AND COMPLETENESS

• FOR EACH USER & GOAL/TASK – ALL TYPES OF RESOURCE SHOULD BE RECORDED
• A PARAGRAPH SHOULD BE WRITTEN ON EACH RESOURCE AND ITS IMPORTANCE
• THE FOLLOWING TABLE SHOULD BE COMPLETED FOR EACH TEST

COMFORT AND ACCEPTABILITY – SATISFACTION OF USERS

• AN OVERALL PARAGRAPH ON USER COMFORT ACCEPTANCE FOR EACH USER & THEIR GOALS/TASKS SHOULD BE WRITTEN FOR INCLUSION IN THE FINAL DELIVERABLE
• FOR EACH USER & GOAL/TASK PERFORMED – ACCEPTABILITY AND COMFORT SHOULD BE RECORDED IN THE FOLLOWING TABLE WITH A FINAL SATISFACTION SCORE BASED ON (0=NIL 5=COMPLETELY SATISFIED)

Σωτηρίου Δημήτριος, Αναπληρωτής Καθηγητής
Εργαστήριο Ιατρικής Φυσικής
Ιατρική Σχολή Πανεπιστημίου Αθηνών
Τελευταία αναθεώρηση : 1/1/2006