Mover, LLC.

11.20.16

U.S. Department of Health & Human Services - 200 Independence Avenue, S.W. Washington, D.C. 20201

Table of Contents

U.S. Department of Health & Human Services - 200 Independence Avenue, S.W. Washington, D.C. 20201

Introduction
Mover, LLC. Is a mobile app based company that allows individuals who have SUVs, trucks, or
other large vehicles to help people more their stuff efficiently and cost effectively. We want to offer
a new method for getting peoples everyday miscellaneous items from point A to point B.
The Mover, LLC. Usability engineers conducted independent usability testing using a prototype
wireframe model of the app. The engineers observed the participants body language and how they
navigated thru the app. Logging notes on the participants.

Executive Summary
The Mover, LLC. project team conducted the usability testing in independent locations in
Eau Claire, Wisconsin. We conducted these interviews to determine what were the weak
and strong points of our app, and to also determine the overall usability of the app.
4 participants took part in the Mover, LLC. project teams usability testing. Each session of
testing lasted approximately twenty to thirty minutes. Test scenarios between the
participants differed in situation to try to expose the flaws of the Mover app.
Throughout the teams testing most of the subjects found the app easy to use and were
able to complete the tasks with minor issues. Some testers were confused with the
hyperlinks in the wireframe but that was just a minor hang up.
The test identified a few minor problems including:
Design Elements
Confirmation page of the move

U.S. Department of Health & Human Services - 200 Independence Avenue, S.W. Washington, D.C. 20201

This document contains participant feedback, satisfaction, errors, and recommendations for
improvement. A copy of the scenarios and questionnaires are included in the Attachments
section.

Methodology
Sessions
The test administrators contacted and recruited participants from their
Personal centers of influence as our demographic for app users is in the 20-35-year-old
range. After the participants accepted the test administrator set up a time and date with
the participant for the interview. Each session lasted approximately twenty to thirty
minutes. During the sessions, the administrator explained the reason for the testing, asked
the testers some basic demographic and psychographic questions. Participants then
received the task scenarios and tried to complete the tasks and find the information
throughout the app.
After each task, the administrator asked the participant to rate the use of the app on a 5point Likert scale with measures ranging from Strongly Disagree to Strongly Agree. After
the participant rated the app on the Likert Scale, the participants were asked a few
subjective questions:
How comfortable were you navigating the app?
Were you able to keep track of your location within the app?
Accurateness of predicting which section of the app contained the information.
After the final task was completed, the test administer asked the participants to rate the
app by using a 5-point Likert Scale (Strongly Disagree to Strongly Agree) for six subjective
measures including.
Ease of Use
Difficulty in navigation throughout the app
Learn ability how easy it would be for a user to learn how to use the app
Information Facilitation- how quickly the participant could find the
information throughout the app
In addition, the test administrator asked the participants the following overall app
questions:
What the participant liked the most
What the participant liked the least
Recommendations for improvement

U.S. Department of Health & Human Services - 200 Independence Avenue, S.W. Washington, D.C. 20201

Participants
All participants were attendees of the University of Wisconsin- Eau Claire and were within
the age group 20-30 year range. From our four participants, three were male and 1 was
female. The participants testing dates were scheduled independently with the test
administrators.

Evaluation Tasks/Scenarios
Test participants attempted to complete the following tasks created by the Mover project
team:
Find your Order History
Find where you can add a Payment type
Find where you can modify your notification settings
Find where you can add photos of your items
Find where you can edit your profile

Results
Task Completion Success Rate
All participants successfully completed Tasks 1(Find your Order History), Task 3(Find where
you can modify your notification settings), Task 4 (Find where you can add photos of your
items). Some found more difficulties with Task 2 (Find where you can add a payment type)
with a completion rate of 75%. And Task 5 (Find where you can edit your profile) with a
completion rate of only 50%.
Task Completion Rates
Participant

Task 1

Task 2

Task 3

Task 4

Task 5

Success

Completion
Rates

100%

75%

100%

100%

50%

U.S. Department of Health & Human Services - 200 Independence Avenue, S.W. Washington, D.C. 20201

Task Rating
After the completion of each task, participants rated the ease or difficult of completing the
task for three factors:

It was easy to find my way to this information.

As I was searching for this information, I was able to keep track of where I was in
the website.
I was able to accurately predict which section of the website contained this
information.

The 5-point rating scale ranged from 1 (Strongly disagree) to 5 (Strongly agree). Agree
ratings are the agree and strongly agree ratings combined with a mean agreement ratings
of > 4.0 considered as the user agrees that the information was easy to find, that they
could keep track of their location and predict the section to find the information.

Ease in Finding Information

All participants agreed it was easy to find your order history (mean agreement rating =
5.0). We found the same findings when it came to modifying notification settings and
adding photos of your items (mean agreement rating =5.0). For adding a payment type
with a 75% success rate and a mean agreement rating of 4.0. And lastly, when it came to
finding where you can edit your profile with a success rate of 50% and a mean agreement
rating of 3.0.

Keeping Track of Location in Site

All participants found it relative ease in navigating thru the app. While finding order history,
finding where to add photos, and finding where to modify notification settings the
participants found a mean agreement rating = 5.0. While finding add payment there was
some confusion with the participants. They found and exposed an unnecessary page in the
app. This area got a mean agreement rating of 3.0. Lastly, when finding edit profile, there
was a mean agreement rating of 4.0.

Predicting Information Section

For example:
All the participants found it relatively easy to predict where the information they were
looking for would be. For Tasks 1,2,4,5 there was a mean agreement rating of 5.0. And for
Task 3 there was a mean agreement rating of 3.0.

Test 1 Mean Task Ratings

U.S. Department of Health & Human Services - 200 Independence Avenue, S.W. Washington, D.C. 20201

Task
1 Find order history
2 find add payment
type
3 Find modify
notification settings
4 Find add photos of
items
5 Find where you can
edit your profile

Ease
Finding Info

Location in
Site

Predict
Section

Overall

5.0

5.0

5.0

5.0

5.0

3.0

5.0

4.33

5.0

5.0

3.0

4.33

4.0

5.0

5.0

4.66

3.0

4.0

5.0

4.0

Errors
The Mover, LLC. project team captured the number of errors participants made while trying
to complete the task scenarios.
The tasks that causes the most issues with the participants were tasks 2,4,and 5. When
looking for a payment type one tester was confused with an extra page in the app and that
caused for them to make errors but they were not costly. When finding where to add
photos, some were confused by the page layout and found themselves wondering where to
submit the move or photo. When it came to editing the profile some of the participants
didnt know the logo/ sign that represents editing the profile.

Overall Metrics
Overall Ratings
After task session completion, participants rated the site for eight overall measures These
measures include:
Ease of Use
Difficulty in navigation throughout the app
Learn ability how easy it would be for a user to learn how to use the app

Information Facilitation- how quickly the participant could find the

information throughout the app

Post-Task Overall Questionnaire

Strongly
Disagree

Disagree

Neutral

Agree

Strongl
y Agree

The App was easy

to use

U.S. Department of Health & Human Services - 200 Independence Avenue, S.W. Washington, D.C. 20201

Strongly
Disagree
Navigating forward
and backward thru
the app was easy
How easy was it
for the user to
learn the app
Could you find the
information quickly

Disagree

Neutral

Agree

Strongl
y Agree

Recommendations
The recommendations section provides recommended changes and justifications driven by
the participant success rate, behaviors, and comments. Each recommendation includes a
severity rating. The following recommendations will improve the overall ease of use and
address the areas where participants experienced problems or found the
interface/information architecture unclear.

Change

Remove the first page in the

payments portion of the app

Add confirmation button to

the make a move portion of
the app

Justification
Participant made us realize that this page is
unnecessary.

Severity
High

Participant made us realize that after you

complete making a move there are only 2 options.
Whether to make another move or return to
menu. When there is a need to confirm your
order.

Conclusion
Most of the participants found that the Mover app was well organized and easily navigated
with the exception of a few glitches in the wireframe. Participants found that the flow of the
app allowed for simple and easy execution of the tasks asked of them to do. Implementing
the changes that we have proposed and continuing to work with users will ensure that the
app is usable and easily learned for all users.

U.S. Department of Health & Human Services - 200 Independence Avenue, S.W. Washington, D.C. 20201