Craigslist.org Usability Test Report
An online usability test was conducted by a master’s student at the University of Leicester, studying human-computer interactions. This study took place over a period of a week and most of the data was accumulated and evaluated on the 12th of April 2021.
Craigslist is one of the leading online advertisement forums with a primary office in the United States of America and subsidiary offices worldwide. The purpose of the test was to assess the usability of the information architecture, flow of information and user interface design of the website. Six participated worldwide with varying knowledge of websites through a total of 8 to 10 would have been desired.
The Goal
Craigslist is a widely used app and even though it has been labelled one of the worst websites in terms of interface. This usability test was done mainly to substantiate the pseudo-hypothesis that an attractive user interface promotes usability.
I also wanted to observe how easy it was for the participants (end users) tocompleted related tasks. I wanted to identify any issues pertaining to navigation, interaction, readability and visual design and provide recommendations to address the issues.
Role
UX Researcher/ Usability Researcher
Timeline
3 weeks
Tools
Craigslist.org website
Background, pre and post test queationnaire
SUS Document
The Craigslist Website
This is the initial view of the craigslist London website.A walkthrough of the site was initially conducted to access it’s features.
Methodology
Participants
Six participated worldwide.
3 males
3 females
Duration
The sessions were completed within approximately 30 minutes.
Location
Microsoft Teams
Zoom
Sessions
Pre-Sessions
Participants were chosen randomly and composed of friends or families of the tester.
Each individual was personally contacted and briefed on the project and was given the chance to agree or disagree to partake.
Each participant was briefed by the test administrator and a short background questionnaire was filled.
The participants were then given a chance to read the task scenarios and the test proceeded with the individuals trying to perform their tasks.
During Session
After each task, the participants were asked to rate the interface using a 5-point.
Likert Scale which ranged each section from “strongly disagree” to “strongly agree”. This was to measure 2 main variants:
• The ease of finding required information on the home page
• The ability to track one’s location at any point on the website
The overall experience on the website was measured using a 5 – point Likert scale testing eight measurement factors:
• Ease of use
• Keeping track
• Learnability
• Information aquisition
• Aesthetics
• Engagement
• Content Organisation
Post Session
Participants were asked to rate the experience of the test by stating what they liked most, and liked least, and recommend ways through which the website could be improved.
Tasks
The tasks were created to test specific touchpoints and interface functionalities of the website:
Test how to locate the contact number of a specific Company of interest or the information accessible to interested users.
Check how new users could create a posting on the platform.
Test the searching and deleting function of anonymous posts postings done with no account.
Test how to locate, use and read from the discussion forums or the discussion forum functionality.
Test a user’s ability to find a specific item posted on a specific day
Test the map feature
Results
Task Completion Success Rate
Most participants were able to complete the tasks without prompting.
Task 1 and task 4 - 100% completion rate
Task 2 - 66.6% completion rate
Task 3 - 0% completion rate
Task 5 and Task 6 - (66%) completion
Task Ratings
Ease in Finding Information
Most participants agreed that it was relatively easy to find information relevant to their search with an overall approval of 100%
Keeping Track of Location on the Site
Again, almost all participants found tracking their current locations on the page at a given time easy.
Time on Task
The completion rate ranged from 75 to 462 seconds and the results across showed task 4 as the fastest to be completed.
Task 3 took the longest as predicted as participants could not easily find their postings in order to delete them (mean = 330.3secs).
Errors
Video and audio medium was used to capture the frequency of errors such as
Menu choice error
Select from list error
Emotional expression of frustration
and confusion
Seeking help
Participants made the most errors in task 3.
Overall Metrics
• Ease of use - 83.3%
• Keeping track - 100%
• Learnability - 66.6%
• Information acquisition -66.6%
• Aesthetics - 0%
• Engagement - 0%
• Content Organisation - 33.3%
Recommendation and Conclusion
• Include cache history from user session
• Get rid of the sexual content
• Easier map search and navigation
• Much friendly interface
• Better layout
• More readable font and discussion page
• Make the user interface better, more accessible and eye-catching.
• Improve the organisation of the links.
Craigslist is a widely used app and even though it has been labelled one of the worst websites in terms of interface, the study proved that it is easy to use.
The entire interface of the website needs to be redesigned to look more attractive.
The discussion forum must be recategorized
There should be help bubbles or dialogue boxes.
Craigslist needs more content monitoring and more design to increase its potential.