Usability Evaluation of Library Maps
OBJECTIVE
To assess and improve the usability of the library map on IU’s website, making navigation more intuitive and efficient for users.
MOTIVATION
Library maps play a critical role in helping students find resources. However, usability challenges, such as poor discoverability and inefficient navigation, hinder their effectiveness. This project aimed to address these challenges through rigorous user research and testing.
ROLE
UX Researcher
DURATION
6 weeks
Research Process
The research began with defining clear objectives: to evaluate how effectively users could locate and navigate library maps and identify friction points. A task-based usability test was designed to simulate real-world scenarios, focusing on:
Testing users’ ability to locate the map feature.
Observing how users navigate to specific locations using the map.
Designing the Experiment
10 students were recruited via university bulletin boards and email lists.
A Think-Aloud Protocol was used to capture participants’ thought processes while completing tasks. Observers recorded qualitative insights and task success rates.
Conducting Interviews
The final step involved analyzing data to identify trends and usability challenges:
Task success rates were calculated to measure ease of use.
SUS scores provided a quantitative measure of overall usability.
Observational notes from think-aloud sessions highlighted user frustrations and preferences.
Evaluating Data
Usability Testing
User Demographics
Graduate Students
Undergraduate Students
Age Group: 19 to 29 yrs
Key Performance Indicators (KPIs)
Task Success Rate
Participants were tasked with locating and using the library map to navigate various sections of the library. Only 20% of participants successfully located the library map without assistance, revealing significant challenges in discoverability.
While 100% of participants eventually completed navigation tasks like finding study rooms or the Service Desk, many struggled with the usability of the map, showcasing moments of frustration. This indicates that even though participants managed to complete tasks, the process was neither smooth nor intuitive.
System Usability Scale (SUS)
The Library Map website received an average SUS score of 58.5, which falls significantly below the benchmark of 70, pointing to poor usability.
Statistical analysis revealed a 97.89% probability that the true usability score is below 70, providing strong evidence of usability issues.
Additionally, the 90% confidence interval for the true SUS score ranges from 49.59 to 67.41, confirming that the website’s usability is well below acceptable standards. The low SUS score reflects participant struggles, particularly in navigating the map and interacting with its features.
Qualitative Usability Metrics
Navigation Inefficiency: While users completed navigation tasks, they faced significant challenges interacting with the map. Key issues included overwhelming visual design, unclear labels, and frustrating functionality, particularly on mobile devices.
Landmark Effectiveness: Visual landmarks such as elevators and staircases were effective in aiding orientation, receiving positive feedback from participants. However, reliance on these suggests a need for additional intuitive cues within the map design.
Key Findings
Lack of Awareness
Many users were unaware of the map feature.
Difficulty locating the map on the library website and app.
Particularly, new users struggled to find it.
Challenges on Mobile Devices
The small screen size made the map harder to use.
Difficulty with zooming, text readability, and navigation on mobile.
Mobile experience was cumbersome compared to desktop.
Confusing Map Design
Users found map design overwhelming.
Dense information and unclear visual cues.
Color coding and room labels were not intuitive.
Design Recommendations
1. Improve Discoverability
Relocate the map to a more prominent position in the website’s navigation menu.
2. Simplify Navigation
Enhance zoom and panning controls for better usability. Use clear labels and reduce information overload on the map.
3. Optimize for Mobile
Redesign the interface to ensure responsiveness and readability on smaller screens.
4. Increase Awareness:
Promote the map feature through tutorials or quick tips on the website’s homepage.
Implementing these recommendations…
Will increase user confidence and satisfaction by making the library website more intuitive and easier to navigate.
Users will be able to find key resources faster, reducing frustration and improving their overall experience.
This will likely lead to a 50% improvement in task success rates for locating the library map.
The improvements are expected to result in SUS scores exceeding 70, reflecting a significant positive shift in user experience.