Skip to main content

Usability Testing Report

Usability Testing Report Book Swap System

Initial Prototype

For our initial prototype, we have created the interface for both primary task and subtask as stated below, and some extra features such as checkout with QR to pay.

Primary task : To search and buy secondhand books.

Subtask:
  • Manage user profile.
  • Add desired books to wish list.
  • Seller can post an ad to sell books.
  • Have chat session through WhatsApp Messenger.
  • Also have checkout session in app-purchase.
We design our prototype by following Schneiderman's 8 Golden Rules :

Principle 1 : Strive for consistency

 

Maintain style of icon and the location of it in the navigation (settings, back, home, fav item)


Principle 2 : Enable frequent users to use shortcuts



User can use sort books by school, adding favorite books to the wish list and the page has WhatsApp button that lead to chat with seller to make a deal.

Principle 3 : Offer informative feedback 


Has sound effect whenever user click fav item. Also, “loading page” when the user click “WhatsApp contact” of the seller


Principle 4 : Design dialogue to yield closure


Has confirmation button at loading page to confirm redirecting to user's WhatsApp Messenger as it not required if user want or not redirecting to WhatsApp.


Principle 5 : Offer simple error handling


There will be an small error pop out “fill the empty blank” if the user haven’t fill the black when add a new item or when their profile not complete.

Principle 6 : Permit easy reversal of actions


There is undo button for “favorites” item by unliked the item. Also, each page have “back” button to ease the user to return to previous page without came back to the home page

Principle 7 : Support internal locus of control



There will be smart animation for each click (fav item) so there is interaction will give cues of control.


Principle 8 : Reduce short-term memory load


There is no need for user to remember any because each icon represent the functions. User also can view the fav item they liked.

1. Introduction

1.1 Project Background

Book Swap System is a mobile application designed to . The goal of this project is to create a convenient, secure, and sustainable campus-only platform for students to exchange textbooks, reducing costs and waste while fostering community engagement.

1.2 Purpose of Usability Testing

This usability testing serves as a crucial validation step to ensure the Book Swap System effectively meets its design objectives. Through systematic evaluation, we aim to:

1. Evaluate User Interactions:

  • Assess how intuitively students can navigate core functionalities
  • Determine if the swapping process aligns with student expectations

2. Identify Pain Points:

  • Discover obstacles in key workflows (searching, listing, and chatting)
  • Uncover interface elements causing confusion or hesitation

3. Gather Actionable Feedback:

  • Collect qualitative insights about feature preferences
  • Understand emotional responses to the swapping experience

4. Optimize for Launch:

  • Prioritize refinements based on empirical evidence
  • Validate design decisions before full development

5. Focus Areas:

  • Learnability: Measure how quickly new users achieve competency with core features
  • Efficiency: Time-task analysis for critical swapping operations
  • Satisfaction: Assess perceived value and trust in the platform
1.3 Key Concepts Used
  • Moderated Testing : We conduct guided testing sessions where participants complete specific tasks while a moderator observes. This approach lets us ask questions in real-time to understand how users think and why they make certain choices. It helps uncover both obvious and subtle usability issues as they occur.
  • In-Person Testing : Testing takes place in natural campus settings like classroom (SMMTC1). By observing students in their actual environment, we see how they would realistically use the app - dealing with distractions, time pressures, and other real-world factors that affect usability.
  • Explorative Testing : Participants freely explore the app without strict instructions, mimicking how they might naturally discover features. This reveals what catches their attention, how they expect features to work, and where the design matches (or conflicts with) their mental models of a swapping platform.
1.4 Testing Objectives : 
  • To evaluate the usability of the second-hand book selling app.
  • To evaluate the ease of navigation and user interface design.
  • To gather feedback on the visual design and feature usefulness.

2. Methods & Procedure

Location :

SMMTC1, SMMTC Building, UUM

Participants :

User 1 : Male

Matric No. : 281668

Age : 23

School : SOC

User 2 : Female

Matric No. : 291341

Age : 22

School : SOC

User 3 : Male

Matric No. : 296768

Age : 23

School : SOC

Testing Environment : 

  • Quiet and Controlled : The room was kept quiet and free from distractions, helping participants focus fully on the tasks without interruptions. This ensured accurate feedback and reliable test results.
  • Technical setup : The laptop was used to display the Figma app prototype so participants could see and interact with it. A stopwatch on the laptop helped track how long each task took during the test. Two phones were used, one for the participant to test the prototype (to simulate real smartphone use) and the other to record the session for notes and review later. And also Figma was the tool used to create the app prototype. Participants could tap and swipe through the design like a real app, helping test usability and gather feedback easily.

Briefed Task :

1. Scenario 1 : You're a university student looking for a used book of school SOC to save money. You want that's still in good condition and priced under RM30.
  • Task 1 : Use search function
  • Task 2 : Apply filters for condition and price
  • Task 3 : View book details

2. Scenario 2 : You have a second-hand book that you want to sell. You need to list it for sale on the app.
  • Task 4 : Upload book photo
  • Task 5 : Publish the listing
2. Scenario 3 : You found the book you want. Now, you want to buy it and have it delivered to you and want to ask the seller if they offer free shipping.
  • Task 6 : Add a book to your favorite books page
  • Task 7 : Find the messaging/chat feature
Testing Metrics : 

Observation and Feedback :

Task 1 : Use search function

Observation

Feedback

Conclusion

The user quickly located the search bar and choose filter by school “SOC”

The search function worked well and users can easily navigate to the page by school.

No major issues were found. The search feature is intuitive and meets user needs.



Task 2 : Apply filters for condition and price

Observation

Feedback

Conclusion

Filters were found easily

Simplify the filter layout and add a "Under RM30" quick-select option.

While functional, the filtering process could be streamlined to improve efficiency.



Task 3 : View book details

Observation

Feedback

Conclusion

The user tapped on a book and saw its condition, price, and seller info without issues.

Include more images (e.g., book spine, highlights) for better assessment.

The book details page is clear but could benefit from additional visuals.



Task 4 : Upload book photo

Observation

Feedback

Conclusion

The upload button was clear, but the user hesitated when selecting a photo from their gallery.

Add a guide (e.g., "Tap here to upload") to reduce confusion.

Small UI improvements could make the photo upload process smoother.



Task 5 : Publish the listing

Observation

Feedback

Conclusion

The "Post" button was easy to find, but the user double-checked details before submitting.

Add a confirmation popup ("Listing published!") for reassurance.

Users need clearer feedback to confirm successful actions.



Task 6 : Add a book to your favorite books page

Observation

Feedback

Conclusion

The user liked the heart icon but suggested making it visible on the list view (not just the detail page).

"Add a fav button before showing the list" (as noted in the post-test). 

The favorites feature is useful but could be more accessible.



Task 7 : Find the messaging/chat feature

Observation

Feedback

Conclusion

The chat icon was just alright; the user satisfied with the chat button

The function should be kept as it is functioning well. But, need to add a checkout page just if the user doesn’t want to meet face-to-face.

The chat feature works but could be complemented with an in-app purchase option.



Tools and Equipment Used:
 

3. Results & Analysis

The usability testing of the Book Swap System involved three participants from the School of Computing (SOC) at UUM. Each user was asked to complete seven tasks, including searching for books, applying filters, viewing details, uploading a listing, using the favourite feature, and accessing the chat function. The testing combined direct observation, timing, and user satisfaction ratings.

Quantitative Results:

                         

Analysis:

  • All users completed the assigned tasks successfully, indicating that the core functionality of the app was usable.

  • User 3 completed tasks the fastest on average, while User 2 had the shortest total completion time overall.

  • User 1 spent the most time and gave the lowest satisfaction rating, suggesting possible friction during usage despite successful task completion.

Qualitative Findings:

  • Icon Confusion: User 1 reported that the favourite icon was hard to recognize and too similar to the chat icon. This likely contributed to lower satisfaction.

  • Feature Accessibility: User 2 requested a shortcut to add books to favourites directly from listings. This reflects a desire for streamlined interaction without extra clicks.

  • Feature Gap: User 3 noted the absence of a checkout button, which highlighted a missing step in the transaction flow and points to opportunities to improve end-to-end functionality.


Post Question:

User 1


User 2


User 3


Overall, while all users achieved their goals, the test uncovered critical design issues affecting satisfaction and efficiency. These findings directly informed several improvements.


4. Improvements/Action Taken

User 1

Findings: The participant mentioned that the favourite icon was confusing and could be mistaken for a chat icon.


BEFORE

The favourite icon used in the app was visually similar to the chat icon, which caused confusion among users. Some users might click the wrong button, thinking they are messaging a seller when they actually added a book to their favourites.

AFTER

To resolve this, the favourite icon was changed to a universally recognized heart symbol, while the chat icon was updated to a speech bubble for clearer distinction. This change helps users quickly identify each function, reducing mistakes and improving overall navigation clarity.


User 2

Findings: The participant suggested adding a favourite button directly on the book listings on the homepage.


BEFORE

Users could only add books to their favourites after opening the book's detail page. This added unnecessary steps and made the process less efficient. Users looking to quickly save books while browsing found this frustrating and time-consuming.

AFTER

The favourite (heart) button was added next to each book item on both the homepage and school-specific book lists. Now, users can directly favourite a book without needing to view its details. This made the experience quicker and more user-friendly for those who like to save multiple books at once.


User 3

Findings: The participant recommended adding a checkout button so users could buy books directly through the Book Swap app.


BEFORE

There was no clear way for users to proceed with buying or swapping books after finding one they liked. The app lacked a checkout or transaction initiation feature, which limited the usefulness of the platform.

AFTER

A checkout button was added to the book detail page and the favourites page. This allows users to start the buying or swapping process directly within the app, creating a more complete and efficient experience for both buyers and sellers.

5. Conclusion

The usability testing for the Book Swap System provided valuable insights into how real users interact with the platform. All participants were able to complete the assigned tasks, indicating that the app’s basic functionality is solid and user-friendly.

However, the testing also revealed specific areas that needed improvement, such as confusing icon designs and the lack of quick-access features. By acting on this feedback, several meaningful changes were implemented, most notably, replacing the favourite icon for better clarity, adding the favourite button directly to listings, and introducing a checkout feature to facilitate transactions.

These improvements have helped align the app more closely with user expectations and the overall goal of making book swapping on campus easier, faster, and more enjoyable. The results confirm that the Book Swap System is ready for further development and deployment, with strong potential to support sustainable and community-based textbook sharing among UUM students.

Comments

Popular posts from this blog

Meet the Team Behind the Book Swap System

WELCOME TO OUR BOOK SWAP SYSTEM 🕮 We’re a passionate team from Chill Penguin aiming to reduce textbook waste and promote sharing through our Book Swap System. What is Book Swap? Book Swap is a student-powered system where textbooks are exchanged instead of bought. It’s sustainable, budget-friendly, and community-driven! Follow us for updates, events, and book listings.

Our Clickable Prototype

  Part 3: Clickable Prototype - BookSwap We created a clickable prototype for BookSwap using Figma to bring our ideas to life and show how the app would actually look and work. This prototype covers the main user tasks and interaction flow that we planned earlier in our storyboard and conceptual design. Here's how we applied the design requirements for this stage: ● High Fidelity in LOOK We used soft tones like teal, purple, and white to give the app a clean, student-friendly feel. Fonts are kept simple and easy to read, with consistent use of spacing and layout across all screens. Our penguin mascot appears in several screens like the welcome, home, and profile pages to give the app a fun and memorable identity. All icons follow the same rounded, minimal style to match the overall theme. Main screens designed include: Welcome/Loading, Login, Home (Book List), Book Details, Favorites, Add Book, and Profile Settings. The visual design reflects how we want the final version of the ap...