Leading Construction and Supply chain Firm Website - Usability Test
Key deliverables
1) Heuristic Evaluation
2) Moderated Guerilla Usability Testing
3) Unmoderated Remote Usability Testing
4) User Personas & Scenarios
5) User Journey Map
1) Heuristic Evaluation
Process
Website heuristically evaluated with three category of users namely Designers, Marketing executives and Content writers. Heuristic evaluation gives us the detailed view of minor and major usability concerns the user experiences. The samples for the evaluation was done by 14 individuals internally, among them 6 were design experts and the rest 8 were from Marketing and Content industry, a set of questions were assigned to each expert who then went through the website to experience and provide the pros and cons of usability. The findings and recommendations are purely based on the evaluation output gained from the samples.
Findings
2) Moderated Guerilla Usability Testing
Process
A total of 12 participants were tested. Participants were not formally recruited in advance based on detailed criteria, but rather approached on the day and asked to take part . Participants in the test were Builders, Urban planners, interior designers,Head of marketing, Head of operations (IT) procurement & Job seekers. Participants were given the opportunity to have the same orientation and level of training as the actual end users would have received. Participants had a mix of backgrounds & characteristics.
Participants were scheduled for 40 minutes max sessions with a minimum of two hours gap between each session for a briefing by the administrator and to reset systems to proper test conditions. A spreadsheet was used to keep track of the participant schedule.
Usability Metrics
The purpose of the testing been to Process Approach for Improving the Usability of the website, to support a process that provides a high level of usability for all users.
The goal is for users to interact with the system effectively, efficiently, and with an acceptable level of satisfaction. To this end, metrics for effectiveness, efficiency and user satisfaction were captured during the usability testing. measuring participant success rates and errors Efficiency measuring the average task time and path deviations Satisfaction with the website usability by measuring ease of use ratings.
Findings
3) Unmoderated Remote Usability Testing
Process
A total of 10 participants were tested. Participants were formally recruited in advance based on detailed criteria with a specific demographic profiles . Participants in the test were GC, interior designers, Architects etc. Participants were given the opportunity to have the same orientation and level of training as the actual end users would have received. Participants had a mix of backgrounds & characteristics.
Participants were scheduled for 45 minutes max sessions. A spreadsheet was used to keep track of the participant schedule.
Tasks
A number of tasks were constructed that would be realistic and representative of the kinds of activities a user might do with the website. The script was divided into sections to reflect the measures being tested, and scenario based tasks to perform to understand and identify the user pain points across various touch points in the website. To test website navigation capabilities, Information adequacy, content management support, non functional links & features etc
Usability Metrics
During the usability test, various documents and instruments were used for Pre-test &
Post-test Questionnaire
Online testing tool https://www.userlytics.com/ was used to capture recordings of the various test metrics to properly evaluate the testing process
Findings
4) User Persona's and User Scenario
Sample Persona
Affinity Map
We reviewed recordings of the testing-sessions carefully and laid out the problems and complaints that each users had. We then used affinity mapping to organize and group these pain-points into categories.
Ideal User Scenario & Journey Map
To help prioritize the issues, We used a 2x2 map to help rank the category of issues by how important they are to the business (x-axis) and to the users (y-axis). Assuming that the main business goal for the Website is to drive up User engagement turn into conversions , We decided that the pain-points around result oriented information direct to the user’s goals were the most important to the business and users. Thus, those were the issues we scoped into our Ideal user journey that will help take better design decisions.
Conclusion (Key Findings):
