Qualitative user testing with branching logic on your web and mobile prototypes with Userlytics and Justinmind
This week we caught up with Userlytics Founder, Alejandro Rivas-Micoud, to hear about how he has harnessed the power of branching logic to bridge the gap between moderated and unmoderated remote user testing. Userlytics is a user testing tool that provides both qualitative and quantitative user testing, and is integrated with Justinmind prototyping tool.
The great thing about user testing your Justinmind prototypes is that you can simulate features in real time and get immediate feedback from users. All Justinmind users can test their prototypes directly within Userlytics in just a few clicks. To use Userlytics to test your Justinmind prototypes, you just need to head to your online account, make your prototype public, copy the URL and paste it directly into Userlytics.
We spoke to Alejandro about how to get set up with user testing within Userlytics, how to interpret and share test results, and their exclusive feature: branding logic. Check it all out below!
Qualitative user testing for mobile
Alejandro took us through a recent mobile-based user testing study, where branching logic was used during the testing.
This was a qualitative user testing process – based on observing users directly. The participant was tested with a picture in picture view, via the participant’s webcam as they followed instructions, executed tasks and answered questions.
Alejandro showed us a recording of the test and we were able to view everything that happened on the participant’s screen –and the participant, and follow them throughout the test.
So what’s the benefit of the qualitative user testing process? When you capture the screen experience of remote usability participants, and they themselves and their context (home or office), including their verbal “think aloud” commentary, you ensure that the feedback you are receiving and acting upon is based on your target persona, while interacting within your target use case.
Setting up a user test within Userlytics
Next, Alejandro explained how to get started with a user test.
The first thing you need to do is define a new user test. Once you’re settled into the tool, you can copy existing tests and change details (cloning). You can define the number of participants, length of session, and how participants will access the test (e.g. via desktop, tablet, mobile device – choose the OS – responsive web, or prototype). Next, you’ll define where the participants are going to come from. There are three options for this:
- Choose from a global panel provided by Userlytics
- Customer screener to target specific user groups
- Client or third party panel-sourced testers
Then you’ll create the questions you want to ask your participants. You can mix and match any combination of survey questions and instructions, in any order and as many as you like. You can drag and drop them directly into the testing interface. Included are specific usability testing metrics such as system usability scale (SUS) questions.
Using branching logic in your user testing process
A feature unique to Userlytics and recently launched is branching logic – a scalable user testing program combined with response & action dependent user test scripts. Each single choice instruction or question can be defined by the answer to the previous question or action with the Userlytics user testing branching logic.
Alejandro explained that it’s a bit like a choose-your-own-adventure novel. Depending on how your respondents answer certain questions, they will take different routes through your survey. You can set up conditional branching logic in single choice questions, rating questions, and success/failure question after each task.
Branches are useful when you want to send respondents down different paths in the qualitative user test. It’s a bit like building complex cases with conditions in Justinmind.
Interpreting the results of your user test
It’s really simple to download and manipulate the Userlytics results. But what really stood out for us was the fact that you can customize the test’s data so get the most out of the results.
The Userlytics team or the client can review the videos and identify the most note-worthy comments and create annotations that are automatically added to an aggregate list. Then, the client can share with colleagues who can then quickly scan down the list and locate the most interesting comments or events. They can visualize them in data, and re-watch snippets by jumping directly to that moment in the participant’s timeline.
There are tons of metrics you can measure your results by, such as net promoter score (an index that measures the willingness of customers to recommend a company’s products or services), system usability scale (10 questions framed in an alternating positive and negatively framed manner with a set of complex algorithms calculating the final score), time on task and success failure ratios.
Sharing the results of your test
Because you can create high-fidelity prototypes with Justinmind, your user testers will be able to give you valuable, realistic feedback on them and help make your product even more powerful. But what do you do with that feedback?
Once you’ve completed a test, you can download the metrics, annotations, and videos and send your colleagues and stakeholders the actual copies. Alternatively, you can provide your colleagues with access to your dashboard through an unlimited number of user accounts.
But our favorite way is with a simple link. Send a link to your team with or without a password, define the permissions that users have e.g. if they can download the videos, can access metrics, annotations, and videos. This makes it easier to get results to the right people, fast.
So what are you waiting for? Download Userlytics and start user testing your Justinmind prototypes today!