Under normal circumstances, few teams have足够的时间和资源,以尽可能多地执行众多的可用性测试. Due to recent quarantine and travel restrictions, almost all UX teams are suddenly finding thatin-person methodologies are not currently possible.

Acting under the (correct) assumption thatany user data is better than no data, many teams are turning to remote usability testing. One of the most popular variations of remote testing is unmoderated usability testing.

Unmoderated usability testing (also known as asynchronous testing) is a popular way to get a product tested by users without traveling or breaking the bank. It usually involves using one of the manyavailable services(例如用户做什么),设置一些任务, and waiting for the data to be collected.

这种方法有一些substantial benefits:

  • 没有招聘(如果您正在使用内置的面板的users that the remote-testing services provide)
  • 不需要适度技能
  • Easy test setup
  • Fast results
  • Low cost

However, the data obtained from such remote unmoderated sessions is often less detailed than that from in-person testing. This difference is accounted by theserious drawbacksunmoderated remote testing:

  • Short test sessions (the length is limited by the testing service’s rules, but usually is around 20 minutes, compared with 1–2 hours for in-person studies)
  • 不way to clarify slightly ambiguous or unclear instructions
  • Inability to ask users to elaborate on a comment or continue using an area of the design
  • 不足的测试人员
  • 参与者的动力和对测试的承诺的可变性
  • 高的chance that testers will multitask or get distracted by their environment

相比之下,remote moderated usability testingcombines the advantages of both methods (in-person and remote unmoderated): it can deliver high-quality findings (comparable to in-person testing), but is convenient and inexpensive (like remote unmoderated).The benefits of remote moderated usability testing include:

  • The facilitator may change, skip, and reordertasksas needed.
  • The facilitator mayask follow-up questions or for clarificationif needed.
  • The participant is less likely to spend time on activities unrelated to the test.
  • The situation may feel more natural than talking out loud to oneself.
  • The test sessions can be longer (usually about an hour) and leave room for in-depth exploration of a design.
  • The team can watch the test at the same time and discuss the findings immediately after the session.

We acknowledge the two most resource-intensive parts of moderated remote testing, which are:

  • Recruiting users:You can’t take advantage of a built-in panel. However, you can alsorecruit usersto match your target audience. Use arecruitment agency, your own user database if you have one,your website, social networks, and friends and family.
  • Setting up the meeting software:它可以采取额外的时间和精力来确保它适用于您的测试参与者,您的观察员和您。

Even with these hurdles, remote moderated testing is easier than most people think. Check out ourchecklist with descriptions for each step.

三个可用性测试格式相比

In-person moderated usability testing

Remote moderated usability testing

Remote unmoderated usability testing

Facilitator required

Yes

Yes

(测试平台充当辅助者)

提出具体问题的能力

Yes

Yes

(though you can set up generic followup questions after each task)

Ability to reorder or modify tasks

Yes

Yes

Ability to clarify instructions for participants

Yes

Yes

Ability to coach or encourage participant to think out loud

Yes

Yes

(虽然您可以在会话开始时指示它们)

Testing location required(for example, a usability-testing lab or focus-group facility)

Yes

Typical cost

高的

Low

Low

Session scheduling

Fixed session dates and times

Flexible session dates and times(可以根据参与者的可用性修改)

不需要安排(用户参加自己的时间)

Typical session length

Can be short(30 min)or long(2-3 hours)

Can be short(30 min)or long(2-3 hours)

Most platforms require short sessions(around 30 min)

Risk of “cheating” or unmotivated participants

Low

Low

高的(depending on how participants are recruited)

Facilitator required

In-person moderated

Yes

Remote moderated

Yes

Remote unmoderated

提出具体问题,重新订购/修改任务,澄清指令和教练参与者的能力

In-person moderated

Yes

Remote moderated

Yes

Remote unmoderated

Testing location required

In-person moderated

Yes

Remote moderated

Remote unmoderated

Typical cost

In-person moderated

高的

Remote moderated

Low

Remote unmoderated

Low

Session scheduling

In-person moderated

Fixed session dates and times

Remote moderated

Flexible session dates and times

Remote unmoderated

不需要安排

Typical session length

In-person moderated

Can be short (30 min) or long (2-3 hours)

Remote moderated

Can be short (30 min) or long (2-3 hours)

Remote unmoderated

Most platforms require short sessions (around 30 min)

Risk of “cheating” or unmotivated participants

In-person moderated

Low

Remote moderated

Low

Remote unmoderated

高的(depending on how participants are recruited)

何时使用远程审核可用性测试

If your team’s UX-research resources are severely limited, remote unmoderated usability testing may be your only option. This is often the case forquantitative usabilitystudies, which often require more than 30 participants. In such situations,remote unmoderated usability testingis certainlybetter thanusability testing.

However, remote moderated usability testing may be a better fit than remote unmoderated testing or in-person moderated testing if:

  • You wantdeep insights和rich data
  • Your participants are busy, geographically distributed, or otherwisecannot travelto a testing location
  • Your researchers haveenough time单独与每个参与者见面

Give Remote Moderated Testing a Try

远程未经寄存的测试具有福利或快速,便宜和简单。它可以得到一些很好的见解,应该是每个UX研究员工具箱的一部分。

但是,远程审核测试可以给您显着更有用,有趣,详细的发现,而不是远程未经寄存的测试。它需要a bit more coordination, but the small amount of extra effort is well worth the beneficial impact this methodology will have on your research. If you’ve never tried it, there’s no better time than now.

Full-Day Seminar on Remote Studies

For detailed help planning, conducting, and analyzing remote moderated user testing, check out our full-day seminar:Remote Usability Testing.