Evaluate

Evaluation, from part solutions to live delivery, provides the confidence all organisations need, and with millions of people tested in blind studies on most of the countries in the world we often build this into our human centred design offerings.

 These are some of the tools and techniques we have developed to evaluate human-centered design decisions.

Randomised controlled trials & pilots

Randomised Control Trials (RCTs) or A/B tests are the best way to deliver provable, repeatable, tested communication changes, at-scale. In their simplest form, an RCT involves evaluating interventions by comparing them to a control.

The randomisation component ensures bias is minimised, making RCTs one of the most rigorous experimental designs on offer.Randomised Control Trials (RCTs) have typically been used to evaluate medical interventions, and frequently employed by us (behavioural scientists) to determine the success of behavioural nudges.

Last year alone we tested on over four and half million people in trials blind to them, in over 40 countries with subscriptions, emails, text messages, and printed letters. All those results are robust and provable and provide an incredible end-solution or beginning-foundation for our clients.


The ABC of RCTs January 29th, 2019

Themes & directions

We don’t all share the same model of the world around us. Even when we do, it can be hard for an individual to explain their own implicit mental model. Divining this is a skill that goes beyond what is said, and delves into how – ultimately affects how questions are framed.

We understand how to interpret the fluent and disfluent responses, and what that means for themes that emerge in qualitative research.

Scoresheets by The Hunting Dynasty

A periodic (e.g. quarterly) review of key comms and customer pathway work ‘scored’ for its use of behavioural techniques by us, and reported back to staff and management giving our view on the correct selection of techniques, and the quality of execution in comms work for management to have data on comms outputs.

Great to embed behavioural techniques in an organisation.