toggle menu

Brown Thomas Arnotts | App User Research

Understanding the expectations of the app customer.

Reading time 3 minutes

Arnotts Transactional App

Background

Since their launch, the iOS & Android apps for both brands have been hugely successful especially with a large adoption of the native applications by the brand's highly engaged customer base. With the intention of making enhancements to the apps, we wanted to better understand the goals and expectations of the customer when shopping on their phone.

The Challenge

To create a short survey and target potential participants using a direct app push message with email used if engagement is low.

In this survey we aimed to avoid certain types of questions, which required a shift in mindset by the business.

  • Asking the respondent to predict future actions
  • Asking the respondent to validate potential features, roadmaps etc.
App survey push notification
App survey push notification

My Role

I was appointed by the Head of Product to lead the UX research initiative alongside 2 senior members of the CRM team. As part of the role, I wrote the survey questions, settling on 2 separate types of customer - those that have used the app to purchase something and those that have not.

App survey questions sample
App survey questions sample

It was my aim to create a short & simple survey, with careful use of question types so that open ended questions were used in key moments. The intent of each question was also aimed at actions and recollections of experiences using the Brown Thomas | Arnotts apps along with other apps the respondent has used on their phone.

I was also responsible for analysing responses and contributing to the production of an internal report to enforce the app enhancement agenda.

The Results

The Brown Thomas push notification generated almost 3,500 survey responses over a 3 day period. However the Arnotts push had a lower engagement, at almost 800 survey responses so a retargeting using email was sent to the customer base generating a further 2,400 responses, 3,200 in total.

Satisfied with the volume of respondents, we set about analysing the data we had gathered, separating demographic & sentiment metrics from qualitative responses gathered through open ended questions. It was through these we were able to create basic categories or themes to group responses together while also being able to align these responses with the customer journey in the app.

A report was created and to be presented to key stakeholders to enhance the apps for both brands so that they can equal and hopefully surpass the customers expectations. The surveys have also identified some key areas which can be explored in greater detail using follow up surveys and user interviews.

App survey results sample
App survey results sample

The Takeaways

This initiative allowed me to work closely with my colleagues on the CRM team. This approach to a survey was a leap for them, one which they embraced and their contribution in identifying the push notification as a targeting method really helped capture highly engaged respondents.

I was given the freedom to create the questions for the survey which allowed me to focus deeply on how best to trigger a sense of recollection of experiences in their responses. I learned how to thread a dual line of questioning and the complexities it can bring.

Regarding the survey results, some interesting observations can be made, one being that customers like to browse on the app but finish the purchase journey on their laptop/desktop. Reasoning given centered around the product imagery on their phone screen not being big enough to validate their decision to purchase.