
==== Front
Digit Health
Digit Health
DHJ
spdhj
Digital Health
2055-2076
SAGE Publications Sage UK: London, England

10.1177/20552076241283245
10.1177_20552076241283245
Original Research Article
Tackling anxiety through innovation: Development and pilot study of an in-the-moment messaging intervention for young adults
https://orcid.org/0000-0003-0122-1000
Dobson Rosie 12
Stowell Melanie 3
Tane Taria 1
Gardiner Chelsey 3
McCool Judith 1
Ni Lin 3
Whittaker Robyn 12
1 School of Population Health, University of Auckland, Auckland, New Zealand
2 Evidence, Research and Clinical Trials, Te Whatu Ora, Willington, New Zealand
3 National Institute for Health Innovation, University of Auckland, Auckland, New Zealand
Rosie Dobson, School of Population Health, University of Auckland, Auckland 1023, New Zealand Email: r.dobson@auckland.ac.nz
17 9 2024
Jan-Dec 2024
10 205520762412832454 4 2024
28 8 2024
© The Author(s) 2024
2024
SAGE Publications Ltd, unless otherwise noted. Manuscript content on this site is licensed under Creative Commons Licenses
https://creativecommons.org/licenses/by-nc-nd/4.0/ This article is distributed under the terms of the Creative Commons Attribution-NoDerivs 4.0 License (https://creativecommons.org/licenses/by-nc-nd/4.0/) which permits any use, reproduction and distribution of the work as published without adaptation or alteration, provided the original work is attributed as specified on the SAGE and Open Access page (https://us.sagepub.com/en-us/nam/open-access-at-sage).
Objective

Anxiety disorders are highly prevalent around the world and are associated with significant disability, comorbidity and costs to society. Digital tools have the potential to deliver equitable, convenient and sustainable interventions for anxiety. We aimed to co-design and pilot-test an in-the-moment intervention to help young people manage anxiety. Young people with lived experience of anxiety were recruited to participate in co-design workshops with the results informing the development of the Tackling Anxiety through Innovation (TAI) intervention. TAI delivers personally tailored messaging prompting engagement in self-care behaviours at times of high anxiety/stress.

Methods

Young people aged 16 to 24 years were recruited into a four-week pilot study. Participants completed the Depression Anxiety Stress Scale – 21 Items (DASS-21) at baseline and four-week follow up, as well as a survey to assess the acceptability of the intervention and its components.

Results

Participants (n = 24) reported the intervention to be highly acceptable and useful. Participants scheduled an average of eight events over the 4 weeks. DASS-21 scores improved significantly from baseline to follow up: anxiety (mean difference 2.42 (SD = 3.65), p = 0.004), depression (3.79 (SD = 3.65), p < 0.001) and stress (3.50 (SD = 3.30), p < 0.001). Participants particularly liked the ability to personalise the messages, the timing and format of the messages, and the reminders to engage in helpful behaviours.

Conclusions

This study adds to the evidence for the use of digital tools in delivering tailored anxiety self-management support to young people. Further refinement and expansion of the intervention are needed to determine its efficacy on a larger scale.

Anxiety
mental health
digital mental health intervention
young adults
wearables
sensors
text message
self-management
The National Science Challenge: A Better Start 7022 Cure Kids https://doi.org/10.13039/501100001515 7022 typesetterts19
cover-dateJanuary-December 2024
==== Body
pmcIntroduction

Background

Anxiety disorders are the most common mental disorders globally, yet only one in four people with the condition receive treatment. 1 Anxiety disorders include generalised anxiety, panic, post-traumatic stress, specific phobias, social anxiety, agoraphobia and separation anxiety. 1 They are associated with significant disability, comorbidity and high economic costs due to their prevalence and chronic nature. 2 Half of all mental disorders start by age 14 3 and 75% by age 25. 4 Anxiety disorders with childhood onset have been associated with increased symptom severity, comorbidity and rates of suicide. 5

Young adulthood is a critical period for early mental health intervention to prevent a trajectory towards severe mental illness. 4 However, mental healthcare has traditionally been modelled on supporting adults at crisis point and does not consider the unique presentations and needs of young adults with emerging signs of mental distress.6,7 Community-based service availability varies greatly across the world, with significant gaps in access for young people. 3 Moreover, help-seeking for mental health among young people is low, with common barriers including fear of stigma, concerns about confidentiality/privacy, and low levels of knowledge about accessing support. 8

Where resources for in-person services are limited, digital interventions have potential to improve the delivery of sustainable and convenient health services, including brief interventions to support mental health.7,9–12 Mobile apps and short message service (SMS) in particular have been found to be effective and equitable methods of delivery for a number of psychological health interventions. 13 Tailored, in-the-moment solutions focused on supporting individuals to self-manage their psychological symptoms have demonstrated potential to effectively reach young adults with mild to moderate anxiety. 7 However, uptake and engagement of digital mental health services vary, 9 with prior work citing technical issues 7 as well as user concerns about privacy/anonymity, human connection, lack of personalisation, and intervention credibility. 10

Wearable devices may facilitate pragmatic interventions for anxiety via digital biofeedback methods. 14 Commercially available wearables such as wrist-worn sensors are becoming ubiquitous and can passively collect relevant data to inform wearers about physiological changes.15,16 Some of the metrics already being collected by many commercially available wearables, such as cardiac, respiratory, neurological electrical activity, body temperature and galvanic skin response, have been found to provide objective information about an individual's state of anxiety or stress response,17,18 and potentially inform intervention delivery. 7 More research is needed about the acceptability, usability and engagement in interventions leveraging commercial wearables to support young people in self-managing anxiety. 7

As part of a larger project that involved a field-testing study of commercially available wearables in the detection of anxiety and stress, we used co-design workshops with young people to develop TAI (Tackling Anxiety through Innovation), a tailored, in-the-moment SMS self-management support programme for young people with mild to moderate anxiety in Aotearoa New Zealand (NZ). This paper presents the co-design of the intervention and feasibility pilot study.

Co-design and development of the TAI intervention

The co-design and development of the TAI intervention was guided by the mHealth Development and Evaluation framework, 19 the participatory co-design cycle, 20 and two Aotearoa NZ specific Kaupapa Māori co-design approaches (summarised in Figure 1).21,22

Figure 1. TAI co-design and development process. TAI: Tackling Anxiety through Innovation.

Opportunity identification

A governance group for the broader project, Te Rōpū Kaitiaki, provided guidance. The group comprised experts in adolescent mental health (clinicians and academics), individuals with mHealth and MedTech expertise, computer science expertise, youth workers, and Māori and Pacific researchers and clinicians. The group developed a research charter which outlined the ethical and professional values and principles to guide all project activities, including the co-design and development stages of the project (see Table 1).

Table 1. Research charter principles as applied to project co-design and development.

Values/principles	Application to the co-design and development	
Te Tiriti o Waitangi	We are committed to fulfilling our obligations to Te Tiriti o Waitangi. 23 We will ensure targeted recruitment and representation of rangatahi Māori (Māori youth), we will value Mātauranga Māori (Māori knowledge systems), and co-design workshops will be Māori-led	
Equity	We will prioritise underserved and underrepresented communities in our research to support fairness and equitable health outcomes, including representation from rainbow communities (LGBTQ+), those living with a disability, and rural communities	
Research excellence	We strive for high quality, evidence-based research that positively contributes to science and knowledge for the collective benefit of society	
Translation/transformation	Our research will be innovative to promote research translation and system transformation. We will centre the workshops within communities for which translation would occur	
Equal partnership with our young people	We will establish and uphold partnerships with our young people that are built on equality, mutual respect, reciprocity and self-determination. The co-design workshops will privilege the voice, preferences and views of our young people in the development of the TAI intervention. The workshops will be held in a youth safe space	
Collective benefit	We will ensure that our research conduct will be mutually beneficial for the communities that we collaborate with. The intervention designed should be such that if effective is accessible for the communities involved in designing it. All participants will be offered a voucher for their contribution and kai (food), and will be invited to participate in pilot study	
Manaakitanga (to care for others)	We will be kind, supportive, caring and respectful to our participants, partners, collaborators and stakeholders	
Respect for data	We will collect, manage and store data safely and securely. We hold accountability to and respect for the individuals from whom the data is derived	
Integrity	We will conduct our research in a manner that is ethical, honest and transparent	
TAI: Tackling Anxiety through Innovation.

Alongside guidance from Te Rōpū Kaitiaki we undertook end-user consultation with young people and with people working directly with young people with anxiety in the community. We completed a scoping literature review to examine the role of sensors in detecting the physiological signs of anxiety to initiate and direct interventions for its management, 7 undertook work to explore available sensors, and met with sensor experts to discuss potential options for this project. The initial scoping work uncovered differing access to technology and mental health support services between urban and rural communities. Developing a solution specific to the needs and preferences of those living in urban areas may result in solutions inaccessible to those living in areas with greater digital divide and areas with more barriers to accessing mental health services – potentially exacerbating existing mental health inequities. This led to the decision to situate the co-design phase within communities with the greatest need for innovative mental health solutions.

Co-design workshops

Young adults aged 16 to 24 years who had a connection to anxiety (via lived experience or via supporting a loved one with anxiety) were invited to take part in co-design workshops held in a predominately rural region of Aotearoa NZ (Te Tai Tokerau Northland). All procedures were approved by the University of Auckland Human Participants Ethics Committee (UAHPEC24862). Co-design participants were required to provide written informed consent, communicate in English, and participate in at least one of the workshops. Friends and whānau (family) were welcome to join the participants for the focus group if they wished. Participants were given a voucher (NZD $100.00) following participation to reimburse them for their time and any costs associated with participating in the workshops. Workshops were facilitated by a local Māori researcher (TT) and supported by others on the research team. Notes and photos from the focus groups were collated and summarised (see Figure 2).

Figure 2. Images from co-design workshops.

There were two stages of workshops (see Figure 1), first focussed on knowledge generation then solution generation. Knowledge Generation: Exploration of personal experiences with anxiety, support, and technology.

Participants were first asked to briefly talk about their experiences with anxiety, or they could conceptualise and communicate their experience via drawing or writing. Participants shared both the physical and mental impacts, the exacerbation of these impacts when anxiety is not mitigated, and judgement by peers.

Participants were asked to share any thoughts or ideas relating to support or coping methods when experiencing anxiety. Participants often utilised visual and/or audio stimuli (i.e. listening to music, looking at photos, TikTok and YouTube), or relied on their key support people (whānau, friends and therapists) and their spirituality. When asked about things that are unhelpful, participants cited people who have a lack of understanding about anxiety and those who pressure a person with anxiety into anxious situations.

Finally, participants were asked to share ideas regarding digital support to help young people experiencing anxiety. Participants stated that they knew when and where they would potentially experience anxiety and that a digital solution that helped them to better prepare for anxiety-provoking events ahead of time would be beneficial as it would allow them to proactively engage in coping methods before anxiety starts. Participants suggested that supportive messages or prompts from their mobile phone may be an effective way to achieve this.

Solution generation: Exploration of potential solutions, including function and content, and the insights discussed in workshop 1 were presented and participants discussed the ideas proposed. Overall, participants were highly supportive of a potential solution that provided personalised support messaging, or prompts delivered in critical moments. Participants also supported the ability to pre-plan support message delivery for situations or events where they might feel anxious. Although most participants were not current wearers of sensors, they responded positively to the inclusion of a wearable sensor in the intervention. Timing and frequency of messages were also key as participants cautioned against sending too many messages and potentially causing disruption or exacerbation of anxiety. Participants also highlighted the importance of personalisation, taking into account that anxiety-provoking situations will be different for everyone. Further considerations included being mobile-friendly and positive framing of intervention content.

Initial prototype development

Insights from the first two workshops elucidated a potential digital solution to support young people experiencing anxiety in real time: a digital platform that allowed users to schedule anxiety-provoking events into a calendar, then receive supportive personalised text messages prior to the event. Initial wireframes were developed using Figma, and a message library drafted.

Protype review and refinement

The initial wireframes for the TAI platform and messages were reviewed by co-design participants via online meetings with the co-design facilitator. The co-design facilitator presented the wireframes and described the intention and function. Participants preferred a solution that emphasised positive/healthy actions they could take (rather than discourage coping strategies that might be unhealthy) and were personalised to an individual's preferred methods of coping. Participants also preferred strategies that were easy to act on (e.g. going for a walk or listening to music) and were culturally appropriate. This feedback was incorporated into the final TAI intervention.

TAI intervention

TAI was developed to provide in-the-moment self-management support for young adults with mild to moderate anxiety. The content was developed by a multidisciplinary team, led by a health psychologist (RD) and a Māori health researcher (TT). Content was informed by the co-design workshop findings alongside learnings from the previous messaging programmes.24,25 A library of simple, tailored text messages was developed to support in-the-moment anxiety management, providing general encouragement with helpful sayings, prompting outreach to helpful individuals, and suggesting stress-relieving activities that were identified during the co-design process. Each participant would receive two text messages in the hour leading up to a potentially stressful event (45 minutes and 15 minutes prior) to allow enough time to read the messages and act on them without interfering with the event itself.

To accommodate personal preferences and cultural characteristics, a bespoke in-house online platform collected participants’ preferred name, ethnic background, names of two supportive individuals, three helpful activities and four helpful sayings. In New Zealand, there are ethnic disparities in rates of mental health problems and in access to culturally aligned services. 26 To ensure relevance to these populations, messages included key greetings and words in Te Reo Māori (Māori language) and other common Pacific language greetings spoken in New Zealand, although messages remained predominantly in English. For helpful activities and sayings, participants could choose from a list of pre-populated options or create their own. Examples of TAI message components can be seen in Table 2. Customised responses were reviewed by a researcher for grammatical correctness and inappropriate language. All preferences were used to populate a schedule of tailored messages to be delivered by SMS in the hour before each stressful event.

Table 2. TAI text message examples.

Message timing	Personalisation components	Participant culture	Example text message	
45 minutes prior to scheduled stressful event	Greeting, name, activity, support person	Māori	Kia ora Hemi. If you are feeling stressed and anxious, why not call or text James or take time to do some meditation or connect with your tūpuna	
Greeting, name, activity, support person	Other	Hi Lily. It might help to plan a workout or listen to some music. Remember [support name] is here for you	
15 minutes prior to scheduled stressful event	Greeting, name, saying 1, saying 2	Samoan	Talofa Sam. Remember to try and focus your attention on the things you can control, and remember you are not alone!	
Māori	Kia ora Hemi. Remember your mana. You are strong and will get through this!	
TAI: Tackling Anxiety through Innovation.

The TAI platform also included a tool for participants to schedule the days and times of any upcoming events they thought could be stressful or anxiety-inducing. Participants could schedule as many events as they wished during the four-week study period. Messages for the first 12 events were unique in the combination of helpful sayings, activities and people they included, and then repeated for any subsequent events. The TAI platform was connected to an in-house system designed to send and receive messages through a message gateway company for delivery to any mobile phone registered with a New Zealand mobile network. Once a participant scheduled an event in the TAI platform message schedules were populated dictating the specific messages and their delivery time. The project team had the ability to review and edit scheduled messages if needed. A participant could stop their messages at any time by replying with the word ‘STOP’, which automatically cancelled all remaining messages on their schedule. The system was designed to maintain logs of all outgoing and incoming messages. There was no cost to participants to receive or reply to messages.

At the outset of the larger project, our aim was to identify a consumer wearable that could accurately detect heightened stress and anxiety as it occurs and develop an intervention that could be implemented simultaneously. In our field testing of existing consumer wearables, we identified a number of issues which have been published elsewhere 27 and full findings will be published separately. In the absence of a consumer-grade wearable that we could confidently use to meet this aim, we restricted to testing the feasibility and acceptability of young people wearing a commercially available sensor alongside our TAI programme. We chose to offer participants the opportunity to use a commonly available smartwatch (Fitbit Inspire series) or to continue wearing their own smartwatch. Participants were encouraged to wear their device as much as possible during the four-week study period, including overnight.

Feasibility, acceptability and perceived impacts of the TAI intervention

The feasibility, acceptability and perceived impacts of the TAI intervention were assessed in a pilot study.

Methods

Study design

A four-week, non-randomised pilot study was conducted between August and November 2023. All study documents and procedures were approved by the University of Auckland Human Participants Ethics Committee (UAHPEC26054).

Participants and recruitment

Eligibility criteria for the pilot study included young adults aged 16 to 24 years, ability to communicate in English, daily access to a smartphone and the internet, ability to provide informed consent, mild to moderate anxiety based on responses to the Depression Anxiety Stress Scales – 21 Items (DASS-21). 28 The only reasons for exclusion aside from the above criteria were not being available for the duration of the four-week pilot study and not having an Aotearoa NZ mobile number. A list of local and national mental health resources, crisis hotlines and service providers was provided to anyone who registered interest in the study.

Recruitment occurred via flyers distributed through universities and community organisations in Tāmaki Makaurau Auckland and Te Tai Tokerau Northland, Aotearoa NZ. Potential participants could access the online participant information and consent form directly (hosted in REDCap 29 ) or request that a research assistant contact them to provide assistance. All participants provided written informed consent electronically before participating. Participants who agreed to take part were contacted for their intervention preferences and to schedule a time for onboarding (TAI platform and Fitbit account setup). Participants were given two NZD $50 vouchers (one at enrolment and one at follow-up completion).

Measures

Baseline measures included demographics and DASS-21 scores. The DASS-21 is a widely used and publicly available assessment instrument for depression, anxiety and stress. 28 At the end of the four-week intervention all participants were asked to complete a final web-based survey in REDCap which included the DASS-21 and questions about their satisfaction with the programme and Fitbit, their usefulness and usability, and perceived impacts. Intervention preferences were obtained through the system recorded data in the TAI platform.

Analysis

Descriptive statistics were calculated for baseline demographic and mental health characteristics, intervention preferences and measures of self-reported engagement with the programme. Counts and percentages were reported for categorical variables and means and standard deviations for continuous variables. Qualitative comments were analysed using a simple content analysis approach to identify common themes and insights from the data. Change in mean DASS-21 score from baseline to four-week follow up was calculated using a paired t-test.

Results

Seventy-two individuals clicked on the study link with 31 (43%) being eligible to participate. Of the 31, 26 completed consent and 25 went on to enrol in the study. Of the 25 enrolled, one withdrew before commencing participation, leaving a total of 24 participants. Table 3 presents the characteristics of the pilot study participants at baseline.

Table 3. Pilot sample characteristics.

	n (%)	
Ethnicity a	
 Māori	4 (17)	
 Asian	7 (29)	
 European	15 (63)	
Age; years (mean, SD, range)	19.6, 2.55, 16–24	
Gender (female)	18 (75)	
Location	
 Auckland/Tāmaki Makaurau	15 (63)	
 Northland/Te Tai Tokerau	7 (29)	
 Other	2 (8)	
Employment status	
 Employed	4 (17)	
 Student	20 (83)	
a Multiple output method.

Engagement and usability

Participants scheduled an average of eight events over the four-week study (range = 2–26) with an average of 19 messages sent per participant (range = 4–58). When asked how many messages they read, 22 (92%) reported reading most or all the messages (14 = all, 8 = most). For those that did not read all the messages (n = 10), the most common reason was that they were too busy (n = 6) or that they were unhelpful (n = 5).

Four participants reported issues including that the platform sometimes didn’t load, wouldn’t let them delete events, they did not have their phones accessible at the time of the messages, or they didn’t always know the timing of events so couldn’t schedule them. Three participants identified issues with the messages including that some messages didn’t make sense or were not received.

All participants opted to wear a study Fitbit. During the daytime, two-thirds (n = 16; 67%) reported wearing their sensor all day, with the remaining wearing it most of the day (n = 5; 21%), or a few hours per day (n = 3, 13%). Similarly, over two-thirds (n = 17; 71%) reported wearing it at night. The most common reasons for not wearing it all the time were that they forgot (n = 6) or that they found it annoying or uncomfortable (n = 5). When asked how often they checked the information available on the sensor (e.g. step count, sleep and heart rate), 18 (75%) reported checking it multiple times a day, four (17%) once a day, and the remaining two (8%) participants reported not checking it at all.

When asked what they thought about the Fitbit overall, responses were largely positive, referring to the usefulness of the information being tracked, ease of use and convenience of being able to see messages without needing to take out a phone. ‘It was definitely useful to be able to see the TAI texts without having to take out my phone, especially when I was in a setting where taking out my phone was inappropriate’. – Participant ID:13

When asked what they liked about wearing the sensor, participants mostly endorsed the ability to see how their heart rate changed during moments of stress/calm, track their steps and sleep, and see patterns over time. Participants also liked the watch's ease of use, lightweight/thin profile and long battery life.‘I liked that it was quite small and I forget that it is on my wrist sometimes and has a really long battery life so I didn't have to charge it very often’. – Participant ID:37

‘The sensor felt like a normal watch and didn't feel like I was “hooked up” to a scientific machine analysing my heartbeat like hospitals do. It was nice to access all the information on my wrist at any time’. – Participant ID:61

When asked what they disliked about wearing the sensor, participants mostly commented on discomfort, particularly when wearing all day or while sleeping. The watch's notifications (such as reminders to move) could also be unhelpful. Only four participants reported technical issues with the sensor including issues with charging, display glitches, data inaccuracies and issues with syncing.

Acceptability

All participants reported they would recommend TAI to others with anxiety (n = 24; 100%) and all but one participant (n = 23; 96%) reported that they would use a programme like TAI again in the future. Free text responses about thoughts on TAI were largely positive.‘I think the messages of encouragement/positive messages were real helpful to make you sit back and take a breather. that we're just human at the end of the day. I really appreciated them’. – Participant ID:1

‘The TAI programme reminded me that I had people I could talk to in order to help manage my anxiety and this really helped me when I was feeling overwhelmed and worried’. – Participant ID:36

Regarding the TAI messages, participants reported that they liked their timing leading up to an event, the reassurance that everything would be okay, and the ability to receive this support remotely and anonymously.‘…it was like getting a message from a friend and I found that quite comforting because sometimes all I wanted was a little help without having to talk to someone’. – Participant ID:19

When asked what they disliked about the messages, participants described a lack of variety in the messages/content and advice that was too generic or impractical. When asked what messages they found particularly helpful participants noted the positive framing and the tailored elements such as their chosen activities or people.‘The personalisation process made all the messages valuable and more impactful when I got them’. – Participant ID:61

‘The beneficial messages were the ones that gave me tips, such as listening to music or going for a short walk’. – Participant ID:61

Three-quarters (n = 18) of participants reported that the timing of the message delivery was helpful and appreciated. For some it appeared that the messages closest to the event were most useful whereas others liked receiving them earlier.‘It was good to have them multiple times, not too close to the event’. – Participant ID:48

‘The timing of the messages was helpful as 15 minutes beforehand was generally enough time to calm myself down without elapsing enough time to become stressed yet again. However, I sometimes did not find the 45-minute beforehand message as helpful as my mind was oftentimes focused on another task’. – Participant ID:13

For the one-quarter who reported the timing was not always helpful, reasons included that they sometimes reminded them of their stress or increased their stress/anxiety when they were not thinking about it. When asked if there was a better time to receive the messages, suggestions were to send them at unplanned/unscheduled stressful times, or after stressful events to offer praise, encourage reflection, or be a pick-me-up if they hadn’t gone well.

Perceived impacts

Participants were asked whether they felt the TAI messages had impacted them. Most provided positive responses, commonly reporting that it had increased their awareness of their mental state and what they can do to support their mental health.‘I think it had a bit of an impact on my thinking in anxious situations. It made me stop and think and I feel like I can carry on that skill’. – Participant ID:4

‘It has reminded me to take time for myself in stressful situations’. – Participant ID:49

Only a few participants reported that TAI hadn’t impacted them, but commented that they had still enjoyed participating or could see it helping others.

Over half of participants (n = 14; 58%) reported the intervention prompted behaviour change. Most reported the messages made them pause and remember to breathe or engage in helpful behaviours. Some participants gave specific details of how TAI had positively impacted them.‘Since starting this study I've gotten my first job and that was something that I was very excited to start but as someone with anxiety it can be hard to be around people and receiving the messages made me push myself and open up more’. – Participant ID:19

Some participants described noticing the changes in their heart rate on their Fitbit when they were stressed or anxious and used this information to try and alleviate the stress.‘It helped me see what situations raised my heart rate, linking these events to my stress and anxiety. Plus it helped me monitor my exercise and allowed me to link this as a beneficial tool to aid and target my anxiety and stress’. – Participant ID:61

DASS-21

There was a significant decrease on all three subscales of the DASS-21 between baseline and 4-week follow up (Table 4): anxiety (mean difference 2.42 (SD = 3.65), p = 0.004), depression (mean difference = 3.79 (SD = 3.65), p < 0.001) and stress (mean difference = 3.50 (SD = 3.30), p < 0.001).

Table 4. DASS-21 scores from baseline to follow up.

DASS-21	Baseline	Follow up			
Mean	SD	Mean	SD	t	p	
Anxiety	10.21	2.021	7.79	4.180	3.247	0.004	
Stress	12.04	2.629	8.54	3.501	5.201	<0.001	
Depression	9.38	3.987	5.58	2.873	5.093	<0.001	
DASS-21: Depression, Anxiety Stress Scales – 21 Items.

Suggestions for improvement

When asked about how else to support young adults with managing stress/anxiety, participants suggested offering linkage to more support, such as alerting a family member, an interactive app with guided breathing activities or counselling services. They suggested providing options to receive support at times of unexpected spikes in anxiety and reiterated the need for more variety and personalisation.‘Maybe have an option if your heart rate is increased to notify a family member that there is a stressful event taking place so that they can reassure you in a more personal way’. – Participant ID:67

Discussion

This study sought to co-design and pilot test an in-the-moment intervention to support young people with anxiety. Our results showed that participants largely found that TAI, with simultaneous use of a commercially available sensor, was an acceptable and potentially useful tool in the self-management of mild to moderate anxiety. Perceived positive impacts of TAI were supported by a significant improvement in DASS-21 scores at follow up. These findings align with previous mHealth-based mental health interventions 13 and interventions using sensors in the management of anxiety. 7

Further evidence of the acceptability of TAI was found in the follow-up surveys, with all participants saying they would recommend the intervention to other people with anxiety and 92% stating they had read all or most of the intervention messages. Participants ranged in age from 16 to 24 years and nearly half (46%) identified as being of Māori or Asian descent. Nearly one-third were from Northland, New Zealand's most rural region. These participant characteristics indicate that this type of intervention has the potential to reach people of diverse backgrounds living with anxiety.

Most participants endorsed the content of the messages and reported behaviour changes in the moments before a stressful event, suggesting the ability to tailor content to meet their coping preferences was useful. The ability to personalise content has been highlighted as an important element in digital mental health interventions for young people. 10

Although the use of the sensor did not play a direct role in the TAI intervention, participants largely endorsed wearing a sensor throughout the four-week study, with two-thirds stating they wore their Fitbit all day and nearly three-quarters (71%) wearing it all night. Most said they checked the sensor information at least a few times a day and found it useful. While the use of sensors was acceptable to participants in this study, given the challenges we experienced in using commercially available sensors to detect anxiety in the moment, 27 more research is needed to understand the viability of using them as part of an intervention. Moreover, while participants in our study could use a Fitbit at no cost, the price of these devices may be a barrier to widespread adoption in real-world settings. 30

Strengths of the TAI programme included that it was co-designed with members of the target population; that it was personally and culturally tailored; and that it used simple, remotely accessible technology which extended its reach outside the urban environment. TAI was designed for individuals with mild to moderate anxiety, addressing a gap in current mental health services. While the study was conducted in Aotearoa NZ, our findings may be useful to inform research in other contexts, as young people's acceptance of these types of interventions is not widely reported in the current literature.

Limitations of this study included the absence of a control group, small sample size and short study and follow-up timeframe, meaning the significant improvements we saw in participants’ DASS-21 scores must be interpreted with caution. Only one-quarter of participants identified as male and none identified as gender non-binary. Participants also varied in the number of stressful events they scheduled (ranging from two to 26), meaning a potentially high degree of variability in participants’ experience of TAI. While only one participant reported that the TAI programme increased their anxiety, more work is needed to understand the characteristics that make young people more or less likely to benefit from this type of intervention. A larger sample size and longer-term randomised controlled trial will be needed to understand the efficacy of TAI on self-management behaviours, clinical outcomes, sustainability and cost-effectiveness. Moreover, safely extending the intervention to young people with severe anxiety should be explored to ensure all service gaps are being addressed.

Conclusions

It is important that researchers ensure that mental health tools are developed to specifically address inequities in access to mental health support and in mental health outcomes. Further, they should be developed with implementation in mind ensuring that findings can be translated into practice. This project had a focus on equity from the start, leading to utilisation of simple and accessible technology (e.g. text messaging), and our findings support continued use of text messaging in mHealth research. This study adds to the evidence for the use of digital tools in delivering tailored anxiety self-management support to young people. In particular, the use of SMS in intervention delivery and wearing a wrist-worn sensor were found to be acceptable by young people experiencing mild to moderate anxiety. Further refinement and expansion of the intervention is needed to determine its efficacy on a larger scale.

Acknowledgements

The authors wish to acknowledge all the participants who contributed and participated in this work. We also would like to acknowledge the staff of NIHI, in particular Elaine Umali, Peter Tsai, Derek Park and Cielo Alexandra Rengifo, for supporting the development of the TAI platform and project management. Finally, we would like to acknowledge the TAI project Te Rōpū Kaitiaki members.

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Ethical approval: All study documents and procedures were approved by the University of Auckland Human Participants Ethics Committee (Pilot study UAHPEC26054; Co-design UAHPEC24862) and adhered to the National Ethical Standards for Health and Disability Research and Quality Improvement.

Guarantor: RD

Funding: This study was funded by the New Zealand Ministry of Business, Innovation & Employment (MBIE) National Science Challenge ‘A Better Start’ and Cure Kids project grant (#7022).

ORCID iD: Rosie Dobson https://orcid.org/0000-0003-0122-1000
==== Refs
References

1 World Health Organisation. Anxiety disorders. Geneva, Switzerland: World Health Organisation, 2023. [cited 2024 8 January]; Available from: https://www.who.int/news-room/fact-sheets/detail/anxiety-disorders.
2 Alonso J Liu Z Evans-Lacko S , et al. Treatment gap for anxiety disorders is global: results of the World Mental Health Surveys in 21 countries. Depress Anxiety 2018; 35 : 195–208. PMID: 29356216.29356216
3 Colizzi M Lasalvia A Ruggeri M . Prevention and early intervention in youth mental health: is it time for a multidisciplinary and trans-diagnostic model for care? Int J Ment Health Syst 2020; 14 : 23.32226481
4 McGorry PD Mei C . Early intervention in youth mental health: progress and future directions. Evid Based Ment Health 2018; 21 : 182–184. PMID: 30352884.30352884
5 Lijster JMD Dierckx B Utens EMWJ , et al. The age of onset of anxiety disorders: a meta-analysis. Can J Psychiatry 2016; 62 : 237–246.27310233
6 Fusar-Poli P . Integrated mental health services for the developmental period (0 to 25 years): a critical review of the evidence. Front Psychiatry 2019; 10 . DOI: 10.3389/fpsyt.2019.00355.
7 Dobson R Li LL Garner K , et al. The use of sensors to detect anxiety for in-the-moment intervention: scoping review. JMIR Ment Health 2023; 10 : e42611. PMID: 36729590.
8 Gulliver A Griffiths KM Christensen H . Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatry 2010; 10 : 13.20122265
9 Fleming T Bavin L Lucassen M , et al. Beyond the trial: systematic review of real-world uptake and engagement with digital self-help interventions for depression, low mood, or anxiety. J Med Internet Res 2018; 20 : e199. PMID: 29875089.
10 Liverpool S Mota CP Sales CMD , et al. Engaging children and young people in digital mental health interventions: systematic review of modes of delivery, facilitators, and barriers. J Med Internet Res 2020; 22 : e16317. PMID: 32442160.
11 Schueller SM Aguilera A Mohr DC . Ecological momentary interventions for depression and anxiety. Depress Anxiety 2017; 34 : 540–545.28494123
12 Tozzi F Nicolaidou I Galani A , et al. eHealth interventions for anxiety management targeting young children and adolescents: exploratory review. JMIR Pediatr Parent 2018 May 10; 1 : e5.
13 Rathbone AL Prescott J . The use of mobile apps and SMS messaging as physical and mental health interventions: systematic review. J Med Internet Res 2017; 19 : e295.
14 Alneyadi M Drissi N Almeqbaali M , et al. Biofeedback-based connected mental health interventions for anxiety: systematic literature review. JMIR Mhealth Uhealth 2021; 9 : e26038.
15 Welch V Wy TJ Ligezka A , et al. Use of mobile and wearable artificial intelligence in child and adolescent psychiatry: scoping review. J Med Internet Res 2022; 24 : e33560. PMID: 35285812.
16 Ahmed A Aziz S Alzubaidi M , et al. Wearable devices for anxiety & depression: a scoping review. Comput Methods Programs in Biomed Update 2023; 3 : 100095. PMID: 36743720.
17 Hyde J Ryan KM Waters AM . Psychophysiological markers of fear and anxiety. Curr Psychiatry Rep 2019; 21 : 56. PMID: 31161250.31161250
18 Chesnut M Harati S Paredes P , et al. Stress markers for mental states and biotypes of depression and anxiety: a scoping review and preliminary illustrative analysis. Chronic Stress 2021; 5 : 24705470211000338. PMID: 33997582.33997582
19 Whittaker R Merry S Dorey E , et al. A development and evaluation process for mHealth interventions: examples from New Zealand. J Health Commun 2012; 17 : 11–21.22548594
20 Bratteteig T Bødker K Dittrich Y , et al. Methods: organising principles and general guidelines for participatory design projects. In: Simonsen J Robertson T (eds) Routledge International handbook of participatory design. Abingdon-on-Thames, UK: Routledge, 2012, pp.117–144.
21 Rolleston AK Bowen J Hinze A , et al. Collaboration in research: weaving Kaupapa Māori and computer science. AlterNative: Int J Indig Peoples 2021; 17 : 469–479.
22 Morenga L T Pekepo C Corrigan C , et al. Co-designing an mHealth tool in the New Zealand Māori community with a “Kaupapa Māori” approach. AlterNative: Int J Indig Peoples 2018; 14 : 90–99.
23 Orange C. Te Tiriti o Waitangi – the Treaty of Waitangi. 2023 [cited 2024 13 February]; Available from: https://teara.govt.nz/en/te-tiriti-o-waitangi-the-treaty-of-waitangi/print.
24 Whittaker R Dobson R Candy S , et al. Mobile pulmonary rehabilitation: feasibility of delivery by a mobile phone-based program. Front Comput Sci 2021; 3 : 546960. DOI: 10.3389/fcomp.2021.546960.
25 Dobson R Whittaker R Jiang Y , et al. Effectiveness of text message based, diabetes self management support programme (SMS4BG): two arm, parallel randomised controlled trial. Br Med J 2018; 361 : k1959.
26 Mental Health and Addiction Inquiry. He Ara Oranga : Report of the Government Inquiry into Mental Health and Addiction. Wellington, New Zealand: Mental Health and Addiction Inquiry, 2018. Available from: https://mentalhealth.inquiry.govt.nz/inquiry-report/he-ara-oranga/.
27 Dobson R Stowell M Warren J , et al. Use of consumer wearables in health research: issues and considerations. J Med Internet Res 2023; 25 : e52444.
28 Antony MM Bieling PJ Cox BJ , et al. Psychometric properties of the 42-item and 21-item versions of the depression anxiety stress scales in clinical groups and a community sample. Psychol Assess 1998; 10 : 176–181.
29 Harris PA Taylor R Thielke R , et al. Research electronic data capture (REDCap) – a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009; 42 : 377–381. PMID: 18929686.18929686
30 Zinzuwadia A Singh JP . Wearable devices – addressing bias and inequity. Lancet Digital Health 2022; 4 : e856–e8e7.
