Young People's Satisfaction With the Online Mental Health Service eheadspace

Development and Implementation of a Service Satisfaction Measure

Debra RICKWOOD, Alison Wallace, Vanessa Kennedy, Shaunagh O'Sullivan, Nic Telford, Stephen Leicester

Research output: Contribution to journalArticle

4 Downloads (Pure)

Abstract

Background: Online youth mental health services are an expanding approach to meeting service need and can be used as the first step in a stepped-care approach. However, limited evidence exists regarding satisfaction with online services, and there is no standardized service satisfaction measure.
Objective: This study implemented an online youth mental health service satisfaction questionnaire within eheadspace, an online youth mental health service. The aims were to test the questionnaire’s psychometric properties and identify current levels of satisfaction among service users, as well as to identify client and service contact characteristics that affect satisfaction. Methods: Data were collected from 2280 eheadspace clients via an online questionnaire advertised and accessed through the eheadspace service platform between September 2016 and February 2018. Client and service contact characteristics, potential outcomes, and session and service feedback data were collected.
Results: The service satisfaction questionnaire demonstrated high internal consistency for the overall satisfaction scale (alpha=.95) and its three subscales: session satisfaction, potential outcomes, and service satisfaction. A three-factor model was the best fit to the data, although including a higher order unidimensional construct of overall satisfaction was also a reasonable fit. Overall, young people were very satisfied with eheadspace (mean 3.60, SD 0.83). Service characteristics, but not client characteristics, were significantly associated with satisfaction. Young people were more satisfied with eheadspace when they had greater engagement as evident through receiving esupport rather than briefer service provision, having a longer session and greater interaction with the clinician, and not previously attending a face-to-face headspace center.
Conclusions: The online youth mental health service satisfaction questionnaire developed for and implemented in eheadspace showed good psychometric properties. The measure is brief, has good internal consistency, and has a clear factor structure. The measure could be adapted for use in other online youth mental health services. The young people using eheadspace and completing
the feedback survey were highly satisfied. Greater engagement with the online service was shown to be associated with greater satisfaction. No specific client demographic groups were shown to be more or less satisfied.
Original languageEnglish
Article numbere12169
Pages (from-to)1-13
Number of pages13
JournalJMIR Mental Health
Volume6
Issue number4
DOIs
Publication statusPublished - 17 Apr 2019

Fingerprint

Mental Health Services
Psychometrics
Surveys and Questionnaires
Demography

Cite this

RICKWOOD, Debra ; Wallace, Alison ; Kennedy, Vanessa ; O'Sullivan, Shaunagh ; Telford, Nic ; Leicester, Stephen. / Young People's Satisfaction With the Online Mental Health Service eheadspace : Development and Implementation of a Service Satisfaction Measure. In: JMIR Mental Health. 2019 ; Vol. 6, No. 4. pp. 1-13.
@article{39c32c49a6b3453198a463e2534601c6,
title = "Young People's Satisfaction With the Online Mental Health Service eheadspace: Development and Implementation of a Service Satisfaction Measure",
abstract = "Background: Online youth mental health services are an expanding approach to meeting service need and can be used as the first step in a stepped-care approach. However, limited evidence exists regarding satisfaction with online services, and there is no standardized service satisfaction measure.Objective: This study implemented an online youth mental health service satisfaction questionnaire within eheadspace, an online youth mental health service. The aims were to test the questionnaire’s psychometric properties and identify current levels of satisfaction among service users, as well as to identify client and service contact characteristics that affect satisfaction. Methods: Data were collected from 2280 eheadspace clients via an online questionnaire advertised and accessed through the eheadspace service platform between September 2016 and February 2018. Client and service contact characteristics, potential outcomes, and session and service feedback data were collected.Results: The service satisfaction questionnaire demonstrated high internal consistency for the overall satisfaction scale (alpha=.95) and its three subscales: session satisfaction, potential outcomes, and service satisfaction. A three-factor model was the best fit to the data, although including a higher order unidimensional construct of overall satisfaction was also a reasonable fit. Overall, young people were very satisfied with eheadspace (mean 3.60, SD 0.83). Service characteristics, but not client characteristics, were significantly associated with satisfaction. Young people were more satisfied with eheadspace when they had greater engagement as evident through receiving esupport rather than briefer service provision, having a longer session and greater interaction with the clinician, and not previously attending a face-to-face headspace center.Conclusions: The online youth mental health service satisfaction questionnaire developed for and implemented in eheadspace showed good psychometric properties. The measure is brief, has good internal consistency, and has a clear factor structure. The measure could be adapted for use in other online youth mental health services. The young people using eheadspace and completingthe feedback survey were highly satisfied. Greater engagement with the online service was shown to be associated with greater satisfaction. No specific client demographic groups were shown to be more or less satisfied.",
keywords = "mental health, adolescent, telemedicine, counseling, internet, satisfaction, feedback, telehealth, young people",
author = "Debra RICKWOOD and Alison Wallace and Vanessa Kennedy and Shaunagh O'Sullivan and Nic Telford and Stephen Leicester",
year = "2019",
month = "4",
day = "17",
doi = "10.2196/12169",
language = "English",
volume = "6",
pages = "1--13",
journal = "JMIR Mental Health",
issn = "2368-7959",
number = "4",

}

Young People's Satisfaction With the Online Mental Health Service eheadspace : Development and Implementation of a Service Satisfaction Measure. / RICKWOOD, Debra; Wallace, Alison; Kennedy, Vanessa; O'Sullivan, Shaunagh; Telford, Nic; Leicester, Stephen.

In: JMIR Mental Health, Vol. 6, No. 4, e12169, 17.04.2019, p. 1-13.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Young People's Satisfaction With the Online Mental Health Service eheadspace

T2 - Development and Implementation of a Service Satisfaction Measure

AU - RICKWOOD, Debra

AU - Wallace, Alison

AU - Kennedy, Vanessa

AU - O'Sullivan, Shaunagh

AU - Telford, Nic

AU - Leicester, Stephen

PY - 2019/4/17

Y1 - 2019/4/17

N2 - Background: Online youth mental health services are an expanding approach to meeting service need and can be used as the first step in a stepped-care approach. However, limited evidence exists regarding satisfaction with online services, and there is no standardized service satisfaction measure.Objective: This study implemented an online youth mental health service satisfaction questionnaire within eheadspace, an online youth mental health service. The aims were to test the questionnaire’s psychometric properties and identify current levels of satisfaction among service users, as well as to identify client and service contact characteristics that affect satisfaction. Methods: Data were collected from 2280 eheadspace clients via an online questionnaire advertised and accessed through the eheadspace service platform between September 2016 and February 2018. Client and service contact characteristics, potential outcomes, and session and service feedback data were collected.Results: The service satisfaction questionnaire demonstrated high internal consistency for the overall satisfaction scale (alpha=.95) and its three subscales: session satisfaction, potential outcomes, and service satisfaction. A three-factor model was the best fit to the data, although including a higher order unidimensional construct of overall satisfaction was also a reasonable fit. Overall, young people were very satisfied with eheadspace (mean 3.60, SD 0.83). Service characteristics, but not client characteristics, were significantly associated with satisfaction. Young people were more satisfied with eheadspace when they had greater engagement as evident through receiving esupport rather than briefer service provision, having a longer session and greater interaction with the clinician, and not previously attending a face-to-face headspace center.Conclusions: The online youth mental health service satisfaction questionnaire developed for and implemented in eheadspace showed good psychometric properties. The measure is brief, has good internal consistency, and has a clear factor structure. The measure could be adapted for use in other online youth mental health services. The young people using eheadspace and completingthe feedback survey were highly satisfied. Greater engagement with the online service was shown to be associated with greater satisfaction. No specific client demographic groups were shown to be more or less satisfied.

AB - Background: Online youth mental health services are an expanding approach to meeting service need and can be used as the first step in a stepped-care approach. However, limited evidence exists regarding satisfaction with online services, and there is no standardized service satisfaction measure.Objective: This study implemented an online youth mental health service satisfaction questionnaire within eheadspace, an online youth mental health service. The aims were to test the questionnaire’s psychometric properties and identify current levels of satisfaction among service users, as well as to identify client and service contact characteristics that affect satisfaction. Methods: Data were collected from 2280 eheadspace clients via an online questionnaire advertised and accessed through the eheadspace service platform between September 2016 and February 2018. Client and service contact characteristics, potential outcomes, and session and service feedback data were collected.Results: The service satisfaction questionnaire demonstrated high internal consistency for the overall satisfaction scale (alpha=.95) and its three subscales: session satisfaction, potential outcomes, and service satisfaction. A three-factor model was the best fit to the data, although including a higher order unidimensional construct of overall satisfaction was also a reasonable fit. Overall, young people were very satisfied with eheadspace (mean 3.60, SD 0.83). Service characteristics, but not client characteristics, were significantly associated with satisfaction. Young people were more satisfied with eheadspace when they had greater engagement as evident through receiving esupport rather than briefer service provision, having a longer session and greater interaction with the clinician, and not previously attending a face-to-face headspace center.Conclusions: The online youth mental health service satisfaction questionnaire developed for and implemented in eheadspace showed good psychometric properties. The measure is brief, has good internal consistency, and has a clear factor structure. The measure could be adapted for use in other online youth mental health services. The young people using eheadspace and completingthe feedback survey were highly satisfied. Greater engagement with the online service was shown to be associated with greater satisfaction. No specific client demographic groups were shown to be more or less satisfied.

KW - mental health

KW - adolescent

KW - telemedicine

KW - counseling

KW - internet

KW - satisfaction

KW - feedback

KW - telehealth

KW - young people

UR - http://www.mendeley.com/research/young-peoples-satisfaction-online-mental-health-service-eheadspace-development-implementation-servic

UR - http://www.scopus.com/inward/record.url?scp=85067810757&partnerID=8YFLogxK

U2 - 10.2196/12169

DO - 10.2196/12169

M3 - Article

VL - 6

SP - 1

EP - 13

JO - JMIR Mental Health

JF - JMIR Mental Health

SN - 2368-7959

IS - 4

M1 - e12169

ER -