Telehealth Acceptability and Feasibility Among People Served in a Community Behavioral Health System During the COVID-19 Pandemic
Abstract
Objective:
The authors examined the acceptability and feasibility of telehealth services shortly after their rapid introduction into a community behavioral health agency as part of the response to the COVID-19 pandemic.
Methods:
Individuals receiving services during May 8–18, 2020, from behavioral health programs that had introduced telehealth in March 2020, were invited to participate in a survey regarding their perceptions of the telehealth services. Ordinal logistic regressions were used to test for differences in survey responses in three ways: between program types, between the 2020 sample and a 2018 sample, and between individuals reported by staff to be distressed or not distressed by the COVID-19 pandemic.
Results:
Of 1,482 survey respondents, >80% reported that their ability to connect to staff, receive support, and get an appointment was at least as great as before the pandemic. Among 80% of respondents indicating interest in continuing remote services after the pandemic ended, 83% preferred a mix of remote and face-to-face services. From February 2020 to April 2020, total service utilization remained stable for treatment, outreach, and housing programs. In addition, mental health–related hospital utilization did not increase.
Conclusions:
The findings of this study suggest that telehealth, including telephone-based services, is an acceptable and even preferred service delivery mode for clients with severe mental illness. Continued investigation into the optimal dosing of face-to-face versus remote services in various settings is needed to inform service practice during and after the COVID-19 pandemic.
HIGHLIGHTS
•
The authors examined the acceptability and feasibility of telehealth services shortly after their rapid introduction into a community behavioral health agency as part of the response to the COVID-19 pandemic.
•
Individuals served via telehealth reported that their ability to connect to staff, receive support, and make an appointment was at least as great as before the pandemic, and most indicated interest in continuing remote services after the pandemic ended.
•
Total service use remained stable for assertive community treatment and housing programs, and mental health–related hospital utilization did not increase.
Since social distancing became a part of the defense against the COVID-19 pandemic, many health care providers have closed their doors and deferred procedures to protect patients from COVID-19 infection (1–3), significantly altering how care is delivered. However, continued management of chronic diseases that increase COVID-19 risk, such as diabetes mellitus and hypertension, remains a crucial part of response to the pandemic. Because of a combination of comorbid conditions and adverse social determinants of health (e.g., housing instability, economic hardship, and social isolation), people with serious mental illness may be at particular risk for increased COVID-19–associated morbidity and mortality and for the adverse social and psychological effects of the pandemic (4). In many states, mental health providers responded to the COVID-19 emergency with rapid and widespread transition to telehealth, supported by relief from many regulatory and legislative barriers established before COVID-19 (5).
Many people with severe mental illness require complex multidisciplinary care management with frequent engagement to help them recover, maintain a degree of independence, and avoid hospitalization (6, 7). For individuals served by teams of mental health professionals, such as in assertive community treatment (ACT) or supported housing, these teams may be the greatest potential source of COVID-19 transmission risk. Transition of these treatment models to telehealth became essential during the pandemic but faced unique barriers.
A growing body of evidence supports the notion that with regard to outcomes and patient satisfaction, telepsychiatry is comparable to face-to-face psychiatry in clinical settings (8–10). A subset of evidence has examined telepsychiatry for the management of serious mental illness, finding that most clients appreciate these services (6, 11–14). Social isolation is a common problem among people with serious mental illness, sometimes compounded by paranoid ideation or negative symptoms (15–25). It is possible that being able to connect with mental health professionals without leaving the home or receiving visitors may offer some relief.
Available studies most frequently involve telepsychiatry offered through videoconferencing or smartphone technology augmenting primarily face-to-face treatment. However, low computer literacy and limited access to Internet technology are prevalent among individuals with serious mental illness and represent barriers to telehealth access. Older individuals may experience even greater issues with telehealth access because of difficulties with hearing, speech, vision, and cognitive impairment (21). When New York State expanded regulations to allow its licensed programs to bill Medicaid for telehealth visits in March 2020 in response to the COVID-19 pandemic, telephone-based interventions were permitted to address technology barriers. Little is known about client preferences and experiences regarding telephone-based services, particularly among people with serious mental illness.
In this study, we examined the acceptability and feasibility of telehealth service provision shortly after its introduction in a community behavioral health agency. In particular, we examined client subjective experience, preferences, and satisfaction with services across behavioral health program types, and we compared their responses with those from a 2018 sample. We also examined utilization patterns for these behavioral health services and for emergency and hospital services.
Methods
Population
We invited individuals receiving services from May 8 to 18, 2020, in programs that had introduced telehealth services during the COVID-19 pandemic at a New York City community behavioral health agency. The total census of these programs was 6,546, which included 2,668 individuals in treatment programs (mental health clinics, ACT, Intensive Mobile Treatment [IMT] program, and Personal Recovery Oriented Services [PROS] day program), 2,540 in outreach programs (including care coordination and several small program types), and 1,796 in housing programs (including Treatment Apartment Program [TAP] and supported housing). Some individuals were enrolled in more than one program. For the 6,546 individuals served by these programs, most had a diagnosis of serious mental illness, with 39% (N=2,553) diagnosed as having a psychotic disorder and 41% (N=2,684) diagnosed as having mood disorders. Most participants identified as Black (60%, N=3,929), with 22% (N=1,440) identifying as Hispanic, 14% (N=916) identifying as White, 3% (N=196) identifying as multiracial, and 1% (N=65) identifying as Asian. Participants had a mean±SD age of 45±17 years (range 5–93). For 233 minors among the individuals served, their guardians were asked to take the survey on their behalf. This study was performed as part of routine agency performance improvement. Institutional review was not required.
Interview Procedures
The survey was administered by clinicians and case managers during scheduled or routine meetings with participants via the telephone, by videoconferencing call, or in person during the study period. Clinicians and case managers were provided with a script to introduce the survey, which explicitly stated that the survey was voluntary. The survey took approximately 5 minutes to complete, and the clinicians and case managers recorded the survey responses in SurveyMonkey.
Measures
The agency developed a brief survey to measure participants’ experience with telehealth services. The first three survey items measured perceived level of connection and support experienced before the pandemic compared with the present. The next four items were extracted from the agency’s annual consumer satisfaction survey to allow for historical data comparison. The next item asked whether the individual would like to continue receiving services remotely after the pandemic ended. If the response was yes, the individual was asked whether they would prefer all telehealth or a mixture of telehealth and in-person service. The next item asked what type of device was used to engage in telehealth (e.g., phone or laptop). The clinician or case manager was then asked to rate their perception of the individual’s level of distress related to the COVID-19 pandemic.
Monthly aggregate service utilization data for Medicaid-reimbursable programs, including clinics, ACT, PROS, and TAP, were extracted from electronic health records to examine changes in client access to and engagement in telehealth and face-to-face services during the period immediately before and after the beginning of the pandemic (February 1–April 30, 2020). Self-reported emergency and inpatient utilization data were obtained from the electronic health record’s Healthy Living Questionnaire, administered quarterly or semiannually in all participating programs other than IMT and care coordination (for the periods January–April 2019 and January–April 2020), to enable comparison.
Data Analysis
All collected data were coded and recorded into a computer data file and analyzed with IBM SPSS Statistics, version 26. Data were aggregated by program type (treatment, outreach, and housing), and ordinal logistic regressions were used to test for differences among program types on responses to the 5-point, Likert-rated survey questions (1, a lot less than before; 2, a little less than before; 3, the same as before; 4, a little more than before; 5, a lot more than before). Ordinal logistic regressions were used to identify differences between historical responses to the client satisfaction survey items in 2018 and responses during the study period in 2020. Ordinal logistic regressions were also used to determine whether provider-rated client distress due to the pandemic was correlated with experience of services and satisfaction. Results were considered statistically significant at p<0.01 to account for multiple testing. Service use frequency data were summarized in graphs.
Results
Survey Participation
In total, 1,482 individuals responded, including 363 (25%) in treatment programs, 225 (15%) in outreach programs, and 894 (60%) in housing programs and representing 38% (N=3,933) of individuals scheduled for visits during the study period. (Estimated survey participation rates by program type can be found in an online supplement to this article, with a higher participation rate in housing programs than in other programs.)
Comparison of Responses by Program Type
Survey responses are detailed in Table 1 and separated by program type. For the overall sample, most participants responded that their ability to connect to staff (85%, N=1,260), get support when needed (90%, N=1,334), and get an appointment when wanted (82%, N=1,215) was the same as or more than before the pandemic.
| Treatment | Housing | Outreach | ||||
|---|---|---|---|---|---|---|
| Survey item and responses | N | % | N | % | N | % |
| I feel connected to my care team a | ||||||
| A lot less | 14 | 4 | 26 | 3 | 10 | 4 |
| A little less | 49 | 14 | 90 | 10 | 33 | 15 |
| The same | 186 | 51 | 517 | 58 | 125 | 56 |
| A little more | 56 | 16 | 164 | 18 | 31 | 14 |
| A lot more | 57 | 16 | 95 | 11 | 26 | 12 |
| I can get support when I need it | ||||||
| A lot less | 12 | 3 | 17 | 2 | 2 | 1 |
| A little less | 23 | 6 | 62 | 7 | 34 | 15 |
| The same | 214 | 59 | 543 | 61 | 125 | 56 |
| A little more | 55 | 15 | 181 | 20 | 41 | 18 |
| A lot more | 56 | 16 | 90 | 10 | 23 | 10 |
| I can get an appointment when I want | ||||||
| A lot less | 11 | 3 | 42 | 5 | 11 | 5 |
| A little less | 24 | 7 | 118 | 13 | 58 | 26 |
| The same | 233 | 65 | 560 | 63 | 122 | 54 |
| A little more | 41 | 12 | 110 | 12 | 12 | 5 |
| A lot more | 49 | 14 | 63 | 7 | 22 | 10 |
| I feel comfortable asking about treatment and medications | ||||||
| A lot less | 3 | 1 | 8 | 1 | 2 | 1 |
| A little less | 8 | 2 | 15 | 2 | 4 | 2 |
| The same | 24 | 7 | 66 | 7 | 23 | 10 |
| A little more | 183 | 51 | 537 | 60 | 129 | 58 |
| A lot more | 140 | 39 | 268 | 30 | 66 | 30 |
| Staff talk to me about specific goals for my health | ||||||
| A lot less | 3 | 1 | 3 | <1 | 1 | <1 |
| A little less | 10 | 3 | 13 | 2 | 1 | <1 |
| The same | 14 | 4 | 56 | 6 | 14 | 6 |
| A little more | 209 | 58 | 553 | 62 | 134 | 60 |
| A lot more | 126 | 35 | 267 | 30 | 75 | 33 |
| Staff are sensitive to my traumatic or difficult experiences | ||||||
| A lot less | 3 | 1 | 3 | <1 | 1 | <1 |
| A little less | 15 | 4 | 13 | 2 | 6 | 3 |
| The same | 33 | 9 | 50 | 6 | 22 | 10 |
| A little more | 180 | 50 | 584 | 66 | 127 | 57 |
| A lot more | 126 | 35 | 240 | 27 | 68 | 30 |
| The quality of my life is improving | ||||||
| A lot less | 5 | 1 | 11 | 1 | 6 | 3 |
| A little less | 31 | 9 | 51 | 6 | 16 | 7 |
| The same | 72 | 20 | 176 | 20 | 78 | 35 |
| A little more | 168 | 46 | 491 | 55 | 91 | 41 |
| A lot more | 86 | 24 | 165 | 19 | 33 | 15 |
| Staff: please assess the degree to which your client is experiencing distress because of the pandemic | ||||||
| A lot less | 25 | 7 | 25 | 3 | 6 | 3 |
| A little less | 61 | 17 | 77 | 9 | 14 | 6 |
| The same | 95 | 26 | 186 | 21 | 47 | 21 |
| A little more | 70 | 19 | 211 | 24 | 76 | 34 |
| A lot more | 111 | 31 | 392 | 44 | 82 | 36 |
a
The care team included case manager, therapist, doctor, and nurse.
We conducted ordinal regressions to determine whether program type affected responses to the survey questions (for all odds ratios [ORs], see the online supplement). Individuals in the housing and outreach groups were less likely than those in the treatment group to report, “I can get an appointment when I want” (housing: OR=0.64, p<0.001; outreach: OR=0.36, p<0.001). Clients in the housing group were more likely than clients in the treatment group to report that staff were sensitive to traumatic experiences (OR=2.11, p<0.001), and staff in that group were more likely to note that clients were in distress (OR=1.77, p<0.001). Participants in the outreach group were less likely than those in the treatment group to report, “The quality of my life is improving” (OR=0.58, p<0.001).
Comparison of Client Satisfaction Survey Items by Year
Responses to questions from the annual client satisfaction survey for the 2018 versus the 2020 samples are detailed in Table 2. We used ordinal logistic regressions to determine possible relationships between year and survey responses (for all ORs, see online supplement). Clients were more likely to report that their quality of life was improving in 2020 than in 2018 (OR=1.28, p<0.001).
| 2018 | 2020 | |||
|---|---|---|---|---|
| Survey item and responses | N | % | N | % |
| I feel comfortable asking about treatment and medications | ||||
| Strongly disagree | 12 | 1 | 13 | 1 |
| Disagree | 22 | 3 | 27 | 2 |
| Neither | 77 | 9 | 113 | 8 |
| Agree | 476 | 53 | 847 | 58 |
| Strongly agree | 305 | 34 | 473 | 32 |
| Staff talk to me about specific goals for my health | ||||
| Strongly disagree | 12 | 1 | 7 | 1 |
| Disagree | 19 | 2 | 24 | 2 |
| Neither | 55 | 6 | 84 | 6 |
| Agree | 510 | 57 | 893 | 61 |
| Strongly agree | 298 | 33 | 468 | 32 |
| Staff are sensitive to my traumatic or difficult experiences | ||||
| Strongly disagree | 17 | 2 | 7 | 1 |
| Disagree | 20 | 2 | 34 | 2 |
| Neither | 78 | 9 | 105 | 7 |
| Agree | 490 | 55 | 888 | 61 |
| Strongly agree | 287 | 32 | 434 | 30 |
| The quality of my life is improving | ||||
| Strongly disagree | 18 | 2 | 22 | 2 |
| Disagree | 32 | 4 | 98 | 7 |
| Neither | 143 | 17 | 326 | 22 |
| Agree | 396 | 47 | 747 | 51 |
| Strongly agree | 259 | 31 | 284 | 19 |
Comparison of Survey Responses by Staff-Reported Client Distress
Staff reported that clients were distressed (very mildly to severely) by the COVID-19 pandemic in 60% (N=889 of 1,482) of the survey responses. Survey responses for clients reported to be distressed versus not distressed are shown in Table 3. Ordinal logistic regressions were used to determine relationships between distress and survey responses (for all ORs, see online supplement). Clients who reported not being distressed were more likely than those who reported being distressed to agree that they feel connected to staff (OR=1.38, p=0.001), that they are able to receive support when needed (OR=1.45, p<0.001), that they are able to get an appointment when wanted (OR=1.49, p<0.001), and that their quality of life is improving compared with before the pandemic (OR=1.86, p<0.001).
| Distressed | Not distressed | |||
|---|---|---|---|---|
| Survey item and responses | N | % | N | % |
| I feel connected to my care team a | ||||
| A lot less | 41 | 5 | 10 | 2 |
| A little less | 130 | 14 | 44 | 7 |
| The same | 484 | 53 | 371 | 61 |
| A little more | 156 | 17 | 101 | 17 |
| A lot more | 103 | 11 | 81 | 13 |
| I can get support when I need it | ||||
| A lot less | 23 | 3 | 8 | 1 |
| A little less | 95 | 10 | 29 | 5 |
| The same | 541 | 59 | 368 | 61 |
| A little more | 163 | 18 | 117 | 19 |
| A lot more | 92 | 10 | 82 | 14 |
| I can get an appointment when I want | ||||
| A lot less | 54 | 6 | 13 | 2 |
| A little less | 144 | 16 | 67 | 11 |
| The same | 545 | 60 | 393 | 65 |
| A little more | 96 | 11 | 71 | 12 |
| A lot more | 73 | 8 | 62 | 10 |
| I feel comfortable asking about treatment and medications | ||||
| A lot less | 9 | 1 | 4 | 1 |
| A little less | 21 | 2 | 7 | 1 |
| The same | 77 | 8 | 37 | 6 |
| A little more | 520 | 57 | 353 | 58 |
| A lot more | 285 | 31 | 203 | 34 |
| Staff talk to me about specific goals for my health | ||||
| A lot less | 7 | 1 | 0 | — |
| A little less | 14 | 2 | 13 | 2 |
| The same | 56 | 6 | 29 | 5 |
| A little more | 550 | 60 | 369 | 61 |
| A lot more | 287 | 31 | 196 | 32 |
| Staff are sensitive to my traumatic or difficult experiences | ||||
| A lot less | 6 | 1 | 1 | <1 |
| A little less | 24 | 3 | 12 | 2 |
| The same | 61 | 7 | 47 | 8 |
| A little more | 551 | 61 | 359 | 60 |
| A lot more | 268 | 30 | 184 | 31 |
| The quality of my life is improving | ||||
| A lot less | 19 | 2 | 3 | 1 |
| A little less | 85 | 9 | 17 | 3 |
| The same | 219 | 24 | 117 | 19 |
| A little more | 447 | 49 | 322 | 53 |
| A lot more | 146 | 16 | 147 | 24 |
a
The care team included case manager, therapist, doctor, and nurse.
Continuation of Telehealth and Use of Technology
Of all respondents, 1,182 (80%) indicated that they would be interested in continuing to receive services remotely after the COVID-19 pandemic ended, with 984 (83%) of those interested in remote services preferring a mix of remote and in-person services, and 198 (17%) preferring all services to be completed remotely. No significant differences were found by program type. The devices used for telehealth included smartphones (53%, N=785), basic cellphones (29%, N=430), landline phones (16%, N=237), and computers (2%, N=30), and almost all services were provided via audio calls and not videoconferencing.
Service Utilization
The number of face-to-face and telehealth services provided from January to April 2020 was obtained for a subset of Medicaid-reimbursable programs, showing an increase in overall service provision for ACT but a large decrease for PROS; clinics and TAP remained roughly stable (Figure 1). The frequency of self-reported emergency and inpatient service uses is shown in Figure 2. We observed a slight decrease in use for mental health reasons and an increase in use for general medical health reasons between 2019 and 2020.
FIGURE 1. Face-to-face and telehealth services provided for individuals receiving behavioral health treatment in 2020, by program type and montha
a ACT, assertive community treatment; PROS, Personal Recovery Oriented Services; TAP, Treatment Apartment Program.
FIGURE 2. Emergency and inpatient services use in 2019 versus 2020 for individuals receiving treatment in behavioral health programsa
a A slight decrease in use for mental health reasons, and an increase in use for general health reasons, can be observed between 2019 and 2020. ED, emergency department.
Discussion
This investigation of clients’ perceptions regarding telehealth is notable for its focus on people with serious mental illness across multiple program types, including office- and community-based care and some longitudinal data comparisons. The rapid transition to telehealth in March 2020 in response to the COVID-19 pandemic bypassed the usual processes by which behavioral health agencies seek client buy-in before implementing new services. Consistent with previous studies of telepsychiatry (6, 11–14), the high level of perceived support and satisfaction with telehealth services, largely regardless of program type, is promising, with no worsening of satisfaction noted during the pandemic in 2020 and compared with historical (i.e., 2018) responses.
Mental health care settings that have made large-scale use of telehealth are increasingly confident in developing and sharing adaptations to virtual care delivery (23), which can be used to accommodate the significant number of clients who requested to continue exclusively with telehealth services after the pandemic. However, for some of these clients, this preference may not be clinically viable. For example, clients requiring direct inspection of living conditions, visualization of mental status, and private locations for telehealth visits or accommodations for hearing or speech disabilities or cognitive impairment, cannot be adequately served without face-to-face visits at least some of the time.
Telehealth may augment face-to-face visits, and determining the “dosing” of telehealth visits will require more experience and research (6). Examination of the impact of videoconferencing versus telephone visits, and of the replacement of office versus field visits, will be important. Notably, replacing office visits with videoconferencing visits may offer a glimpse of a client’s home life that enhances a provider’s understanding of the client’s situation, whereas when replacing a field visit with a phone call, it is likely that this information will be lost. There may also be differences when a client interacts with one provider via telehealth versus when they are served by individual members of a team of providers.
We are not aware of other investigations into the impact of client distress on the perception of telehealth. The negative impact of staff-rated distress on client-rated perceived support suggests the need to increase support for clients perceived to be distressed. However, the relative stability of emergency and hospital use compared with the same period in 2019 is reassuring. Outcomes of other rapid transitions to telehealth also indicate the capacity for safe and equitable care delivery (24).
The stable or increased numbers of total visits for clinic, ACT, and TAP programs support the continued telehealth provision in these programs if the reimbursement for telehealth continues to be viable. It also suggests a benefit to some clients in increasing their access to care beyond prepandemic levels. Other venues have reported increases in outpatient attendance consistent with our results (23). Although individual telehealth care models showed promise, group models such as PROS and day programs do not easily lend themselves to a rapid transition to telehealth, as evidenced by decreased visit numbers. The culture change to provision of groups via phone or video call was very challenging, with availability of technology and the high degree of necessary coordination being the main barriers. After a group telehealth model is better established at this agency and others, comparison of telehealth satisfaction in individual versus group settings will be useful.
A subset of the population lacked access to any communication device. To increase telehealth service participation, the agency provided 97 individuals with mobile phones and arranged use of communal phones and devices. As all programs begin to accrue the necessary technology, it seems likely that both the frequency and the quality of telehealth will increase. However, although many clients were noted to have smartphones, anecdotal reports suggest that data plans supporting video call capability are difficult to sustain financially for most of the people in this population. This assertion needs to be examined in a follow-up survey, with further exploration of technology needs and opportunities. In the meantime, the feasibility and acceptability data from this study suggest that regulators and funders should continue to reimburse telephone-based services to support access to care among people with severe mental illness.
Although the sample size was large, the short survey period reduced the participation rate as a proportion of the total census, and a possible selection bias existed toward individuals who had made themselves available for telehealth services and who were willing to cooperate with a survey administered in a telehealth session. A notable omission was that we did not record whether the survey was administered in person or via a telehealth session and whether it was administered via videoconferencing or a telephone call. Demographic data were also not recorded for survey respondents, limiting the ability to generalize the results to the total population. However, demographic data available for the total population do support generalizability to other behavioral health populations.
Another source of bias was that survey responses were recorded by staff interviewing their own clients; this procedure likely affected the correlation found between staff-rated client distress and the client’s satisfaction and quality-of-life responses. The challenges in obtaining data from a clientele who frequently lack Internet access and who have literacy issues continue to affect community research quality. In the case of the data used in the present study, it was important to obtain these data quickly to inform the agency’s practices and to advocate for regulatory changes to meaningfully improve community-based telehealth. This survey was administered only 2 months after telehealth began to be offered; repeated survey administration will be necessary to understand client preferences, outcomes, and risks in the longer term.
Conclusions
The findings of this study suggest that people who are served in a variety of behavioral health treatment programs find telehealth, including telephone-based services, to be an acceptable and even preferred mode of service delivery. In addition, service use numbers indicate its feasibility in individual care settings but possibly not in group programs. Continued investigation into the optimal dosing of face-to-face versus telephone and videoconferencing call services (in office-based, community-based, and group-based settings), as well as viable billing models for these services, will be needed to inform practice during and after the COVID-19 pandemic.
Acknowledgments
The authors acknowledge David Woodlock, M.S., for supporting this work.
Footnote
The authors report no financial relationships with commercial interests.
Supplementary Material
File (appi.ps.202000623.ds001.pdf)
- View/Download
- 102.18 KB
References
1.
Basu S : Non-communicable disease management in vulnerable patients during COVID-19. Indian J Med Ethics 2020 ; 2 : 103 – 105
2.
Vieira CM, Franco OH, Restrepo CG, et al : COVID-19: the forgotten priorities of the pandemic. Maturitas 2020 ; 136 : 38 – 41
3.
Schrag D, Hershman DL, Basch E : Oncology practice during the COVID-19 pandemic. JAMA 2020 ; 323 : 2005 – 2006
4.
Druss BG : Addressing the COVID-19 pandemic in populations with serious mental illness. JAMA Psychiatry 2020 ; 77 : 891 – 892
5.
Shore JH, Schneck CD, Mishkind MC : Telepsychiatry and the coronavirus disease 2019 pandemic—current and future outcomes of the rapid virtualization of psychiatric care. JAMA Psychiatry (Epub May 11, 2020).
6.
Swanson CL, Trestman RL : Rural assertive community treatment and telepsychiatry. J Psychiatr Pract 2018 ; 24 : 269 – 273
7.
ACT Program Guidelines 2007. Albany, New York State Office of Mental Health, 2020. https://omh.ny.gov/omhweb/act/program_guidelines.html. Accessed Oct 7, 2020
8.
Hubley S, Lynch SB, Schneck C, et al : Review of key telepsychiatry outcomes. World J Psychiatry 2016 ; 6 : 269 – 282
9.
O’Reilly R, Bishop J, Maddox K, et al : Is telepsychiatry equivalent to face-to-face psychiatry? Results from a randomized controlled equivalence trial. Psychiatr Serv 2007 ; 58 : 836 – 843
10.
De Las Cuevas C, Arredondo MT, Cabrera MF, et al : Randomized clinical trial of telepsychiatry through videoconference versus face-to-face conventional psychiatric treatment. Telemed J E Health 2006 ; 12 : 341 – 350
11.
Lal S, Abdel-Baki A, Sujanani S, et al : Perspectives of young adults on receiving telepsychiatry services in an urban early intervention program for first-episode psychosis: a cross-sectional, descriptive survey study. Front Psychiatry 2020 ; 11 : 117
12.
Hulsbosch AM, Nugter MA, Tamis P, et al : Videoconferencing in a mental health service in the Netherlands: a randomized controlled trial on patient satisfaction and clinical outcomes for outpatients with severe mental illness. J Telemed Telecare 2017 ; 23 : 513 – 520
13.
Sreejith G, Menon V : Mobile phones as a medium of mental health care service delivery: perspectives and barriers among patients with severe mental illness. Indian J Psychol Med 2019 ; 41 : 428 – 433
14.
Ben-Zeev D, Brian RM, Jonathan G, et al : Mobile health (mHealth) versus clinic-based group intervention for people with serious mental illness: a randomized controlled trial. Psychiatr Serv 2018 ; 69 : 978 – 985
15.
Walker S, Kennedy A, Vassilev I, et al : How do people with long-term mental health problems negotiate relationships with network members at times of crisis? Health Expect 2018 ; 21 : 336 – 346
16.
Dagan Y, Yager J : Addressing loneliness in complex PTSD. J Nerv Ment Dis 2019 ; 207 : 433 – 439
17.
Gromann PM, Heslenfeld DJ, Fett AK, et al : Trust versus paranoia: abnormal response to social reward in psychotic illness. Brain 2013 ; 136 : 1968 – 1975
18.
Lemmers-Jansen ILJ, Fett AJ, Hanssen E, et al : Learning to trust: social feedback normalizes trust behavior in first-episode psychosis and clinical high risk. Psychol Med 2019 ; 49 : 780 – 790
19.
Watson J, Fossey E, Harvey C : A home but how to connect with others? A qualitative meta-synthesis of experiences of people with mental illness living in supported housing. Health Soc Care Community 2019 ; 27 : 546 – 564
20.
Mote J, Gard DE, Gonzalez R, et al : How did that interaction make you feel? The relationship between quality of everyday social experiences and emotion in people with and without schizophrenia. PLoS One 2019 ; 14 : e0223003
21.
Lam K, Lu AD, Shi Y, et al : Assessing telemedicine unreadiness among older adults in the United States during the COVID-19 pandemic. JAMA Intern Med 2020 ; 180 : 1389 – 1391.
22.
Fortuna KL, Ferron J, Pratt SI, et al : Unmet needs of people with serious mental illness: perspectives from certified peer specialists. Psychiatr Q 2019 ; 90 : 579 – 586
23.
Kannarkat JT, Smith NN, McLoed-Bryant SA : Mobilization of telepsychiatry in response to COVID-19—moving toward 21st century access to care. Adm Policy Ment Health 2020 ; 47 : 489 – 491
24.
Wood SM, White K, Peebles R, et al : Outcomes of a rapid adolescent telehealth scale-up during the COVID-19 pandemic. J Adolesc Health 2020 ; 67 : 172 – 178
25.
Thomas RK, Suleman R, Mackay M, et al : Adapting to the impact of COVID-19 on mental health: an international perspective. J Psychiatry Neurosci 2020 ; 45 : 229 – 233
Information & Authors
Information
Published In
History
Received: 17 August 2020
Revision received: 14 September 2020
Accepted: 16 September 2020
Published online: 7 May 2021
Published in print: June 2021
Keywords
Authors
Funding Information
Research was supported by the Optimizing and Personalizing Interventions for Schizophrenia Across the Lifespan (OPAL) center of the National Institute of Mental Health under award P50-MH-115843.
Metrics & Citations
Metrics
Citations
Export Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
View Options
View options
PDF/EPUB
View PDF/EPUBLogin options
Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.
Personal login Institutional Login Open Athens loginNot a subscriber?
PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.
Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).