Skip to main content
Full access
Articles
Published Online: 15 April 2016

Determinants of Completion and Use of Psychiatric Advance Statements in Mental Health Care in the Netherlands

Abstract

Objective:

Crisis plans are a type of psychiatric advance statement (PAS) that describe how to recognize early signs of a psychiatric crisis and how to handle crisis situations. Although PASs may help reduce the occurrence of crises, their implementation in clinical practice is problematic. This study examined patient and clinician characteristics associated with successful completion of a crisis plan and determined how often a plan was consulted in a crisis situation.

Methods:

Participants were 139 crisis-prone outpatients and their clinicians recruited in the context of a randomized controlled trial in the Netherlands studying the effects of crisis plans. Multivariate logistic regression analyses examined associations between patient and clinician characteristics and completion of a crisis plan. Descriptive and univariate statistics were used to determine subsequent use of crisis plans.

Results:

Of the 139 patients, 64% completed a crisis plan. Higher completion rates were associated with a better clinician-rated working alliance, a lower education level of the patient, and fewer years of professional experience of the clinician. Of the 89 patients who completed a crisis plan, 38 later experienced a crisis, and plans were consulted for a third of these patients (34%). For those whose crisis involved involuntary admission, a smaller proportion had their plans consulted, compared with those whose crisis involved an outpatient emergency visit or voluntary admission.

Conclusions:

PAS completion was associated not only with patient and clinician characteristics but also with a positive working alliance. PAS use did not occur in all cases, especially not when patients were involuntarily admitted.
Psychiatric advance statements (PASs) are important instruments for patients and clinicians who wish to prevent crisis situations and to handle them in a mutually agreeable way (1,2). PASs may also have a positive effect on the therapeutic relationship and patient satisfaction (3). The term “psychiatric advance statement” encompasses a variety of statements used in psychiatric care, such as crisis plans (CPs), joint CPs, and psychiatric advance directives. They can vary in form, content, and judicial context (4).
PASs are a promising practice, with equivocal evidence as to their effectiveness. Because the process of implementing evidence-based interventions may take more than a decade, it is not surprising that PAS implementation in the mental health system has been problematic (3,5,6). A U.S. study of outpatients at five public mental health services showed that only 4% to 13% of patients who wanted a PAS had completed one (7). Reasons for lack of PAS implementation include clinicians’ doubts about the need for them and clinicians’ reluctance to share decisions with patients (8,9).
We found only two studies that investigated determinants of PAS completion (3,7). One organizational factor that seems to be important for completion is the use of an independent facilitator. In one study, individuals were randomly assigned to two conditions—one with and one without a facilitator (3). In the group with the facilitator, 61% completed a PAS, compared with 3% in the group without the facilitator (3). Patient-level factors associated with PAS completion included an understanding of key PAS components, greater insight into the illness and the need for treatment, and adverse medication experiences (3,7). More evidence about patient- and clinician-related factors may help inform interventions to increase PAS completion rates.
Another aspect of PAS implementation is whether they are used during a crisis. Although PAS use seems logical from a clinical standpoint, many factors can interfere. In times of crisis, the plan may be overlooked by clinicians working in the crisis service because time is lacking or because no one is aware that a PAS exists. To our knowledge, this issue has not been studied previously.
Therefore, the purposes of this study were to identify factors associated with PAS completion and to determine how often PASs are used when a patient is in crisis. We expected that PAS completion would be more likely among patients with better psychosocial functioning (that is, greater illness insight, fewer symptoms, better social functioning, and fewer behavioral problems); those with more positive attitudes toward mental health services, the clinician, and the usefulness of a PAS; and those whose clinician had more positive attitudes toward the patient and the usefulness of a PAS.

Methods

Design

Data were derived from a randomized controlled trial (RCT) conducted in the Netherlands on the effects of a CP—a type of PAS—for patients with psychotic and bipolar disorders. This study, which has been described in detail (2,10), investigated the effects of CPs on the number of voluntary and involuntary admissions and outpatient emergency visits. The trial distinguished two intervention conditions and one control condition in which patients did not have a CP (no CP). In the first intervention condition, the CP was created solely by the patient and the clinician (CCP). In the second intervention condition, a patient advocate (PA) facilitated the process of CP completion (PACP) by preparing the draft and by supporting the patient in negotiating the specifics of the plan with the clinician. The study was approved by the Medical Ethics Trial Committee for Mental Health Organizations. Informed consent was obtained from all participants.

CPs

CPs comprise two aspects of a PAS: crisis prevention (for example, how to recognize early warning signs) and provision of practical information for future psychiatric care. Practical information is summarized on a small card—the “crisis card”—which users carry with them. The format of the crisis card distinguishes four domains: indicators of relapse, the patient’s care preferences in the event of a crisis, medical information, and contact information of relevant others. In the Netherlands, CPs are not legally binding and can be viewed as an advance agreement between patient and clinician.

Recruitment

We included adult outpatients who had had at least one crisis contact with mental health services or had been admitted to a hospital—voluntarily or involuntarily—in the previous two years. Participants were recruited from 12 community mental health teams in three mental health institutions in Rotterdam, the Netherlands. Eligible participants were selected on the basis of case notes (N=537); 151 refused to participate, and 174 could not be contacted. A total of 212 patients were included in the RCT (no CP, N=73; PACP, N=69; and CCP, N=70). All patients randomly assigned to the intervention conditions (PACP and CCP) were included in our analyses (N=139). Data were collected between 2008 and 2011.

Procedures

A researcher and two participating PAs trained the clinicians (N=93) in creating CPs during a two-hour session. Participants were psychiatric nurses, who were the patients’ primary clinicians. PAs were social workers with extensive professional experience in mental health care. Both worked for a patient advocacy organization, where their main task was to draw up CPs.
The following steps were taken to create a CP. At the first meeting with the patient, the procedure was discussed, information—for example, on crisis-precipitating factors—was collected, and strategies for preventing crises were developed. Over the next few meetings, a draft of the CP was prepared. When the CP was complete, it was signed by the patient’s psychiatrist, the clinician, and any others involved in the CP, such as partners or family. The final step was to summarize the CP on a card that was given to the patient.

Measures and Instruments

Outcome variables.

CP completion was operationalized as the handover of the crisis card to the patient. CP use was assessed during follow-up (at nine and 18 months). We interviewed the patient’s clinician, asking the following questions: “Has the CP been used over the past nine months?” (yes/no); “Who has consulted the CP?” (patient, clinician, family, or other stakeholder); “Which parts of the CP have been consulted?” (parts 1–8); “The instructions in the CP were followed/ignored during the crisis, because . . . ” (open question). Data from the nine- and 18-month follow-ups were combined. The occurrence and type of crises were assessed over 18 months. Service use data were collected from patients’ files and checked against the Rotterdam Region Psychiatric Case Register (11). Three categories were used for crises: 0, no crisis; 1, outpatient emergency visit or voluntary admission; and 2, involuntary admission (whether acute or court ordered).

Determinants.

Patient characteristics included chart diagnosis, gender, age, ethnicity, education, income, and marital status. Clinician characteristics included years of professional experience. The patient’s psychosocial functioning was assessed by an independent interviewer with the Health of the Nation Outcome Scale (12,13). The patient’s insight into illness was measured with the self-report Insight Scale (13). The patient’s level of service engagement as seen from the clinician’s perspective was measured by using the Service Engagement Scale (14). The quality of the therapeutic relationship was measured with the Working Alliance Inventory (15), which was scored from both the patient’s and the clinician’s perspectives. Expectations about the CP were measured by four questions, answered by both clinician and patient (10): “To what extent do you think the CP could be effective in preventing a crisis, recognizing a crisis, what to do in advance of a crisis, and what to do in case of a crisis?” The items were rated on a 5-point scale. Determinants were assessed at baseline, before randomization. Instruments used in this study have been described in detail elsewhere (10).

Statistical Analysis

Determinants of completion.

In the first step in the modeling procedure, univariate associations between CP completion and all determinants were analyzed with logistic regression analysis. For this purpose, nonnormally distributed variables were recoded into categories of approximately equal size. Determinants with a significance level of .25 were considered potentially relevant and retained for analysis (16). Next, all potentially relevant determinants and meaningful interactions between determinants were entered into a preliminary model and removed in a stepwise backward selection procedure on the basis of model fit. Collinearity between determinants was checked. The fit of the final model was evaluated by using diagnostic scatterplots of the standardized residuals and described using Nagelkerke’s R2. The data were hierarchical—that is, patients were clustered within clinicians and treatment teams. However, sensitivity analysis using multilevel models produced no evidence that associations between determinants and CP completion varied across clinicians or treatment teams.

CP use.

Associations with CP use were explored by using logistic regression analysis. SPSS for Windows, version 21.0, was used for statistical procedures.

Results

Sample

Characteristics did not differ between the PACP and CCP conditions. Table 1 summarizes patient and clinician characteristics for the overall sample of 139 patients. Psychosocial functioning scores were consistent with average scores in populations of patients with psychosis (11). Illness insight was average to high. Service engagement scores indicated moderate engagement. Scores on the patient- and clinician-rated working alliance indicated positive therapeutic relationships. Scores on the expected usefulness of CPs indicated positive expectations. The patient and clinician working alliance scores were positively related (r=.33, p<.001). Furthermore, a positively rated alliance by the patient and by the clinician was related to better service engagement (r=–.28, p=.002, and r=–.61, p<.001, respectively).
TABLE 1. Characteristics of 139 patients and 93 clinicians in the sample
CharacteristicN%
Patients  
 Age (M±SD)40.5±11.2 
 Sex  
  Men9669
  Women4331
 Marital status  
  Single or divorced12086
  Married1914
 Ethnicity  
  Dutch native8561
  Immigrant5439
 Income  
  Employed139
  Unemployed12691
 Education level  
  Low3022
  Middle9971
  High107
 Diagnosis  
  Psychotic disorder9871
  Other severe mental illness4129
 Psychosocial functioning (M±SD score)  
  HoNOSa11.3±5.1 
  Insight Scaleb8.4±2.9 
 Attitude (M±SD)  
  Service Engagement Scalec28.1±8.1 
  Working Alliance Inventoryd142.5±20.8 
  Expectations of the crisis plane15.3±2.7 
Clinicians  
 Years of professional experience (M±SD) (range 0–40)14.0±9.4 
 Attitude (M±SD)  
  Working Alliance Inventoryd137.6±15.1 
  Expectations of the crisis plane16.1±1.9 
a
Possible scores on the Health of the Nation Outcome Scale (HoNOS) range from 0 to 48, with higher scores indicating more problems with psychosocial functioning.
b
Possible scores range from 0 to 16, with higher scores indicating greater insight.
c
Possible scores range from 14 to 56, with higher scores indicating less service engagement.
d
Possible scores range from 36 to 180, with higher scores indicating a greater satisfaction with the alliance. Clinicians rated the alliance with each patient.
e
Possible scores range from 4 to 20, with higher scores indicating more positive expectations of the crisis plan.

CP Completion

Table 2 presents data on CP completion. The 93 trained clinicians were responsible for creating 139 CPs (median, one CP per clinician; range, one to three). Completion rates did not differ significantly between the PACP and CCP conditions, although clinicians in the CCP condition needed more reminders. Univariate analyses indicated the following potentially relevant (p<.25) determinants of CP completion: female gender, unemployment, psychotic disorder, a low education level, a higher level of service engagement, a positively rated working alliance by the patient and the clinician, fewer years of professional experience for the clinician, and positively rated expectations of the CP by the clinician.
TABLE 2. Completion of crisis plans (CPs) among 139 patients and reasons given for noncompletion
VariableN%
Patients with a completed CPa8964
 In the CCP group of 70 patients4057
 In the PACP group of 69 patients4970
N of needed reminders sent to clinicians (M±SD)b5±3 
Reason for noncompletionc  
 No time; other treatment priorities1836
 Patient continuously in crisis and lacked illness insight1020
 Patient refused to reflect on possible crisis612
 Patient not compliant with treatment612
 Patient could not be contacted48
 Patient changed clinician multiple times36
 Patient died12
 Patient emigrated12
 CP got lost before finalization12
a
CCP, CP created solely by the patient and the clinician; PACP, CP completion facilitated by a patient advocate
b
Patient advocates needed no reminders.
c
For the 50 patients without a completed CP, either the clinician or the patient advocate provided reasons for noncompletion.
Table 3 presents the final model. The probability of CP completion was lower when the working alliance was rated negatively by the clinician and when the clinician had more years of professional experience. Patients with a low education level were more likely to complete a CP than those with a moderate or high education level. We found no interaction effect between working alliance and education on CP completion.
TABLE 3. Predictors of crisis plan completion in the final modela
VariableBetaSEOR95% CI
Working alliance, clinician’s perspective (reference: positive)    
 Negative–1.76.53.49.17–.61
 Neutral–.61.53.54.19–1.53
Low education level of patient (reference: middle and high)1.06.532.881.03–8.10
Clinician’s professional experience (years)–.04.02.96.92–1.00
Constant1.96.587.10 
a
Nagelkerke’s R2=.16

Use of CPs

Of the 89 patients who completed a CP, 38 (43%) later experienced a crisis. Of these, 24 (27%) needed an outpatient emergency visit or were admitted voluntarily, and 14 (16%) were admitted involuntarily. Of the 50 patients whose CP was not completed, 32 (64%) experienced a crisis; 19 (38%) needed an outpatient emergency visit or were admitted voluntarily, and 13 (26%) were admitted involuntarily. The type of crisis did not differ between patients with complete and incomplete CPs.
The CP was consulted by the patient, clinician, family, or other stakeholder for a third (N=13, 34%) of the 38 patients who later experienced a crisis. For 24% (N=9) of the 38 patients, no information was available on whether the CP was consulted. CPs drafted by the clinician were consulted significantly more often than those drafted with the help of a PA (69% [N=9] versus 31% [N=4], p=.03). CPs were consulted equally by patients and clinicians. Of three patients whose CPs were consulted, no data were available on which part of the plan was consulted. For the other ten, the information consulted most often concerned the patient’s care preferences (N=6, 60%), followed by indicators of relapse (N=3, 30%) and medication (N=1, 10%).
Among the 51 patients who did not later experience a crisis, CPs were consulted for ten (20%) patients. In two of these cases, CPs were consulted by family members or others involved in the patient’s care, rather than by the patient or clinician.
The proportion of patients who had their CP consulted was greater among the 24 patients who needed an emergency visit or were admitted voluntarily (N=12, 60%; N with missing data=4) than among the 14 patients who were involuntarily admitted (N=1, 11%; N with missing data=5) (p=.02).

Discussion

Almost two-thirds of the PASs were completed successfully. PASs were not completed for one-third of the patients, irrespective of the patient’s consent. Completion was associated with a better working alliance from the clinician’s perspective, a lower education level of the patient, and fewer years of professional experience of the clinician. We found no evidence that PAS completion was related to the patient’s level of psychosocial functioning or attitude toward health care or the usefulness of a PAS. However, the likelihood of PAS completion was higher if the clinician had a positive attitude toward the patient. Among patients with a completed PAS, the plan was used during a crisis for only one-third, usually in the context of an emergency visit or voluntary admission.
Fifty-seven percent of PASs were completed only after the clinicians were reminded to do so. This result is in line with earlier U.S. research (3), in which 61% of PASs were completed after efforts were made to facilitate the process. In our study, we assume that clinicians gave priority to other treatment tasks or were prevented by practical barriers, such as lack of experience drafting such plans or lack of time. A legal requirement to create a PAS might have disadvantages. The statutory nature of such a requirement would risk making PAS completion an obligatory administrative procedure rather than a mutual agreement.
This study found no association between PAS completion and psychosocial functioning. This finding is supported by previous research on the effects of patient characteristics on PAS completion (3,7). Our finding that a better working alliance (from the clinician’s perspective) was positively associated with PAS completion has not been previously reported; however, it is in line with previous findings that clinicians’ reluctance to complete PASs is an important barrier (8,9).
It is noteworthy that previous studies found that greater professional experience reduced perceived barriers regarding PAS completion (8,9), whereas our own study suggests the opposite. Also, our finding that patients with a lower level of education had higher completion rates contradicts previous studies (3,7). We speculate that clinicians who are more senior have more difficulty with change, which makes them less likely to include PASs in their practice (17). Patients with a higher level of education may have stronger opinions regarding their treatment, and reaching an agreement with the clinician on PAS content may thus be more difficult (18). Swanson and colleagues (3,7) reported that patients’ positive attitudes toward PASs and toward health care contributed to higher completion rates, a finding we could not replicate.
Our results suggest that PASs are completed if a clinician believes treatment to be progressing. It is known that some clinicians experience problems forming a collaborative relationship with patients who have severe mental illness (19). We also found that the PASs were consulted for a greater proportion of patients who subsequently had an emergency visit or voluntary admission, compared with patients who subsequently had an involuntary admission. This may indicate that a PAS can positively affect the way a crisis is handled or that patients who are less severely ill or more motivated for treatment are also more willing to consult the plan when in crisis. More research is needed to examine this phenomenon (2).
Our results do not suggest that PAS completion was moderated by PA facilitation. However, previous studies have suggested that PA facilitation results in qualitatively better PASs and in higher completion rates (3,20). PASs drafted by a clinician were consulted more often. Therefore, we recommend that clinicians and PAs work together to improve PAS completion, especially when the alliance between clinician and patient is disturbed.
To our knowledge this is the first study to assess PAS completion in relation to patient and clinician characteristics and attitudes toward PASs and health care services. In addition, no previous studies to our knowledge have examined associations between PAS completion and the use of PASs during crisis situations.
Because of our limited sample size, associations between patient and clinician characteristics and PAS completion and use during crises should be interpreted with caution. Research is needed to replicate these findings. Although CPs are similar to PASs described elsewhere (4), specific features of the format or context might limit the generalizability of our findings. Also, data on PAS completion were collected in the context of an RCT on the effects of completed PASs. Because considerable efforts were made to encourage clinicians to complete PASs, the results cannot be generalized to a naturalistic context in which clinicians are not similarly encouraged. The completion rate would probably have been significantly lower without such monitoring. Our sample included only 40% of eligible patients, and although analysis did not suggest the presence of selection bias (2), the 40% rate might affect generalizability. The sample size limited the number of determinants that could be included in our analysis. Therefore, determinants, such as working alliance, were operationalized by using overall scores. A larger sample is needed to examine the impact of specific elements of these determinants. Finally, because clinicians provided data on PAS use, consultation of the plan by others might have been missed. In addition, the patient’s perspective would have provided valuable information.

Conclusions

We found that successful PAS completion was not related to patient and clinician attitudes toward the usefulness of the instrument. Instead, a positive working relationship between the patient and clinician was a predictor of PAS completion. Clinicians should be more aware of the potential benefits of consulting a PAS. Future research should assess how information from PASs is used during crisis situations and determine how use of this information affects the way a crisis develops.

Acknowledgments

The authors thank the patients and clinicians who took part in the study. They are also grateful to the research assistants and participating mental health organizations for help in conducting the study.

References

1.
Henderson C, Flood C, Lease M, et al: Effect of joint crisis plans on use of compulsory treatment in psychiatry: single blind randomised controlled trial. BMJ 329:136–138, 2004
2.
Ruchlewska A, Wierdsma AI, Kamperman AM, et al: Effect of crisis plans on admissions and emergency visits: a randomized controlled trial. PLoS One 9:e91882, 2014
3.
Swanson JW, Swarzt MS, Elbogen EB, et al: Facilitated psychiatric advance directives: a randomised trial of an intervention to foster advance treatment planning among persons with severe mental illness. American Journal of Psychiatry 163:1943–1951, 2006
4.
Henderson C, Swanson J, Szmukler G, et al: Typology of advance statements in mental health care. Psychiatric Services 59:63–71, 2008
5.
Henderson C, Jackson C, Slade M, et al: How should we implement psychiatric advance directives? Views of consumers, caregivers, mental health providers and researchers. Administration and Policy in Mental Health and Mental Health Services Research 37:447–458, 2010
6.
Thornicroft G, Farrelly S, Szmukler G, et al: Clinical outcomes of joint crisis plans to reduce compulsory treatment for people with psychosis: a randomized controlled trial. Lancet 381:1634–1641, 2013
7.
Swanson JW, Swartz MS, Ferron J, et al: Psychiatric advance directives among public mental health consumers in five U.S. cities: prevalence, demand, and correlates. Journal of the American Academy of Psychiatry and the Law 34:43–57, 2006
8.
Kim MM, Scheyett AM, Elbogen EB, et al: Front line workers’ attitudes towards psychiatric advance directives. Community Mental Health Journal 44:28–46, 2007
9.
Van Dorn RA, Swartz MS, Elbogen EB, et al: Clinician’s attitudes regarding barriers to the implementation of psychiatric advance directives. Administration and Policy in Mental Health and Mental Health Services Research 33:449–460, 2006
10.
Ruchlewska A, Mulder CL, Smulders R, et al: The effects of crisis plans for patients with psychotic and bipolar disorders: a randomized controlled trial. BMC Psychiatry 9:41, 2009
11.
Wierdsma AI, Dieperink CJ, Koopmans GT: Regional mental health care information: the psychiatric case register Rotterdam region [in Dutch]; in Health Information Developments in the Netherlands. Edited by Dekker WA. Amsterdam, Dutch Association for Medical Records Administration, 1999
12.
Wing JK, Beevor AS, Curtis RH: Health of the Nation Outcome Scale (HONOS): research and development. British Journal of Psychiatry 172:11–18, 1998
13.
Birchwood M, Smith J, Drury V, et al: A self-report Insight Scale for psychosis: reliability, validity and sensitivity to change. Acta Psychiatrica Scandinavica 89:62–67, 1994
14.
Tait L, Birchwood M, Trower P: A new scale (SES) to measure engagement with community mental health services. Journal of Mental Health (Abingdon, England) 11:191–198, 2002
15.
Horvath AO, Greenberg LS: Development and validation of the Working Alliance Inventory. Journal of Counseling Psychology 36:223–233, 1989
16.
Hosmer DW, Lemeshow S: Applied Logistic Regression. New York, Wiley, 2000
17.
Schabracq MJ, Winnubst JAM, Cooper CL: Handbook of Work and Health Psychology. Chichester, United Kingdom, Wiley, 2003
18.
Patel SP, Bakken S, Ruland C: Recent advances in shared decision making for mental health. Current Opinion in Psychiatry 21:606–612, 2009
19.
Wittorf A, Jakobi U, Bechdolf A, et al: The influence of baseline symptoms and insight on the therapeutic alliance early in the treatment of schizophrenia. European Psychiatry 24:259–267, 2009
20.
Ruchlewska A, Mulder CL, Van der Waal R, et al: Crisis plans facilitated by patient advocates are better than those drawn up by clinicians: results from an RCT. Administration and Policy in Mental Health and Mental Health Services Research 41:220–227, 2014

Information & Authors

Information

Published In

Go to Psychiatric Services
Go to Psychiatric Services

Cover: Dulcimer, probably by Robert Kelly. White wood with walnut, accession #2005.708.1. The Colonial Williamsburg Foundation, museum purchase.

Psychiatric Services
Pages: 858 - 863
PubMed: 27079985

History

Received: 29 October 2014
Revision received: 14 September 2015
Revision received: 21 November 2015
Accepted: 18 December 2015
Published online: 15 April 2016
Published in print: August 01, 2016

Authors

Details

Asia Ruchlewska, Ph.D.
Dr. Ruchlewska, Dr. Kamperman, Dr. Wierdsma, and Dr. Mulder are with the ESPRi (Epidemiological and Social Psychiatric Research Institute), Department of Psychiatry, Erasmus Medical Centre, Rotterdam, the Netherlands. Dr. Mulder is also with Bavo Europoort, Rotterdam. Dr. van der Gaag is with EMGO Institute for Health and Care Research, VU University, Amsterdam, the Netherlands. He is also with the Parnassia Psychiatric Institute, the Hague, the Netherlands. Send correspondence to Dr. Kamperman (e-mail: [email protected]).
Astrid M. Kamperman, Ph.D.
Dr. Ruchlewska, Dr. Kamperman, Dr. Wierdsma, and Dr. Mulder are with the ESPRi (Epidemiological and Social Psychiatric Research Institute), Department of Psychiatry, Erasmus Medical Centre, Rotterdam, the Netherlands. Dr. Mulder is also with Bavo Europoort, Rotterdam. Dr. van der Gaag is with EMGO Institute for Health and Care Research, VU University, Amsterdam, the Netherlands. He is also with the Parnassia Psychiatric Institute, the Hague, the Netherlands. Send correspondence to Dr. Kamperman (e-mail: [email protected]).
André I. Wierdsma, Ph.D.
Dr. Ruchlewska, Dr. Kamperman, Dr. Wierdsma, and Dr. Mulder are with the ESPRi (Epidemiological and Social Psychiatric Research Institute), Department of Psychiatry, Erasmus Medical Centre, Rotterdam, the Netherlands. Dr. Mulder is also with Bavo Europoort, Rotterdam. Dr. van der Gaag is with EMGO Institute for Health and Care Research, VU University, Amsterdam, the Netherlands. He is also with the Parnassia Psychiatric Institute, the Hague, the Netherlands. Send correspondence to Dr. Kamperman (e-mail: [email protected]).
Mark van der Gaag, Ph.D.
Dr. Ruchlewska, Dr. Kamperman, Dr. Wierdsma, and Dr. Mulder are with the ESPRi (Epidemiological and Social Psychiatric Research Institute), Department of Psychiatry, Erasmus Medical Centre, Rotterdam, the Netherlands. Dr. Mulder is also with Bavo Europoort, Rotterdam. Dr. van der Gaag is with EMGO Institute for Health and Care Research, VU University, Amsterdam, the Netherlands. He is also with the Parnassia Psychiatric Institute, the Hague, the Netherlands. Send correspondence to Dr. Kamperman (e-mail: [email protected]).
Cornelis L. Mulder, M.D., Ph.D.
Dr. Ruchlewska, Dr. Kamperman, Dr. Wierdsma, and Dr. Mulder are with the ESPRi (Epidemiological and Social Psychiatric Research Institute), Department of Psychiatry, Erasmus Medical Centre, Rotterdam, the Netherlands. Dr. Mulder is also with Bavo Europoort, Rotterdam. Dr. van der Gaag is with EMGO Institute for Health and Care Research, VU University, Amsterdam, the Netherlands. He is also with the Parnassia Psychiatric Institute, the Hague, the Netherlands. Send correspondence to Dr. Kamperman (e-mail: [email protected]).

Competing Interests

The authors report no financial relationships with commercial interests.

Funding Information

Bavo Europoort Mental Helath Care Services: No number available
ZonMw10.13039/501100001826: 100-003-018
The trial was funded by grant 100-003-018 from the Dutch Organization for Health Research and Development (ZonMw) and by the mental health care organization, Bavo Europoort (trial registration NTR1166).

Metrics & Citations

Metrics

Citations

Export Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format
Citation style
Style
Copy to clipboard

View Options

View options

PDF/EPUB

View PDF/EPUB

Login options

Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.

Personal login Institutional Login Open Athens login
Purchase Options

Purchase this article to access the full text.

PPV Articles - Psychiatric Services

PPV Articles - Psychiatric Services

Not a subscriber?

Subscribe Now / Learn More

PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.

Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).

Media

Figures

Other

Tables

Share

Share

Share article link

Share