Skip to main content
Full access
Regular Articles
Published Online: 22 February 2016

Quantifying Poststroke Apathy With Actimeters

Publication: The Journal of Neuropsychiatry and Clinical Neurosciences

Abstract

The authors tested the hypothesis that wrist-worn actimeters can quantify the severity of poststroke apathy. The authors studied 57 patients admitted to an acute rehabilitation unit for ischemic or hemorrhagic stroke. After accounting for motor deficit of the affected arm and accounting for age, each increment of the Apathy Inventory score correlated with 5.6 fewer minutes of moving per hour. The overall statistical model had an R2 of only 0.34, suggesting unexplained factors for total movement time. Wrist-worn actimeters may serve as an objective, quantifiable measure of poststroke apathy in patients with an intact upper extremity but cannot be used alone to diagnose apathy.
Apathy occurs in approximately 35% of patients after stroke and is associated with more disability and lower quality of life.14 Apathy is defined as a reduction in goal-directed behavior and flattening of emotions compared with the patient’s previous degree of function, not attributable to an impairment of arousal or medication side effect.5 Apathy is typically defined using scales, based on patient report or clinician observation, all of which involve subjective interpretation.6 As in most behavioral disorders, there is currently no objective, quantifiable definition of apathy. This serves as a limitation for the conduct of observational and clinical trial research, because subjective measures limit interrater reliability and the interpretation of outcomes (e.g., quantifying change across time).
One approach to quantify human behavior is the use of actimeters. These are small, typically wireless accelerometers or gyroscopes that can be secured to participants’ bodies to record movement, typically for many days at a time. Actimeters have been used to quantify total movement, interlimb patterns, and body position, with the potential for secondary analyses including sleep duration, circadian rhythms, and steps taken per day (reviewed by Dobkin and Dorsch7; recent examples in stroke recovery are provided by Dorsch et al.8 and Bailey et al.9) Actimeters are a promising tool for clinical research because they are affordable, user-friendly, and noninvasive and they produce outputs that are ecologically valid and linearly quantifiable, unlike many standard clinical research tools.
Actimeters have already been used in studies investigating apathy to determine whether there is an association between apathy and the amount of time that participants move.10,11 These studies were performed among patients with a variety of brain injuries, as well as among individuals with Alzheimer's disease; the results showed that apathetic patients generally move less during the day. These findings may not be extrapolated to stroke survivors, because poststroke motor dysfunction directly affects movement ability. Thus, metrics associated with quantity of movement may reflect stroke severity rather than apathy severity.
Here, we asked whether the amount of movement measured by a wristwatch-style actimeter on the unaffected wrist correlates with severity of apathy in patients with stroke. We studied patients undergoing acute rehabilitation because this setting provides a controlled environment with similar daily demands placed on all patients. This study aimed to determine the potential utility of actimeters as a measure of apathy severity and thus their potential utility in future clinical trials. We hypothesized that participants with apathy would move less throughout the day. We also performed exploratory analyses on the correlation of amount of movement with recovery during rehabilitation.

Methods

Participants

From July 2014 to May 2015, we studied patients admitted to an acute rehabilitation hospital for deficits as a result of an ischemic or hemorrhagic stroke. To ensure that the actimeter values were not affected by disorders of movement, we did not study patients with bilateral upper extremity weakness (one arm had to have a Fugl-Meyer score of 66 of 66), or movement disorders such as Parkinson's disease. We also excluded patients for which we could not diagnose apathy severity, including individuals who were taking sedating or antipsychotic medications during the day, had hypoarousal such as from an infection or sleep disturbance, or had active psychiatric disease other than depression. This study was approved by the Burke Rehabilitation Hospital Committee for Human Rights in Research, and all participants or their legally authorized representatives gave signed informed consent.

Behavioral Outcome Measures

Apathy was quantified using the Apathy Inventory–Clinician Version (AI-C),12 scored weekly by the participants’ treating speech therapist as part of standard of care. The AI-C asks the clinician to report on (a) emotional blunting, (b) loss of initiative (i.e., goal-directed behavior), and (c) loss of interest in activities and other people. Each question is scored from 0 (no problem) to 4 (major problem), with a total score ranging from 0 to 12. AI-C scores ≥4 indicate clinically significant apathy. Scores were based on behaviors observed during the previous week. We report the AI-C score closest to the time of the actimetry recording.
To quantify depressive symptoms, we interviewed patients with the Montgomery-Åsberg Depression Rating Scale (MADRS; 0–60, with higher scores representing worse depression).13 Note that this was only performed on the subset of patients with intact communication ability (mild or no aphasia as judged by the treating speech pathologist).
Motor dysfunction was assessed with the upper extremity Fugl-Meyer motor scale by the patients’ treating occupational therapists.14,15 This scale assesses reflexes, strength, and dexterity, with scores ranging from 0 (flaccid paralysis) to 66 (full strength). Disability was assessed at admission and discharge by treating therapists using the FIM instrument (UB Foundation Activities, Inc., Buffalo). Scores ranged from 18 to 126, with lower scores representing more disability.
For the multiple regression analysis, the Fugl-Meyer upper limb assessment was used as a measure of stroke severity. The Fugl-Meyer scale was chosen in place of the FIM because the Fugl-Meyer is an impairment measure, which means that it is less affected by other factors. For example, we have observed that apathy can directly affect many of the measures within the FIM (e.g., apathetic patients are scored lower on language measures because they do not initiate speech, although their language skills are intact).

Actimeters

Quantity of movement was assessed using a wristwatch-style actimeter (GENEActiv; Activinsights Ltd., Kimbolton, UK) that uses a triaxial accelerometer. It was set to record acceleration at 40 Hz with all data recorded onto the device in units of milli-g (1000 milli-g=1 g=9.81 m/s2). Participants wore the actimeter on the wrist of an upper extremity with intact strength (normal Fugl-Meyer score of 66). Data were collected for at least 36 hours (two nights and the intervening day), although they were only analyzed from the day and the second night. We documented the schedule of therapy sessions and meals for all patients during the day.

Actimeter Data Processing

Acceleration values were extracted from the device and were further analyzed in custom MATLAB scripts (MATLAB 2012b; MathWorks, Inc., Natick, MA) unless otherwise noted. To minimize the effect of gravity on acceleration values, we removed slowly changing acceleration values (approximately >2 seconds) using a detrending algorithm with a moving window (“locdetrend” from chronux.org16). We then converted the three axes into one by calculating the total Euclidean distance of all axes from the origin. Finally, we binarized all acceleration values empirically into movement (>0.3 milli-g) or no movement. This binarization removed the influence of movement amplitude from the final analyses because we were interested in the amount of time spent moving rather than its amplitude. Results are all displayed as “total movement time,” meaning the amount of time where the acceleration value signified that the subject was moving.

Statistical Analyses

Statistical analyses were also performed in MATLAB using built-in and Statistics Toolbox codes. Scatterplots were produced with the code “scatter.m” after confirming that there were no overlapping data points. Because some data were not Gaussian distributed, we report medians and interquartile ranges and compare groups using the Wilcoxon rank-sum test. Box plots were created using MATLAB’s “boxplot.m” with default parameters. Multiple linear regression analysis was performed using MATLAB’s “linearmodel.fit” with default parameters.

Results

Patients Studied

A total of 57 patients consented and completed data acquisition. We collected data from an additional 14 participants, but these data were not used for 11 patients because they removed the actimeters before study completion, and device error occurred in three patients. Of the 11 participants who removed the device, four had apathy. Of the 57 participants studied, 33 had sufficient communication ability to perform the MADRS interview for depression symptoms.
Participants had a wide range of apathy scores (Figure 1), with 21 patients (36%) with apathy (defined as AI-C ≥4) and the remaining 36 (44%) without apathy. Note that this does not reflect the demographics of the population at this hospital as reported by Kennedy et al.3; rather, this reflects our attempt to obtain data on a similar number of participants with apathy relative to those without apathy. Apathetic and nonapathetic patients were well matched on age and gender, but those with apathy were generally more disabled from their stroke and had less recovery during their stay in the rehabilitation unit (Table 1).
FIGURE 1. Histogram of Apathy Inventory Scores of All Patients
TABLE 1. Participant Demographic Dataa
CharacteristicApatheticNot Apatheticp
Age in years73±8.577.5±140.36
Days since stroke8±46±2<0.001
Fugl-Meyer score33±556.5±38.5<0.001
FIM at admission30±1560±19.5<0.001
FIM at discharge40±25.390.5±20<0.001
Change in FIM19.5±1228±13.50.03
Gender (male/female)10/1119/170.98
a
All variables are described as medians ± interquartile ranges, except for gender. All statistical tests performed were Wilcoxon rank-sum tests except for gender, where a chi-square was used.

Correlation of Apathy Severity Versus Quantity of Movement

Our primary aim was to investigate whether there was a correlation between apathy severity and amount of movement during the hours of 9 a.m. to 5 p.m. (Figure 2). During this time, the patients typically participated in physical therapy, occupational therapy, speech therapy, meals, and free time. We found that apathy severity inversely correlated with total movement per hour (Pearson r=−0.49, p<0.001).
FIGURE 2. Scatterplot of Apathy Inventory Score Versus Movement Time in Minutes Moving per Hour Using Data Acquired From 9 a.m. to 5 p.m.a
a The line represents best fit using least-squares method implemented with MATLAB’s “Isline.m” (r=−0.49, p<0.001).
It is also possible that age and stroke severity affect total movement, so we accounted for these factors in a multiple linear regression. We used the Fugl-Meyer motor score of the more affected upper extremity as a marker for stroke severity (note that the actimeter was on an unaffected upper extremity). We found that after accounting for age and stroke severity, movement time remained inversely correlated with AI-C (Table 2). With each incremental higher number that participants scored on the AI-C, they moved approximately 5.6 minutes less per hour from 9 a.m. to 5 p.m. The Fugl-Meyer score of the affected limb also correlated with the amount of movement performed by the unaffected limb, but age did not.
TABLE 2. Results of Multiple Regression Analysis for Movement Time From 9 a.m. to 5 p.m.a
 Estimate (Beta)SEtStatp
Intercept9.561.835.24<0.001
AI-C score–5.621.03–5.47<0.001
Fugl-Meyer–0.060.01–5.570.04
Age–0.030.02–1.110.21
a
Movement time (minutes per hour)=~ 1+beta1*AI-C score+beta2*Fugl-Meyer+beta3*age; number of observations=57; error degrees of freedom=53; root mean square error=2.08; R2=0.38; adjusted R2=0.34; F-statistic versus constant model=10.8; and p=1.35e–05. AI-C, Apathy Inventory Clinician Version.
Depression scoring with the MADRS was only available in the 33 patients with intact communication. In this subgroup, we found no significant correlation between severity of depression symptoms and total movement time (Pearson p=0.17). We therefore did not include MADRS score in the multiple regression analysis.
We performed further exploratory analyses on the correlation of apathy severity with movement time during different settings (Figure 3). We found that apathetic patients moved less during physical and occupational therapy sessions as well as in the period outside of physical therapy (all p<0.001 using t tests). At night (defined as 11 p.m. to 7 a.m.), there was no difference in total movement between apathetic and nonapathetic patients, suggesting no difference in the amount of sleep or movement during sleep.
FIGURE 3. Total Movement Time During Different Settingsa
aOT, occupational therapy; PT, physical therapy.
Previous studies have found that patients with poststroke apathy recover slower during acute rehabilitation.2,3,17,18 Here, we confirmed this finding as apathy severity correlated with change in FIM score from admission to discharge (Pearson r=−0.44, p<0.001). Movement time also correlated with change in FIM score (Pearson r=0.41, p=0.002) but could be due to a strong association with apathy severity. To determine this, we tested the association between movement time and change in FIM score among the 36 nonapathetic patients (AI-C <4) and found no correlation between movement time and change in FIM score (Pearson r=0.06, p=0.71).

Discussion

The primary finding of this study is that the amount of movement of the unaffected upper extremity among patients with stroke undergoing inpatient rehabilitation correlates well with their severity of apathy. This finding remained positive even after accounting for the severity of stroke (defined by the weakness of the patients’ more affected side) and age. These findings suggest that actimeters may serve as a useful adjunctive measurement of apathy severity.
Other studies have looked at the correlation of apathy with the amount of movement by actimeters and produced similar findings to ours. The closest study to ours was by Müller et al.,11 who used wristwatch-style actimeters to study 24 patients with a variety of brain injuries (stroke, hypoxia, tumor, and trauma) and 12 age-matched controls. One-half of their patients had significant apathy and one-half had minimal to no apathy. The authors found that patients with significant apathy moved less, whereas patients without significant apathy were similar to controls. In addition, David et al.10 studied 107 patients with Alzheimer's disease for 7 days and found that the 43 patients with apathy had reduced daytime mean motor activity relative to the 64 patients without apathy. These studies, combined with ours, suggest that actimeters may be useful adjunct measures of apathy in a wide range of conditions, including psychiatric diseases such as major depressive disorder and schizophrenia and other neurodegenerative conditions such as Parkinson's disease.
Both Müller et al.11 and David et al.10 also reported that patients with apathy had more periods of daytime napping. We did not specifically measure this because it is impossible to differentiate sleeping versus sitting still while awake with a wristwatch actimeter alone. David et al.10 also sought to determine whether actimeters can be used to diagnose apathy. They used receiver-operating characteristic curve analysis and reported that amount of movement could be used to distinguish apathy from nonapathy, although with a sensitivity of 81% and specificity of 71%. Our findings suggest that actimeters alone cannot be used to diagnose apathy because there is significant variability in the amount of movement in patients with no signs of apathy (AI-C=0; Figure 2); instead, actimeters could be used as an adjunctive tool in combination with other clinical assessments.
The consistent findings of inverse correlations between apathy severity and amount of daytime movement across this and other studies suggest that actimeters may be useful tools for generating outcome measures in clinical trials for treatment of poststroke apathy. As reviewed by Dobkin and Dorsch,7 actimeters and similar noninvasive, mobile tools offer significant advantages for clinical research. These tools can record data from patients in their homes, making the information more ecologically valid and less costly. They can also record information for many days to ensure that more aspects of behavior are captured. In addition, the data these tools produce are linear and therefore easier for analysis than typical clinical scales with arbitrary scoring systems. On the other hand, current outputs from these devices are limited in that what they report may not reflect the behavior of interest (e.g., measuring all movement rather than goal-directed movement); however, advancements in algorithm and device development suggest that this hurdle can be overcome.8,9,19
A secondary finding from this study involves the role of apathy and recovery. Our finding that apathy correlates with less recovery of disability (FIM) during rehabilitation stay is consistent with other studies.2,3,17,18 The mechanism by which apathy affects recovery is not clear. It could be due to reduced participation in rehabilitation; however, a study that looked specifically at participation found no correlation with apathy or depression.20 The role of apathy in recovery could also be attributable to reduced practice outside of therapy—we did not measure this specifically, but we found no correlation between overall activity (movement of the unaffected extremity) and recovery among the nonapathetic patients. Previous meta-analyses have reported that amount of therapy time provided correlates with recovery after stroke.21,22 Future studies could use actimeters on the affected extremities to more specifically determine the role of practicing of movement and rate of recovery.
This study had multiple limitations affecting interpretation and generalization. One was that our measure of apathy severity (AI-C score) may not always represent poststroke apathy. In some cases, this is because patients may have had apathy before stroke onset (families were not interviewed as part of the scoring process). In other cases, the apathy may be attributable to concurrent depression or neurodegenerative disease. These limitations are not significant because the goal of this study was to determine whether apathy could be quantified by actimeters in patients with stroke, regardless of the cause. Another limitation was that actimeters measure any movement of the extremity and are unable to specifically identify goal-directed movement, which is a core aspect of apathy. Furthermore, goal-directed behavior is only one aspect of apathy, and actimeters cannot measure goal-directed cognition and emotional expression. Finally, our statistical model of apathy severity, stroke severity, and age (Table 2) explained less than one-half of the variance in amount of movement (adjusted R2=0.34), suggesting that there are other unexplained factors. This remaining variability in movement time suggests that further information is required before using movement time as a diagnostic test of poststroke apathy.
The findings here suggest multiple directions of future research. One is to better explain the variability in movement time not explained by age, apathy severity, and stroke severity. This could include measures of fatigue and sleepiness, pain, or other measures of motivation. Further data should also come from inpatient and outpatient populations for longer periods to determine whether movement amount is stable and if it correlates with the change in apathy severity that occurs in some patients naturally across time.3,23 Actimeters could be used as low-cost exploratory outcome measures in clinical trials of apathy treatments in a variety of conditions. Finally, quantification of apathy may be improved by algorithms that allow actimeters to measure goal-directed behavior, as well as the addition of other devices that can be used to measure goal-directed cognition and emotional expression.24

Acknowledgments

The authors thank Janet Herbold and the speech-language pathologists at Burke Rehabilitation Hospital for assistance with acquiring the data.

References

1.
van Dalen JW, Moll van Charante EP, Nederkoorn PJ, et al: Poststroke apathy. Stroke 2013; 44:851–860
2.
Harris AL, Elder J, Schiff ND, et al: Post-stroke apathy and hypersomnia lead to worse outcomes from acute rehabilitation. Transl Stroke Res 2014; 5:292–300
3.
Kennedy JM, Granato DA, Goldfine AM: Natural history of poststroke apathy during acute rehabilitation. J Neuropsychiatry Clin Neurosci 2015; 27:333–338
4.
Mayo NE, Fellows LK, Scott SC, et al: A longitudinal view of apathy and its impact after stroke. Stroke 2009; 40:3299–3307
5.
Robert P, Onyike CU, Leentjens AFG, et al: Proposed diagnostic criteria for apathy in Alzheimer’s disease and other neuropsychiatric disorders. Eur Psychiatry 2009; 24:98–104
6.
Clarke DE, Ko JY, Kuhl EA, et al: Are the available apathy measures reliable and valid? A review of the psychometric evidence. J Psychosom Res 2011; 70:73–97
7.
Dobkin BH, Dorsch A: The promise of mHealth: daily activity monitoring and outcome assessments by wearable sensors. Neurorehabil Neural Repair 2011; 25:788–798
8.
Dorsch AK, Thomas S, Xu X, et al; SIRRACT investigators: SIRRACT: an international randomized clinical trial of activity feedback during inpatient stroke rehabilitation enabled by wireless sensing. Neurorehabil Neural Repair 2015; 29:407–415
9.
Bailey RR, Klaesner JW, Lang CE: Quantifying real-world upper-limb activity in nondisabled adults and adults with chronic stroke. Neurorehabil Neural Repair 2015; 29:969–978
10.
David R, Mulin E, Friedman L, et al: Decreased daytime motor activity associated with apathy in Alzheimer disease: an actigraphic study. Am J Geriatr Psychiatry 2012; 20:806–814
11.
Müller U, Czymmek J, Thöne-Otto A, et al: Reduced daytime activity in patients with acquired brain damage and apathy: a study with ambulatory actigraphy. Brain Inj 2006; 20:157–160
12.
Robert PH, Clairet S, Benoit M, et al: The apathy inventory: assessment of apathy and awareness in Alzheimer’s disease, Parkinson’s disease and mild cognitive impairment. Int J Geriatr Psychiatry 2002; 17:1099–1105
13.
Montgomery SA, Asberg M: A new depression scale designed to be sensitive to change. Br J Psychiatry 1979; 134:382–389
14.
Fugl-Meyer AR, Jääskö L, Leyman I, et al: The post-stroke hemiplegic patient. 1. A method for evaluation of physical performance. Scand J Rehabil Med 1975; 7:13–31
15.
Gladstone DJ, Danells CJ, Black SE: The Fugl-Meyer assessment of motor recovery after stroke: a critical review of its measurement properties. Neurorehabil Neural Repair 2002; 16:232–240
16.
Mitra P, Bokil H: Observed Brain Dynamics, 1st ed. New York, Oxford University Press, 2007
17.
Santa N, Sugimori H, Kusuda K, et al: Apathy and functional recovery following first-ever stroke. Int J Rehabil Res 2008; 31:321–326
18.
Hama S, Yamashita H, Shigenobu M, et al: Depression or apathy and functional recovery after stroke. Int J Geriatr Psychiatry 2007; 22:1046–1051
19.
Patel S, Hughes R, Hester T, et al: Tracking motor recovery in stroke survivors undergoing rehabilitation using wearable technology. Conf Proc IEEE Eng Med Biol Soc 2010; 2010:6858–6861
20.
Skidmore ER, Whyte EM, Holm MB, et al: Cognitive and affective predictors of rehabilitation participation after stroke. Arch Phys Med Rehabil 2010; 91:203–207
21.
Kwakkel G, van Peppen R, Wagenaar RC, et al: Effects of augmented exercise therapy time after stroke: a meta-analysis. Stroke 2004; 35:2529–2539
22.
Lohse KR, Lang CE, Boyd LA: Is more better? Using metadata to explore dose-response relationships in stroke rehabilitation. Stroke 2014; 45:2053–2058
23.
Withall A, Brodaty H, Altendorf A, et al: A longitudinal study examining the independence of apathy and depression after stroke: the Sydney Stroke Study. Int Psychogeriatr 2011; 23:264–273
24.
Berke EM, Choudhury T, Ali S, et al: Objective measurement of sociability and activity: mobile sensing in the community. Ann Fam Med 2011; 9:344–350

Information & Authors

Information

Published In

Go to The Journal of Neuropsychiatry and Clinical Neurosciences
Go to The Journal of Neuropsychiatry and Clinical Neurosciences
The Journal of Neuropsychiatry and Clinical Neurosciences
Pages: 199 - 204
PubMed: 26900735

History

Received: 26 September 2015
Revision received: 27 October 2015
Accepted: 15 November 2015
Published online: 22 February 2016
Published in print: Summer 2016

Authors

Details

Andrew M. Goldfine, M.D., M.Sc.
From the Dept. of Neurology, Stony Brook Medicine, Stony Brook, NY (AMG); Burke Medical Research Institute, White Plains, NY (BD, JMK, BS, CS, DP); and Weill Cornell Medical College of Cornell University, New York, NY (BD, DP).
Behdad Dehbandi, M.Sc.
From the Dept. of Neurology, Stony Brook Medicine, Stony Brook, NY (AMG); Burke Medical Research Institute, White Plains, NY (BD, JMK, BS, CS, DP); and Weill Cornell Medical College of Cornell University, New York, NY (BD, DP).
Juliana M. Kennedy, B.S.
From the Dept. of Neurology, Stony Brook Medicine, Stony Brook, NY (AMG); Burke Medical Research Institute, White Plains, NY (BD, JMK, BS, CS, DP); and Weill Cornell Medical College of Cornell University, New York, NY (BD, DP).
Briana Sabot
From the Dept. of Neurology, Stony Brook Medicine, Stony Brook, NY (AMG); Burke Medical Research Institute, White Plains, NY (BD, JMK, BS, CS, DP); and Weill Cornell Medical College of Cornell University, New York, NY (BD, DP).
Cory Semper, M.E.
From the Dept. of Neurology, Stony Brook Medicine, Stony Brook, NY (AMG); Burke Medical Research Institute, White Plains, NY (BD, JMK, BS, CS, DP); and Weill Cornell Medical College of Cornell University, New York, NY (BD, DP).
David Putrino, Ph.D., P.T.
From the Dept. of Neurology, Stony Brook Medicine, Stony Brook, NY (AMG); Burke Medical Research Institute, White Plains, NY (BD, JMK, BS, CS, DP); and Weill Cornell Medical College of Cornell University, New York, NY (BD, DP).

Notes

Send correspondence to Dr. Goldfine; e-mail: [email protected]

Competing Interests

The authors report no financial relationships with commercial interests.

Funding Information

Research reported in this publication was supported by the Burke Medical Research Institute and by award K23HD079556 from the NIH Eunice Kennedy Shriver National Institute of Child Health and Human Development. This work was also funded in part by the Harvey Goodstein Charitable Foundation, as well as by Gary, Sari, and Annie Roboff in memory of their mother, Phyllis Roboff.

Metrics & Citations

Metrics

Citations

Export Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format
Citation style
Style
Copy to clipboard

View Options

View options

PDF/EPUB

View PDF/EPUB

Login options

Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.

Personal login Institutional Login Open Athens login
Purchase Options

Purchase this article to access the full text.

PPV Articles - Journal of Neuropsychiatry and Clinical Neurosciences

PPV Articles - Journal of Neuropsychiatry and Clinical Neurosciences

Not a subscriber?

Subscribe Now / Learn More

PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.

Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).

Media

Figures

Other

Tables

Share

Share

Share article link

Share