Skip to main content

Abstract

Objective:

The authors sought to identify diagnostic risk factors of manic, mixed, or hypomanic episodes in the offspring of parents with bipolar disorder (“high-risk offspring”).

Method:

High-risk offspring 6–18 years old (N=391) and demographically matched offspring (N=248) of community parents without bipolar disorder were assessed longitudinally with standardized diagnostic instruments by staff blind to parental diagnoses. Follow-up assessments were completed in 91% of the offspring (mean follow-up interval, 2.5 years; mean follow-up duration, 6.8 years).

Results:

Compared with community offspring, high-risk offspring had significantly higher rates of subthreshold mania or hypomania (13.3% compared with 1.2%), manic, mixed, or hypomanic episodes (9.2% compared with 0.8%), and major depressive episodes (32.0% compared with 14.9%). They also had higher rates of attention deficit hyperactivity disorder (30.7% compared with 18.1%), disruptive behavior disorders (27.4% compared with 15.3%), anxiety disorders (39.9% compared with 21.8%), and substance use disorders (19.9% compared with 10.1%), but not unipolar major depressive disorder (major depression with no bipolarity; 18.9% compared with 13.7%). Multivariate Cox regressions showed that in the high-risk offspring, subthreshold manic or hypomanic episodes (hazard ratio=2.29), major depressive episodes (hazard ratio=1.99), and disruptive behavior disorders (hazard ratio=2.12) were associated with subsequent manic, mixed, or hypomanic episodes. Only subthreshold manic or hypomanic episodes (hazard ratio=7.57) were associated when analyses were restricted to prospective data.

Conclusions:

Subthreshold manic or hypomanic episodes were a diagnostic risk factor for the development of manic, mixed, or hypomanic episodes in the offspring of parents with bipolar disorder and should be a target for clinical assessment and treatment research. Major depressive episodes and disruptive behavior disorders are also indications for close clinical monitoring of emergent bipolarity in high-risk offspring.
Most adults with bipolar disorder recall having mood symptoms before age 18, and there is growing evidence that those with childhood or adolescent onset have a worse prospective course of mood symptoms and higher rates of comorbid psychiatric illness as compared with those with adult onset (13). Furthermore, there is on average a lag of more than a decade between the onset of impairing mood symptoms and a bipolar diagnosis in bipolar adults with onset during youth (4). Improved identification of bipolar disorder in childhood and adolescence may increase the opportunity to apply evidence-based treatments in earlier phases of the illness, which in turn has the potential to improve long-term course and outcomes. Given that bipolar disorder runs in families (5) and has a strong genetic basis (6), the offspring of parents with bipolar disorder are an excellent population in which to examine diagnostic precursors of bipolar disorder.
Most studies of the child and adolescent offspring of bipolar parents show that the offspring have elevated rates of bipolar disorder, major depression, and anxiety disorders relative to comparison groups (7, 8). However, results are mixed regarding attention deficit hyperactivity disorder (ADHD), oppositional defiant disorder, and conduct disorder (914). There are only a few high-risk studies with longitudinal data, but low numbers of individuals with bipolar disorder in the high-risk group limit the studies’ ability to identify predictors of developing bipolar disorder. Depression was found to precede manic or hypomanic episodes in nearly all high-risk offspring with bipolar disorder in two longitudinal studies, although the mean age at intake was 16.5 years in both studies (15, 16). Episodic symptoms such as crying, anxiety, hyperalertness, and decreased sleep in childhood preceded the onset of mania in a small sample of offspring of Amish parents with bipolar disorder, but power limitations precluded formal statistical analyses (17).
The Pittsburgh Bipolar Offspring Study (BIOS) is the largest study to date of offspring of parents with bipolar disorder. A unique feature of BIOS is that offspring were assessed for subthreshold episodes of manic symptoms using a priori operationalized criteria from the Course and Outcome of Bipolar Youth (COBY) study (18). Previous results from the intake assessment demonstrated that the offspring of parents with bipolar disorder had higher rates of anxiety disorders, bipolar I disorder, and bipolar spectrum disorders (bipolar I and II disorders or bipolar disorder not otherwise specified) relative to comparison offspring (12). A diagnosis of a bipolar spectrum disorder in the high-risk offspring was associated with younger parental age at the child’s birth, older offspring age, higher rates of anxiety and disruptive behavior disorders in the offspring, and both parents having a bipolar diagnosis (19).
Our primary aims in this study were 1) to confirm and extend the findings regarding diagnostic differences between the offspring of parents with bipolar disorder (subsequently referred to as “high-risk offspring”) and offspring of community comparison parents now that longitudinal data are included and the mean age of the sample is 18 years; and 2) to describe the developmental trajectory of mood episodes and identify diagnostic precursors of full-threshold bipolar disorder (defined as the presence of manic, mixed, or hypomanic episodes, which we refer to hereafter as “mania/hypomania”) in the offspring of parents with bipolar disorder. Based on the studies noted above, we hypothesized that subthreshold mania or hypomania, depression, anxiety, and disruptive behavior disorders would be associated with future mania/hypomania.

Method

The methods of BIOS have been described in detail elsewhere (12). The study was approved by the University of Pittsburgh Institutional Review Board.

Sample

The sample was recruited through the parent probands. Parents with bipolar disorder were recruited through advertisements (53%), other research studies (31%), and outpatient clinics (16%). Parents with bipolar disorder had to meet DSM-IV criteria for bipolar I or II disorder and live within 200 miles of Pittsburgh. Exclusion criteria were a lifetime diagnosis of schizophrenia, mental retardation, a mood disorder secondary to medical illness, substance use, or use of psychoactive medications. Comparison parents were recruited from the community using random digit dialing and were group-matched to the bipolar parents by age, sex, and neighborhood. Comparison parents could not have a parent or sibling with bipolar disorder, and the biological coparent could not have bipolar disorder. The study included all offspring of the parent probands who were in the age range of 6 to 18 years (including siblings and half-siblings), unless the child had mental retardation.

Procedures

Study procedures were initiated after informed consent was obtained from the parents and assent from the children (12). Parent probands and participating biological coparents (31%) were assessed for DSM-IV disorders by direct interview using the Structured Clinical Interview for DSM-IV (SCID) and the ADHD, oppositional defiant disorder, conduct disorder, and separation anxiety disorder sections of the Schedule for Affective Disorders and Schizophrenia for School-Age Children–Present and Lifetime Version (K-SADS-PL). The psychiatric history of nonparticipating biological coparents was obtained from the parent proband using the Family History Research Diagnostic Criteria method (20) plus the ADHD, oppositional defiant disorder, conduct disorder, and separation anxiety items from the K-SADS-PL.
At intake, parents were interviewed about their offspring and the children were directly interviewed using the K-SADS-PL for non-mood disorders and the K-SADS Mania Rating Scale and the depression items from the K-SADS–Present Version. Symptoms that are criteria for more than one diagnosis (e.g., distractibility) were not rated as fulfilling criteria for a mood disorder unless they had their onset or significantly intensified during a period of abnormal mood. Subthreshold mania or hypomania was diagnosed using the bipolar disorder not otherwise specified criteria from the COBY study (18) and was defined as distinct periods of abnormally elevated, expansive, or irritable mood that met the following criteria: 1) at least two DSM-IV manic symptoms (three if the mood is irritable only) that were clearly associated with the onset of abnormal mood; 2) a clear change in functioning associated with the onset of these affective symptoms; 3) the presence of the elated and/or irritable mood and manic symptoms for a significant part of the day (a minimum of 4 hours, not necessarily consecutive); and 4) a minimum of 4 days (not necessarily consecutive) of meeting criteria 1–3 over the subject’s lifetime.
Socioeconomic status was determined using the Hollingshead scale (21).
Follow-up evaluations were performed approximately every 2 years using the same diagnostic instruments cited above for parents and offspring younger than age 19. Offspring age 19 and older were assessed using the SCID for non-mood disorders, and the K-SADS Mania Rating Scale and the depression items from the K-SADS–Present Version for mood disorders. If a participant was not able to complete an interview at the 2-year interval, attempts to schedule and complete the evaluation would continue unless the participant or the parent or guardian asked to withdraw from the study. Follow-up evaluations focused on assessment of the interval since the previous interview.
Assessments were performed by interviewers with bachelor’s or master’s degrees who had intensive training with the diagnostic instruments and were required to achieve 80% agreement with a certified rater. Interviewers who assessed offspring were blind to the parents’ diagnoses, as different interviewers were used to assess the parents. All information was presented to a child psychiatrist, who reviewed the data to confirm diagnoses. Psychiatrists were blind to parental diagnoses. As specified in the K-SADS instructions, all available data were used to assign summary symptom and diagnostic scores, and discrepant information was discussed at a case conference with the psychiatrist.
Diagnostic reliability was assessed using audiotapes of 44 actual BIOS assessments, which were rated by two to eight BIOS interviewers (mean=5.4). The kappa statistic for diagnostic reliability was 0.86 for bipolar spectrum disorders, 0.77 for bipolar I or II disorder versus bipolar disorder not otherwise specified versus no bipolar disorder, 0.64 for major depressive episode, 0.71 for any depressive episode, 0.86 for ADHD, 0.78 for anxiety disorders, 0.84 for oppositional defiant disorder and/or conduct disorder, and 1.0 for substance use disorders.
The onset age of specific disorders and mood episodes was set to the estimated age at which the participant met full DSM-IV criteria. For consistency with other longitudinal high-risk studies, the onset of full-threshold bipolar disorder in the offspring was set to when they first met DSM-IV criteria for a manic, mixed, or hypomanic episode. The onset age of bipolar spectrum disorder was set to the age of the first time the participant met criteria for subthreshold mania or hypomania or full-threshold bipolar disorder.

Statistical Analysis

Comparisons of demographic and clinical characteristics were evaluated between parent and biological coparent groups using t tests and chi-square tests. Comparisons between offspring groups used mixed logistic regression models to control for within-family correlation. Demographic variables that showed group differences below a p value of 0.2 were included as potential covariates in subsequent models comparing diagnostic differences between the high-risk and comparison offspring. Potential covariates were entered in a forward stepwise approach (with the criteria of p<0.2 for entry and p<0.1 for retention used for all stepwise models). Mixed regression models controlling for parental psychopathology were also used to compare diagnostic differences among the offspring of bipolar parents and three different comparison offspring groups: all comparison offspring, the offspring of comparison parent probands who had a lifetime diagnosis of an axis I disorder, and the offspring of healthy comparison parent probands. Potential covariates were entered in a forward stepwise approach and included the demographic variables from the previous analyses, as well as parental proband and coparent non-bipolar diagnoses. Offspring groups were compared on the cumulative risk of developing mania/hypomania and of developing any bipolar spectrum disorder (bipolar I or II disorder or bipolar disorder not otherwise specified) using Kaplan-Meier survival analyses.
Diagnostic precursors of mania/hypomania were evaluated in the high-risk offspring using Cox regression models that included family membership as a random effect. Diagnostic factors that were associated with hazard of developing mania/hypomania at a level of p<0.2 in univariate models were included in a stepwise multivariate Cox regression with the retention criterion of p<0.1. Since mania/hypomania would be diagnosed in an offspring with a prior substance use disorder only if there was clear evidence that the two disorders were independent, the temporal association between the two conditions may have been distorted. Therefore, we did not include substance use disorders in the multivariate models. Potential confounding factors were then evaluated by adding to them to the model one at a time, and they were retained if they significantly affected results (defined as a change >15% in the hazard ratio of diagnostic factors retained in the model). Potential confounding factors were as follows: offspring age at intake; offspring age at last assessment; year at intake; number of assessments; duration of follow-up; whether the first follow-up assessment occurred within 3 years of intake; whether the second follow-up assessment occurred within 5 years of intake; offspring sex; offspring race; socioeconomic status; parent proband sex; parent proband age at onset of their own bipolar disorder; and parent proband bipolar subtype (I or II). Sensitivity analyses repeating the Cox regressions using the same methodology were performed in the subset of high-risk offspring, with follow-up for those who did not have a history of mania/hypomania at intake. To minimize the influence of recall bias, mood episodes and diagnoses were considered to precede the onset of mania/hypomania in the sensitivity analyses only if they were diagnosed at an assessment prior to the assessment at which mania/hypomania was identified.

Results

Participants

The study included 391 offspring of 236 parents with bipolar disorder (bipolar I disorder, N=170; bipolar II disorder, N=66) and 248 offspring of 141 community comparison parents. Two community comparison parents developed bipolar disorder over follow-up and were reassigned to the bipolar disorder group. One additional bipolar disorder family was entered into the study after the initial analyses, and one child of a parent with bipolar disorder was determined to have mental retardation and was removed from the study.
At least one follow-up visit was completed for 90.9% of the offspring, and follow-up rates did not differ between offspring groups (Table 1). The initial follow-up assessment was completed “on schedule” (within 3 years of intake) for 78.6% of offspring, with no difference between offspring groups. The rate of second follow-up assessments that were on schedule (within 5 years of intake) was nonsignificantly lower for the high-risk offspring than for the comparison offspring (63.4% compared with 71.8%). There were no differences between the high-risk offspring and comparison offspring in the mean number of follow-up assessments (2.7 [SD=1.3] compared with 2.7 [SD=1.2]), duration of follow-up (6.8 years [SD=2.2] compared with 6.9 years [SD=2.0]), or interval between assessments (2.5 years [SD=1.1] compared with 2.4 years [SD=0.8]).
TABLE 1. Demographic Characteristics of Offspring of Parents With Bipolar Disorder (High-Risk Offspring) and Offspring of Community Comparison Parents
CharacteristicHigh-Risk Offspring (N=391)Comparison Offspring (N=248)
 N%N%
Female19148.913454.0
White31781.118474.2
Living with both biological parentsa16341.715462.1
Had at least 1 follow-up assessment35791.322490.3
First follow-up assessment completed within 3 years of intake30778.519578.6
Second follow-up assessment completed within 5 years of intake24863.417871.8
 MeanSDMeanSD
Age at intake (years)11.93.711.83.6
Age at last assessment (years)18.14.818.04.5
Mother’s age at offspring’s birth (years)a26.75.828.35.6
Father’s age at offspring’s birth (years)29.57.630.47.0
a
Significant difference between groups; models adjusted for within-family correlation.
Offspring for whom follow-up assessment data were available were more likely to be white, to be living with both biological parents at baseline, and to have a lifetime diagnosis of a major depressive episode, anxiety disorder, and a substance use disorder at baseline, compared with those who did not complete any follow-up assessments. The groups did not differ in sex distribution or in rates of bipolar spectrum disorders, ADHD, oppositional defiant disorder, or conduct disorder (see Table S1 in the data supplement that accompanies the online edition of this article). Offspring with follow-up data had higher socioeconomic status on average, and their mothers and fathers were older on average at the time of the offspring’s birth.

Offspring Demographic Characteristics

Compared with community comparison offspring, high-risk offspring were less likely to be living with both biological parents, and their mothers’ mean age at the time of the offspring’s birth was significantly lower (Table 1).

Parent Factors

Relative to the comparison parents, the parents with bipolar disorder were more likely to be white, were less likely to be married, were younger, and were of lower socioeconomic status (see Table S2 in the data supplement). Parents with bipolar disorder were more likely to have a history of a major depressive episode and of a non-mood axis I disorder, including anxiety disorders, ADHD, disruptive behavior disorders (oppositional defiant or conduct disorder), and substance use disorders. These factors were eligible for inclusion in final multivariate models comparing offspring groups.
The biological coparents of the high-risk offspring were more likely to have an axis I diagnosis, depression, and a substance use disorder (see Table S3 in the data supplement). There was no difference between offspring groups in the proportion of coparents who were assessed using the SCID compared with the family history method.

Offspring Lifetime Diagnoses and Mood Episodes at Last Assessment

Relative to comparison offspring, high-risk offspring had significantly higher lifetime rates of all of the disorders and mood episodes examined except obsessive-compulsive disorder, posttraumatic stress disorder, conduct disorder, and unipolar major and minor depressive disorders (Table 2). After adjustment for parent and coparent lifetime axis I diagnoses (Table 3), there was little change in the results, except that unipolar major depressive disorder was significantly higher in the high-risk offspring. When the comparison was limited to high-risk offspring compared with offspring of comparison parent probands who had a lifetime axis I disorder, there were no differences between groups in unipolar depression, ADHD, and disruptive behavior disorders.
TABLE 2. Lifetime Diagnoses at Last Assessment Among Offspring of Parents With Bipolar Disorder (High-Risk Offspring) and Offspring of Community Comparison Parents
 High-Risk Offspring (N=391)Comparison Offspring (N=248)Analysisa
DiagnosesN%N%Fp
Any axis I disorder29074.212048.429.9<0.0001
Any mood disorder18948.35622.630.2<0.0001
 Any bipolar spectrum disorder7519.252.031.5<0.0001
  Bipolar I disorder153.810.46.840.009
  Bipolar II disorder184.610.49.390.002
  Bipolar disorder not otherwise specified4210.731.218.2<0.0001
 Any unipolar depressive disorder11429.25120.64.400.04
  Major depressive disorder7418.93413.72.680.10
  Minor depressive disorderb4010.2176.90.940.33
Mood episodes  0   
 Manic, mixed, or hypomanic369.220.813.20.0003
 Subthreshold manic or hypomanicc5213.331.223.5<0.0001
 Any depressive episode18146.35421.829.5<0.0001
  Major depressive12532.03714.920.3<0.0001
  Minor depressive10827.62510.126.0<0.0001
Any non-mood axis I disorder26367.310642.726.2<0.0001
 Any anxiety disorder15639.95421.820.2<0.0001
  Generalized anxiety disorder8020.5176.925.8<0.0001
  Social phobia4912.5176.95.480.02
  Separation anxiety disorder6717.1176.911.60.001
  Panic disorder276.962.45.020.03
  Obsessive-compulsive disorder215.462.42.790.10
  Posttraumatic stress disorder338.4145.60.750.39
 Attention deficit hyperactivity disorder12030.74518.16.060.01
 Disruptive behavior disorders10727.43815.34.850.03
 Oppositional defiant disorder9925.33212.95.870.02
 Conduct disorder379.5145.70.910.34
 Substance use disorder7819.92510.110.10.002
a
Forward stepwise models adjusted for family membership and the following pool of potential covariates (p<0.2 for entry, p<0.1 for retention): race, living with both biological parents, mother’s age at child’s birth, proband’s age at intake, second follow-up assessment completed within 5 years of intake, and socioeconomic status. P values are adjusted for demographic characteristics.
b
Dysthymia or depressive disorder not otherwise specified.
c
Subthreshold manic or hypomanic episodes not diagnosed after onset of manic, mixed, or hypomanic episodes.
TABLE 3. Comparison of Diagnostic Rates Between Offspring of Parents With Bipolar Disorder (High-Risk Offspring) and Offspring of Community Comparison Parents
 High-Risk Offspring (N=391) Versus Offspring of All Comparison Parents (N=248)aHigh-Risk Offspring (N=391) Versus Offspring of Comparison Parents Who Had a Lifetime Axis I Disorder (N=149)aHigh-Risk Offspring (N=391) Versus Offspring of Healthy Comparison Parents (N=99)b
DiagnosesHazard Ratio95% CIpHazard Ratio95% CIpHazard Ratio95% CIp
Any axis I disorder2.151.39, 3.340.00062.131.31, 3.440.0023.942.30, 6.74<0.0001
Any mood disorder2.681.64, 4.37<0.00012.601.53, 4.420.00044.132.15, 7.93<0.0001
Bipolar spectrum disorders10.584.15, 26.93<0.000110.943.34, 35.81<0.000110.032.37, 42.460.002
Bipolar I and II disorders11.342.69, 47.820.00113.641.84, 101.050.019.031.22, 67.140.03
Unipolar depressive disorders1.470.9, 2.400.11.380.82, 2.320.22.221.17, 4.230.02
Unipolar major depressive disorder1.701.05, 2.770.031.530.89, 2.650.11.790.87, 3.690.1
Any anxiety disorder1.671.02, 2.720.041.831.07, 3.140.032.691.45, 4.970.002
Social phobia, separation anxiety, and/or generalized anxiety disorder2.031.23, 3.330.0052.181.25, 3.810.0062.801.49, 5.250.002
Attention deficit hyperactivity disorder1.631.08, 2.470.021.250.79, 1.970.33.681.75, 7.720.0006
Disruptive behavior disorders1.901.11, 3.250.021.730.93, 3.200.082.501.11, 5.600.03
Oppositional defiant disorder2.201.25, 3.860.0061.790.95, 3.350.073.861.47, 10.100.006
Conduct disorder1.750.68, 4.520.21.340.55, 3.250.50.820.33, 2.000.7
Substance use disorders4.491.86, 10.810.00094.361.74, 10.920.0022.130.88, 5.170.09
a
Forward stepwise models adjusted for family membership and the following pool of potential covariates (p<0.2 for entry, p<0.1 for retention): race, sex, living with both biological parents, mother’s age at child’s birth, proband’s age at intake, proband’s marital status, second follow-up assessment completed within 5 years of intake, socioeconomic status, proband parent diagnoses of major depression, anxiety disorder, attention deficit hyperactivity disorder, disruptive behavior disorders, and substance use disorders, and biological coparent diagnoses of depressive disorders, disruptive behavior disorders, and substance use disorders.
b
Forward stepwise models as above but excluding proband parent diagnostic variables.

Onset of Bipolar Disorder

The high-risk offspring had a substantially higher likelihood of having a bipolar spectrum disorder and mania/hypomania than the comparison offspring (Figure 1). The cumulative rate of bipolar spectrum disorders at age 21 estimated by the Kaplan-Meier analysis was 23.0% in the high-risk offspring and 3.2% in the comparison offspring. The estimated cumulative rate of mania/hypomania at age 21 was 12.7% in the high-risk offspring and 1.5% in the comparison offspring.
FIGURE 1. Cumulative Rates of Bipolar Spectrum Disorders and Mania/Hypomania, by Age at Onset, in Offspring of Parents With Bipolar Disorder (High-Risk Offspring) and Offspring of Community Comparison Parentsa
a Mania/hypomania includes bipolar I and II disorders and bipolar disorder not otherwise specified. For bipolar spectrum diagnoses (panel A), high-risk offspring > comparison offspring; log-rank χ2 = 40.2; p=2.3×10−10; for first manic or hypomanic episode (panel B), high-risk offspring > comparison offspring; log-rank χ2=19.2; p=1.2×10−5.
In the high-risk offspring, the mean age at onset of mania/hypomania was 13.4 years (SD=3.8) and the first onset of a bipolar spectrum disorder was at a mean age of 12.1 years (SD=4.0). The mean age at onset of the first major depressive episode was 13.7 years (SD=4.0), and the first onset of any depressive episode (major depressive episode or minor depression) was at a mean age of 12.5 years (SD=4.6). Of the 15 high-risk offspring who had a manic episode, five (33%) had the first episode before age 10 and eight (53%) before age 12, with the earliest at 8.1 years of age.

Diagnoses Preceding First Manic or Hypomanic Episode in Offspring of Parents With Bipolar Disorder

Of the 391 offspring of parents with bipolar disorder, 36 had a lifetime history of a manic/hypomanic episode. Of these, 25 (69.4%) had a depressive episode and 20 (55.6%) had a major depressive episode prior to the onset of mania/hypomania. A subthreshold manic or hypomanic episode preceded the onset of mania/hypomania in 13 (36.1%) of those with a lifetime history of mania/hypomania (Table 4).
TABLE 4. Association of Prior Mood Episodes and Diagnoses With Hazard of Developing Subsequent Manic/Hypomanic Episodes in Offspring of Parents With Bipolar Disorder (High-Risk Offspring)
 Lifetime Mania/Hypomania (N=36)No Mania/Hypomania (N=355)  Analysis
Episode or DiagnosisOnset Prior to Manic/Hypomanic Episode (%)Lifetime at Last Assessment (%)Lifetime at Last Assessment (%)Hazard Ratioa95% CIχ2p
Any mood episode77.8100.043.13.561.62, 7.8110.020.002
 Any depressive episode69.491.741.72.491.23, 5.076.370.01
 Major depressive episode55.680.627.02.581.34, 4.987.960.005
 Subthreshold manic or hypomanic episode36.1b11.03.761.90, 7.4414.47<0.001
Any non-mood disorder80.697.264.22.301.01, 5.263.920.05
 Attention deficit hyperactivity disorder41.744.428.72.041.05, 3.984.420.04
 Disruptive behavior disorder47.261.123.92.881.49, 5.599.840.002
 Anxiety disorder52.872.236.61.860.97, 3.593.470.06
 Substance use disorder5.644.417.50.200.05, 0.834.900.03
a
Cox regression models controlling for within-family correlation.
b
Subthreshold manic or hypomanic episodes were not systematically assessed after onset of mania/hypomania.
Cox regressions showed that any depressive episode, major depressive episode, subthreshold manic or hypomanic episode, ADHD, and disruptive behavior disorder were associated with an elevated hazard of developing mania/hypomania, while substance use disorders were associated with a reduced hazard (Table 4). The associations between potential confounding variables and risk of developing mania/hypomania are listed in Table S4 in the online data supplement. The multivariate Cox model retained three clinical diagnostic factors: subthreshold manic or hypomanic episode (hazard ratio=2.29, 95% CI=1.10–4.78, p=0.03), disruptive behavior disorders (hazard ratio=2.12, 95% CI=1.09–4.14, p=0.03), and major depressive episode (hazard ratio=1.99, 95% CI=0.99–3.97, p=0.05). It also included one confounder covariate that met criteria for significant impact: proband age at intake assessment (hazard ratio=0.94, 95% CI=0.89–0.99, p=0.02).
We also examined the association of two comorbid conditions (subthreshold mania or hypomania and ADHD) with onset of mania/hypomania (see Table S5 in the data supplement). No comorbid pair of diagnoses was more significantly associated with onset of mania/hypomania than one of the diagnoses alone.

Sensitivity Analyses: Diagnoses Preceding Prospectively Observed Mania/Hypomania in High-Risk Offspring

When the analysis was restricted to the 344 high-risk offspring who had prospective follow-up data and did not have a history of mania/hypomania at intake, 21 (6.1%) had a new onset of mania/hypomania during follow-up, eight of them with manic episodes and 13 of them with hypomanic episodes only. Of these 21 offspring, 12 (57.1%) were diagnosed with a subthreshold manic or hypomanic episode at an assessment prior to the assessment when mania/hypomania was first diagnosed, while 66.7% had a prior depressive episode, 52.4% had a prior major depressive episode, 42.9% had a prior ADHD diagnosis, 38.1% had a prior disruptive behavior disorder diagnosis, 42.9% had a prior anxiety disorder diagnosis, and 9.5% had a prior substance use disorder diagnosis. Multivariate models showed that only subthreshold manic or hypomanic episodes were associated with prospectively observed onset of mania/hypomania (hazard ratio=7.57, 95% CI=3.09–18.6, p<0.0001), with proband age at onset of bipolar disorder retained as a confounder covariate (hazard ratio=0.95, 95% CI=0.89–1.02, p=0.1).

Discussion

This study demonstrates that bipolar spectrum disorders—bipolar I, bipolar II, and bipolar disorder not otherwise specified—are significantly more prevalent in high-risk offspring as compared with community comparison offspring, even before the offspring have reached young adulthood. The high-risk offspring in this study had much higher rates of depressive episodes relative to comparison offspring, but the rate of unipolar depressive disorders (depression with no history of full-threshold or subthreshold manic or hypomanic episodes) was only marginally higher. Nearly all non-mood axis I disorders were more prevalent in the high-risk offspring than in the community offspring. Mania/hypomania in the high-risk offspring was almost always preceded by identifiable mood episodes and non-mood disorders. Distinct subthreshold episodes of mania or hypomania were highly specific to the high-risk offspring and were the strongest predictor of progression to full-threshold mania/hypomania in the high-risk cohort. Identifiable depressive episodes preceded the onset of mania/hypomania in about two-thirds of the cases, but only major depressive episodes specifically predicted the onset of mania/hypomania above and beyond subthreshold manic or hypomanic episodes and the presence of a disruptive behavior disorder. Sensitivity analyses using only prospective data, in which the effects of recall bias were minimized, showed that only subthreshold manic or hypomanic episodes were associated with prospectively observed mania/hypomania.
When we examined the higher rates of non-mood axis I disorders in the high-risk offspring, we found that controlling for parental non-bipolar axis I disorders did not substantially change the results. However, when the comparison group was limited to offspring of community comparison parents who had a lifetime axis I disorder, ADHD and disruptive behavior disorders no longer differed between groups. Given that the rates of ADHD and disruptive behavior disorders were significantly higher in the high-risk offspring as compared with all comparison offspring when parental non-bipolar axis I diagnoses were included in the model, these results must be interpreted with caution.
Before considering the implications of these findings, it is important to consider the study’s limitations. Although this was a prospective study, all diagnoses and estimates of onset age were made retrospectively for the interval between assessments. Offspring were recruited across a broad age range (6–18 years), so most offspring were not through the age of risk for onset of bipolar illness; only 29% were older than age 21 at their last assessment. Although this is the largest longitudinal study of offspring of parents with bipolar disorder, only 36 offspring were diagnosed with full-threshold mania/hypomania. Only a small proportion of the biological coparents had direct diagnostic interviews. Lastly, the bipolar parents were not systematically recruited from clinical or epidemiological populations, so it is unclear whether these findings are generalizable to the offspring of all bipolar parents.
The unexpected finding that presence of a substance use disorder was associated with a lower risk of developing mania/hypomania was likely caused by the conservative procedure used for diagnosing mania/hypomania in the presence of a substance use disorder. It may not be a valid result, particularly in light of the higher rate of lifetime substance use disorders in high-risk offspring who developed mania/hypomania compared with those who did not (44.0% compared with 17.5%).
The lifetime prevalence of any axis I disorder was substantial in both the high-risk offspring (74.2%) and the comparison offspring (48.4%). However, the prevalence of disorders in the comparison offspring is similar to that of other community studies of adolescents and young adults. It is nearly identical to that of the National Comorbidity Survey Adolescent Supplement study (49.5%), which was a large cross-sectional study of adolescents in the community (22). The lifetime prevalence in the comparison offspring matches the cumulative rate of psychiatric disorders at age 21 (49.2%) reported in the Great Smoky Mountains Study, which, like BIOS, used multiple assessments over time (23). The lifetime prevalence rates in the high-risk offspring are similar to those reported in the Dutch longitudinal high-risk study (72%) and by Duffy et al. (76%) (15, 24).
The rate of bipolar I disorder in the BIOS high-risk sample (3.8%) was comparable to that reported in other longitudinal offspring studies (range, 3%–7%), while the rate of either bipolar I or II disorder was slightly lower (8.4% compared with 10.1%–18.8%) (1517, 25). This may be due to the younger age at last assessment in BIOS, as overall rates of bipolar I or II disorder in BIOS continue to climb after age 18. A recent meta-analysis of epidemiologic studies of adolescents found the rates of bipolar I disorder (1.2%) and bipolar spectrum disorders (1.8%) to be similar to those in the BIOS offspring of community comparison parents (bipolar I disorder, 0.4%; bipolar spectrum disorders, 2.0%) (26).
The results from BIOS differ substantially from those of other longitudinal offspring studies in three ways. First, the mean age at onset of manic/hypomanic episodes was considerably younger in BIOS (13.4 years compared with 17–19 years), with manic episodes occurring before age 12 in half of the BIOS bipolar I offspring, compared with none reported in other studies. Second, a major depressive episode preceded the onset of mania/hypomania only about 50% of the time in BIOS, as compared with nearly all cases in other studies. Third, the BIOS offspring had significantly higher rates of psychopathology meeting criteria for one or more non-mood DSM-IV disorders prior to the onset of full-threshold bipolar illness. Age at first assessment may be a contributing factor for the first issue; BIOS offspring were 11.9 years old on average, as compared with 16.5 years old in the two largest longitudinal studies. The mean age at onset of first manic/hypomanic episode was significantly lower in the offspring who were under age 12 at intake (N=16; mean age, 11.3 years [SD=3.3]) than in those who were 12–18 years old at intake (N=20; mean age, 15.0 years [SD=3.3]) (t=−3.3, p=0.002). The age at onset of first manic/hypomanic episode was about 12 years in the National Comorbidity Survey Adolescent Supplement study, so BIOS is not unique in observing onset of mania and hypomania before adolescence (27). However, there was no significant difference between the younger and older age groups at intake in the rate of major depressive episodes (50% compared with 60%), subthreshold manic or hypomanic episodes (38% compared with 35%), or non-mood axis I disorders (81% compared with 80%) preceding the onset of mania/hypomania in the BIOS offspring, so the reasons for these findings are not clear.
The finding that subthreshold manic or hypomanic episodes often precede manic/hypomanic episodes has been found in one other longitudinal offspring study. Duffy et al. (16) noted in their cohort that 48% of offspring with bipolar disorder would have met criteria for bipolar disorder not otherwise specified prior to the onset of mania/hypomania. The BIOS results demonstrate that this is not a result of recall bias, as prospectively observed manic/hypomanic episodes were preceded in 55% of the cases by subthreshold episodes identified at prior assessments. The prognostic significance of subthreshold manic or hypomanic episodes has also been demonstrated in a pediatric clinical population. Youths diagnosed with bipolar disorder not otherwise specified at intake in the COBY study developed full-threshold bipolar I or II disorder at a rate of 45% over an average of 5 years of follow-up (28). Those with a family history of bipolar disorder had a significantly higher rate of diagnostic progression compared with those who did not (56% compared with 33%). The prognostic significance of subthreshold mania or hypomania may not be limited to youth, as subthreshold symptoms of hypomania have been found to be predictive of future conversion to bipolar disorder in adults diagnosed with unipolar depression (29).
Anxiety disorders were present at significantly higher rates in the high-risk offspring relative to comparison offspring in BIOS and have been associated with the presence of mood disorders in high-risk offspring in other studies (14, 30). However, presence of an anxiety disorder was not associated with future onset of mania/hypomania in BIOS, although it was close to statistical significance in the univariate analysis. The lack of association of anxiety disorder with risk of future bipolar disorder is consistent with what was found by Duffy et al. (31). Anxiety disorders were not associated in multivariate models, likely because of their high comorbidity with depression and subthreshold mania or hypomania.
In summary, these results indicate that in the offspring of parents with bipolar disorder, mania and hypomania do not come “out of the blue” but instead are almost always preceded by identifiable mood episodes and non-mood disorders. Major depression is the index episode only half of the time, and subthreshold episodes of mania or hypomania are the only specific diagnostic antecedent to mania/hypomania when using prospectively obtained data. Clinicians should carefully assess for subthreshold manic or hypomanic episodes and differentiate them from symptoms of depression and other disorders in the offspring of parents with bipolar disorder, as they carry prognostic significance for the future development of full-threshold bipolar illness. This may provide an opportunity for early intervention to improve the course of illness. For instance, a recent study demonstrated benefits from a family-focused approach for symptomatic youths who had a first-degree relative with bipolar disorder (32). Given the clear prognostic significance of subthreshold mania or hypomania in youths at familial risk for bipolar disorder, we need additional treatment research for these youths. As both major depressive episodes and disruptive behavior disorders also indicate risk of future bipolarity, they are indications for close clinical monitoring in high-risk offspring. Given the high prevalence of both mood and non-mood disorders in the high-risk offspring and the difficulty of differentiating subthreshold mania or hypomania from other disorders, it would be worthwhile for clinicians who treat bipolar adults to encourage them to have their children evaluated by specialty pediatric mental health services if the parent is concerned about their child’s mood or behavior.

Supplementary Material

File (appi.ajp.2014.14010035.ds001.pdf)

References

1.
Perlis RH, Dennehy EB, Miklowitz DJ, et al: Retrospective age at onset of bipolar disorder and outcome during two-year follow-up: results from the STEP-BD study. Bipolar Disord 2009; 11:391–400
2.
Lish JD, Dime-Meenan S, Whybrow PC, et al: The National Depressive and Manic-Depressive Association (DMDA) survey of bipolar members. J Affect Disord 1994; 31:281–294
3.
Chengappa KN, Kupfer DJ, Frank E, et al: Relationship of birth cohort and early age at onset of illness in a bipolar disorder case registry. Am J Psychiatry 2003; 160:1636–1642
4.
Leverich GS, Post RM, Keck PE Jr, et al: The poor prognosis of childhood-onset bipolar disorder. J Pediatr 2007; 150:485–490
5.
Goodwin FK, Jamison KR: Manic-Depressive Illness: Bipolar Disorders and Recurrent Depression, 2nd ed. New York, Oxford University Press, 2007
6.
Barnett JH, Smoller JW: The genetics of bipolar disorder. Neuroscience 2009; 164:331–343
7.
DelBello MP, Geller B: Review of studies of child and adolescent offspring of bipolar parents. Bipolar Disord 2001; 3:325–334
8.
Lapalme M, Hodgins S, LaRoche C: Children of parents with bipolar disorder: a metaanalysis of risk for mental disorders. Can J Psychiatry 1997; 42:623–631
9.
Henin A, Biederman J, Mick E, et al: Psychopathology in the offspring of parents with bipolar disorder: a controlled study. Biol Psychiatry 2005; 58:554–561
10.
Chang KD, Steiner H, Ketter TA: Psychiatric phenomenology of child and adolescent bipolar offspring. J Am Acad Child Adolesc Psychiatry 2000; 39:453–460
11.
Birmaher B, Axelson D, Goldstein B, et al: Psychiatric disorders in preschool offspring of parents with bipolar disorder: the Pittsburgh Bipolar Offspring Study (BIOS). Am J Psychiatry 2010; 167:321–330
12.
Birmaher B, Axelson D, Monk K, et al: Lifetime psychiatric disorders in school-aged offspring of parents with bipolar disorder: the Pittsburgh Bipolar Offspring study. Arch Gen Psychiatry 2009; 66:287–296
13.
Vandeleur C, Rothen S, Gholam-Rezaee M, et al: Mental disorders in offspring of parents with bipolar and major depressive disorders. Bipolar Disord 2012; 14:641–653
14.
Nurnberger JI Jr, McInnis M, Reich W, et al: A high-risk study of bipolar disorder. Childhood clinical phenotypes as precursors of major mood disorders. Arch Gen Psychiatry 2011; 68:1012–1020
15.
Mesman E, Nolen WA, Reichart CG, et al: The Dutch bipolar offspring study: 12-year follow-up. Am J Psychiatry 2013; 170:542–549
16.
Duffy A, Alda M, Hajek T, et al: Early stages in the development of bipolar disorder. J Affect Disord 2010; 121:127–135
17.
Egeland JA, Endicott J, Hostetter AM, et al: A 16-year prospective study of prodromal features prior to BPI onset in well Amish children. J Affect Disord 2012; 142:186–192
18.
Birmaher B, Axelson D, Strober M, et al: Clinical course of children and adolescents with bipolar spectrum disorders. Arch Gen Psychiatry 2006; 63:175–183
19.
Goldstein BI, Shamseddeen W, Axelson DA, et al: Clinical, demographic, and familial correlates of bipolar spectrum disorders among offspring of parents with bipolar disorder. J Am Acad Child Adolesc Psychiatry 2010; 49:388–396
20.
Andreasen NC, Endicott J, Spitzer RL, et al: The family history method using diagnostic criteria: reliability and validity. Arch Gen Psychiatry 1977; 34:1229–1235
21.
Hollingshead AB: Four-Factor Index of Social Status. New Haven, Conn, Yale University, Department of Sociology, 1975
22.
Merikangas KR, He J-P, Burstein M, et al: Lifetime prevalence of mental disorders in US adolescents: results from the National Comorbidity Survey Replication–Adolescent Supplement (NCS-A). J Am Acad Child Adolesc Psychiatry 2010; 49:980–989
23.
Copeland W, Shanahan L, Costello EJ, et al: Cumulative prevalence of psychiatric disorders by young adulthood: a prospective cohort analysis from the Great Smoky Mountains Study. J Am Acad Child Adolesc Psychiatry 2011; 50:252–261
24.
Duffy A, Alda M, Crawford L, et al: The early manifestations of bipolar disorder: a longitudinal prospective study of the offspring of bipolar parents. Bipolar Disord 2007; 9:828–838
25.
Meyer SE, Carlson GA, Wiggs EA, et al: A prospective study of the association among impaired executive functioning, childhood attentional problems, and the development of bipolar disorder. Dev Psychopathol 2004; 16:461–476
26.
Van Meter AR, Moreira ALR, Youngstrom EA: Meta-analysis of epidemiologic studies of pediatric bipolar disorder. J Clin Psychiatry 2011; 72:1250–1256
27.
Merikangas KR, Cui L, Kattan G, et al: Mania with and without depression in a community sample of US adolescents. Arch Gen Psychiatry 2012; 69:943–951
28.
Axelson DA, Birmaher B, Strober MA, et al: Course of subthreshold bipolar disorder in youth: diagnostic progression from bipolar disorder not otherwise specified. J Am Acad Child Adolesc Psychiatry 2011; 50:1001.e3–1016.e3
29.
Fiedorowicz JG, Endicott J, Leon AC, et al: Subthreshold hypomanic symptoms in progression from unipolar major depression to bipolar disorder. Am J Psychiatry 2011; 168:40–48
30.
Duffy A, Horrocks J, Doucette S, et al: The developmental trajectory of bipolar disorder. Br J Psychiatry 2014; 204:122–128
31.
Duffy A, Horrocks J, Doucette S, et al: Childhood anxiety: an early predictor of mood disorders in offspring of bipolar parents. J Affect Disord 2013; 150:363–369
32.
Miklowitz DJ, Schneck CD, Singh MK, et al: Early intervention for symptomatic youth at risk for bipolar disorder: a randomized trial of family-focused therapy. J Am Acad Child Adolesc Psychiatry 2013; 52:121–131

Information & Authors

Information

Published In

Go to American Journal of Psychiatry
Go to American Journal of Psychiatry
American Journal of Psychiatry
Pages: 638 - 646
PubMed: 25734353

History

Received: 9 January 2014
Revision received: 5 September 2014
Revision received: 19 November 2014
Accepted: 24 November 2014
Published online: 3 March 2015
Published in print: July 01, 2015

Authors

Details

David Axelson, M.D.
From the Department of Psychiatry, Nationwide Children’s Hospital and Ohio State University College of Medicine, Columbus; the Department of Psychiatry, Sunnybrook Health Sciences Centre, University of Toronto Medical Center, Toronto; and Western Psychiatric Institute and Clinic and Department of Psychiatry, University of Pittsburgh Medical Center, Pittsburgh.
Benjamin Goldstein, M.D., Ph.D.
From the Department of Psychiatry, Nationwide Children’s Hospital and Ohio State University College of Medicine, Columbus; the Department of Psychiatry, Sunnybrook Health Sciences Centre, University of Toronto Medical Center, Toronto; and Western Psychiatric Institute and Clinic and Department of Psychiatry, University of Pittsburgh Medical Center, Pittsburgh.
Tina Goldstein, Ph.D.
From the Department of Psychiatry, Nationwide Children’s Hospital and Ohio State University College of Medicine, Columbus; the Department of Psychiatry, Sunnybrook Health Sciences Centre, University of Toronto Medical Center, Toronto; and Western Psychiatric Institute and Clinic and Department of Psychiatry, University of Pittsburgh Medical Center, Pittsburgh.
Kelly Monk, R.N.
From the Department of Psychiatry, Nationwide Children’s Hospital and Ohio State University College of Medicine, Columbus; the Department of Psychiatry, Sunnybrook Health Sciences Centre, University of Toronto Medical Center, Toronto; and Western Psychiatric Institute and Clinic and Department of Psychiatry, University of Pittsburgh Medical Center, Pittsburgh.
Haifeng Yu, M.S.
From the Department of Psychiatry, Nationwide Children’s Hospital and Ohio State University College of Medicine, Columbus; the Department of Psychiatry, Sunnybrook Health Sciences Centre, University of Toronto Medical Center, Toronto; and Western Psychiatric Institute and Clinic and Department of Psychiatry, University of Pittsburgh Medical Center, Pittsburgh.
Mary Beth Hickey, B.A.
From the Department of Psychiatry, Nationwide Children’s Hospital and Ohio State University College of Medicine, Columbus; the Department of Psychiatry, Sunnybrook Health Sciences Centre, University of Toronto Medical Center, Toronto; and Western Psychiatric Institute and Clinic and Department of Psychiatry, University of Pittsburgh Medical Center, Pittsburgh.
Dara Sakolsky, M.D., Ph.D.
From the Department of Psychiatry, Nationwide Children’s Hospital and Ohio State University College of Medicine, Columbus; the Department of Psychiatry, Sunnybrook Health Sciences Centre, University of Toronto Medical Center, Toronto; and Western Psychiatric Institute and Clinic and Department of Psychiatry, University of Pittsburgh Medical Center, Pittsburgh.
Rasim Diler, M.D.
From the Department of Psychiatry, Nationwide Children’s Hospital and Ohio State University College of Medicine, Columbus; the Department of Psychiatry, Sunnybrook Health Sciences Centre, University of Toronto Medical Center, Toronto; and Western Psychiatric Institute and Clinic and Department of Psychiatry, University of Pittsburgh Medical Center, Pittsburgh.
Danella Hafeman, M.D., Ph.D.
From the Department of Psychiatry, Nationwide Children’s Hospital and Ohio State University College of Medicine, Columbus; the Department of Psychiatry, Sunnybrook Health Sciences Centre, University of Toronto Medical Center, Toronto; and Western Psychiatric Institute and Clinic and Department of Psychiatry, University of Pittsburgh Medical Center, Pittsburgh.
John Merranko, M.A.
From the Department of Psychiatry, Nationwide Children’s Hospital and Ohio State University College of Medicine, Columbus; the Department of Psychiatry, Sunnybrook Health Sciences Centre, University of Toronto Medical Center, Toronto; and Western Psychiatric Institute and Clinic and Department of Psychiatry, University of Pittsburgh Medical Center, Pittsburgh.
Satish Iyengar, Ph.D.
From the Department of Psychiatry, Nationwide Children’s Hospital and Ohio State University College of Medicine, Columbus; the Department of Psychiatry, Sunnybrook Health Sciences Centre, University of Toronto Medical Center, Toronto; and Western Psychiatric Institute and Clinic and Department of Psychiatry, University of Pittsburgh Medical Center, Pittsburgh.
David Brent, M.D., M.P.H.
From the Department of Psychiatry, Nationwide Children’s Hospital and Ohio State University College of Medicine, Columbus; the Department of Psychiatry, Sunnybrook Health Sciences Centre, University of Toronto Medical Center, Toronto; and Western Psychiatric Institute and Clinic and Department of Psychiatry, University of Pittsburgh Medical Center, Pittsburgh.
David Kupfer, M.D.
From the Department of Psychiatry, Nationwide Children’s Hospital and Ohio State University College of Medicine, Columbus; the Department of Psychiatry, Sunnybrook Health Sciences Centre, University of Toronto Medical Center, Toronto; and Western Psychiatric Institute and Clinic and Department of Psychiatry, University of Pittsburgh Medical Center, Pittsburgh.
Boris Birmaher, M.D.
From the Department of Psychiatry, Nationwide Children’s Hospital and Ohio State University College of Medicine, Columbus; the Department of Psychiatry, Sunnybrook Health Sciences Centre, University of Toronto Medical Center, Toronto; and Western Psychiatric Institute and Clinic and Department of Psychiatry, University of Pittsburgh Medical Center, Pittsburgh.

Notes

Address correspondence to Dr. Axelson ([email protected]).

Funding Information

Dr. Benjamin Goldstein has served as a consultant for Bristol-Myers Squibb and has received speaking honoraria from Purdue. Dr. Tina Goldstein has received grant funding from NIMH, NIDA/NIAAA, the National Institute of Child Health and Human Development, and the Pittsburgh Foundation and receives royalties from Guilford Press. Dr. Sakolsky has received research support from NIMH and NARSAD, has received an honorarium from the American Academy of Child and Adolescent Psychiatry for CME work, and serves as an editorial board member of Child and Adolescent Psychopharmacology News and as a specialty consultant for Prescriber's Letter. Dr. Brent has received grants from NIMH, fees from CME events, royalties from Guilford Press and ERT, Inc., and fees from UpToDate. Dr. Kupfer has served as a consultant to the American Psychiatric Association (as Chair of the DSM-5 Task Force), has joint ownership of copyright for the Pittsburgh Sleep Quality Index, is a member of the Valdoxan Advisory Board of Servier International, and is a stockholder in AliphCom and Psychiatric Assessments, Inc. Dr. Birmaher receives royalties from Random House, Lippincott Williams & Wilkins, and UpToDate. The other authors report no financial relationships with commercial interests.

Metrics & Citations

Metrics

Citations

Export Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format
Citation style
Style
Copy to clipboard

View Options

View options

PDF/EPUB

View PDF/EPUB

Get Access

Login options

Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.

Personal login Institutional Login Open Athens login
Purchase Options

Purchase this article to access the full text.

PPV Articles - American Journal of Psychiatry

PPV Articles - American Journal of Psychiatry

Not a subscriber?

Subscribe Now / Learn More

PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.

Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).

Media

Figures

Other

Tables

Share

Share

Share article link

Share