An obstacle to increasing access to pediatric mental health care is the significant shortage and unequal distribution of mental health professionals (e.g., child and adolescent psychiatrists) (
1–
3). To fill this gap, pediatric primary care providers (PCPs) are often tasked with diagnosing and treating mental health conditions (
4). PCPs are a reasonable choice, given their longitudinal contact with families and that primary care represents a nonstigmatizing setting in which to address mental health concerns. The American Academy of Pediatrics recommends that PCPs play a central role in assessment and management of common mental health problems (e.g., anxiety) (
5,
6). However, PCPs may lack the time and training to provide mental health care and may not be comfortable doing so (
7–
9).
A growing body of research supports embedded and off-site integration of mental health care with primary care to assist PCPs in meeting patients’ mental health needs (
10,
11). Child psychiatry access programs (CPAPs) represent one promising strategy for increasing mental health care access. These programs, now operating in >30 states (
12), provide continuing education, child-adolescent psychiatry consultation (CAPC), and resource and referral networking (R/RN) by telephone; several programs also offer limited direct-to-patient face-to-face or telehealth consultation with child-adolescent psychiatrists (
13–
16). Two programs (in Maryland and Michigan) offer time-limited, face-to-face mental health treatment with embedded social workers (
15,
17). However, CPAP services vary across states (
13,
18).
Maryland Behavioral Health Integration in Pediatric Primary Care (BHIPP), a statewide CPAP, supports PCPs in managing their patients’ mental health needs through several interconnected services. PCPs’ calls to BHIPP’s warmline, a telephone service available Monday–Friday from 9 a.m. to 5 p.m., are answered by licensed social workers who assist with general questions and R/RN tailored to patients, as well as triaging calls for CAPC. BHIPP child-adolescent psychiatrists and licensed social workers collaborate on disposition letters sent to PCPs after a CAPC and meet twice a month to review patients served through CAPC to ensure consistency of guidance provided. BHIPP also offers continuing education to build PCP knowledge and skills. In collaboration with Salisbury University, and under supervision by licensed social workers, BHIPP also embeds master’s-level social work students in primary care practices in eight rural Maryland counties to provide direct-to-patient mental health intervention (DMHI), including screening, brief treatment (i.e., four to six therapy sessions), and case management, as well as to facilitate PCPs’ use of BHIPP’s warmline. Families access DMHI through PCP referral or self-referral. BHIPP child-adolescent psychiatrists and licensed social workers also support DMHI through provision of monthly training and supervision for master’s-level social work students and by recommending DMHI through CAPC and R/RN.
Previous research on CPAPs has primarily focused on program use, including characteristics of practices, providers, and patients served by CPAPs and provider and family satisfaction with services (
19,
20). However, among studies examining patient characteristics, most have focused exclusively on CAPC, with only two studies from Michigan’s CPAP examining patient characteristics both across and within CPAP service types (
15,
17). Further, all studies have relied on descriptive statistics to examine patient characteristics (e.g., call rates about depression vs. attention-deficit hyperactivity disorder [ADHD]), which limits understanding of the complex and overlapping mental health needs of patients served by CPAPs. To address these gaps, this study aimed to describe the demographic and clinical characteristics of patients served across BHIPP and by BHIPP service type (i.e., CAPC, R/RN, and DMHI) and to use latent class analysis, an exploratory person-centered approach, to examine patterns of presenting concerns in order to determine whether there are distinct subgroups of patients served by BHIPP and whether subgroups differ in patient characteristics, BHIPP service received, and BHIPP care recommendations provided. Addressing these aims will yield more clinically useful knowledge about the nature and complexity of the needs of patients served through CPAPs and will inform training and consultation provided to PCPs.
Methods
Study Sample
Between October 2012 and March 2020, a total of 9,569 patient-specific BHIPP contacts across three services (CAPC, R/RN, and DMHI) were completed. For DMHI, we restricted the sample to the first visit to avoid double counting patients (the original DMHI sample comprised 5,305 patient contacts involving 2,840 unique patients). Additionally, 165 (6%) of the 2,840 DMHI patients were excluded because they could not be connected with a PCP. Therefore, this analysis focused on 6,939 unique patients (N=1,893 in CAPC, N=2,371 in R/RN, and N=2,675 in DMHI) associated with 823 unique PCPs. Institutional review board approval was obtained from Johns Hopkins University, University of Maryland, and Maryland’s Department of Health.
Variables
Service type and patient data.
BHIPP service type included CAPC, R/RN, or DMHI. For descriptive statistics, a three-category variable indicated the service received. For latent class analysis, a binary variable comparing receipt of DMHI to receipt of warmline services (CAPC and R/RN) was created. Patient demographic data included gender, age, race-ethnicity, and insurance type (i.e., private, public, and none or unknown or missing).
Patient presenting concerns.
During BHIPP contacts, the PCP, patient, or family describes presenting concerns, and BHIPP clinicians select from a list of 44 presenting concerns. For this study, options were grouped into six categories: anxiety (anxiety, worries-fears, avoidance, dissociation, somatic complaints, obsessions, and compulsions), mood symptoms (depressed mood, emotion dysregulation, expansive mood, and labile mood), behavior problems (parent-child conflict, behavior problems at home and school, destructive behaviors, risky behaviors, sexual acting out, truancy, aggression, hurting animals, hyperactivity, and impulsivity), attention-concentration problems, learning problems (learning problems, learning disability, and underachievement at school), and self-injury (suicidal ideation, suicide attempt, and nonsuicidal self-injury). Binary variables were created for each category: 1, any presenting concerns within that category; 0, no presenting concerns within that category. Binary variables were used in descriptive analyses and as latent class indicators.
Mental health diagnostic impressions.
Diagnostic impressions regarding patients’ mental health were grouped into seven categories: ADHD with or without a learning disability; adjustment disorder; anxiety disorders; depressive disorders; disruptive behavior disorder or oppositional defiant disorder; trauma and related disorders; and more serious disorder, including autism spectrum disorder, bipolar disorder, eating disorder, mood disorder not otherwise specified, psychotic disorder, or substance use disorder. Each diagnostic impression was designated for each patient if either the PCP or BHIPP staff indicated that it was present.
Current treatments and case severity.
Current mental health–related treatments reported by the PCP, patient, or family during the contact included emergency department or crisis services, residential treatment, inpatient stay or hospitalization, day hospital, intensive outpatient treatment, outpatient psychotherapy, medication treatment, assessment-evaluation, mental health consultation, in-home services, early childhood mental health clinic, Infants and Toddlers Program, special education services, early learning center, home visiting, family education and support, school-based services, case management and family navigation, ancillary services (e.g., speech therapy), and other. A binary variable was created to indicate any or no service receipt, and similar services were grouped (e.g., emergency department and inpatient stay were grouped into a higher level of care) for descriptive analyses.
Case severity was based on BHIPP clinician ratings on the Clinical Global Impressions–Severity (CGI-S) scale, a single-item assessment capturing impressions of severity on a 7-point scale, from 1, normal, to 7, extremely ill (
21). The CGI-S includes the clinician’s impression of the patient’s level of distress, illness severity, and functional impairment and has strong reliability and validity (
21,
22). BHIPP clinicians receive ongoing training on the CGI-S to promote interrater reliability. Previous CPAP research has employed similar severity measures (
13,
23–
25).
BHIPP recommendations.
BHIPP recommendations are made to the PCP, patient, and family regarding medication evaluation or change, symptom assessment with a screening tool, provision of psychoeducational handouts to the family, behavioral interventions in the PCP’s office (e.g., relaxation and behavior management), or referral of patients to mental health services or community resources. A binary variable was created to reflect whether each recommendation was made during BHIPP contact.
Statistical Analyses
Patient characteristics were examined with descriptive statistics. Latent class analysis, accounting for nesting of patients within PCPs, was conducted to identify classes of patients experiencing similar patterns of presenting concerns and to compare classes on patient characteristics, BHIPP service receipt, and BHIPP recommendations. Latent class models were estimated with Mplus, version 8.1 (
26). Missing data were addressed by using full information maximum likelihood estimation. The number of latent classes was selected by comparing model fit statistics and class size. Model fit was assessed with standard fit statistics, including Bayesian information criterion (BIC) and sample size–adjusted BIC (aBIC) (
27,
28). Decreases in fit statistics indicate model fit improvements. The Vuong-Lo-Mendell-Rubin likelihood ratio test (VLMR) was used to compare the relative fit of a model with k classes to a model with one fewer class. A statistically significant VLMR test indicates that the model with fewer classes should be rejected in support of the model with more classes (
27). Entropy (range 0–1) was also examined; higher entropy values indicate better classification accuracy. Finally, class sizes were also examined, because research has shown that small or uncommon classes can be difficult to reliably identify and that it is important not to overextract classes (
28,
29).
Once the best-fitting unconditional latent class model was identified, patient characteristics, BHIPP service type, and BHIPP recommendations were added to examine associations with class membership by using multinomial logistic regression through the auxiliary function R3step. This approach was selected because covariates were not intended to serve as latent class indicators or to directly influence the structure or size of latent classes but were hypothesized to be associated with class membership (
30).
Results
Characteristics of Patients for Whom PCPs Sought BHIPP Services
Table 1 presents data on patient characteristics overall and by service type. Among the 6,939 unique patient contacts, 38.6% were for DMHI, 34.2% for R/RN, and 27.3% for CAPC. Half (50.3%) of the patients were female, and 58.7% were White. The mean±SD age of the sample was 11.3±5.1 years, and 37.6% were publicly insured. The most common presenting concerns were anxiety (39.7%), behavior problems (36.5%), mood problems (26.5%), and attention-concentration problems (17.5%). At BHIPP contact, 32.7% of patients were already receiving mental health–related services. Among the patients receiving services, 60.3% were receiving medication evaluation and treatment, 14.5% outpatient psychotherapy, and 15.1% school-based services; 27.3% were already taking psychotropic medications, and of this group, 28.4% were taking multiple medications. The most common diagnostic impressions were anxiety disorders (36.8%), ADHD with or without a learning disability (28.0%), and depressive disorders (19.1%). Approximately 55.0% of patients were rated in the mild-to-moderate impairment range on the CGI-S.
In the DMHI group, 52.1% of patients were female, most (68.1%) were White, 73.4% were ages 6–18, and 44.8% were publicly insured. Notably, the largest proportion of patients in the 0-to-5-year-old range (22.5%) were seen through BHIPP’s DMHI service. In the CAPC group, 52.8% were male, most (64.7%) were White, 82.2% were ages 6–18, and 30.3% were publicly insured. In the R/RN group, 51.5% were female, most were White (43.2%) or African American (24.6%), 83.5% were ages 6–18, and 35.3% were publicly insured.
The most common presenting concerns for patients receiving DMHI were behavior problems and anxiety, and most DMHI patients were not currently receiving mental health–related services or taking medication. For most DMHI patients, the diagnostic impression of the PCP or the BHIPP social work student was anxiety disorder or ADHD. Among patients served through CAPC, anxiety and behavior problems were the most common concerns, and at the initial BHIPP contact, most were already receiving mental health–related services, primarily through outpatient medication evaluation and treatment; about one-third were taking multiple medications. For the CAPC group, the most common diagnostic impressions were anxiety and ADHD. For the R/RN group, anxiety and mood problems were the most common presenting concerns, and most patients were not receiving mental health–related services or taking medication. For the R/RN group, the most common diagnostic impressions of PCPs or BHIPP staff were anxiety and depressive disorders. Severity ratings varied by service group; most patients receiving DMHI were rated as borderline mentally ill, mildly ill, or moderately ill (80.8%); most patients receiving CAPC were rated as moderately, markedly, severely, or extremely ill (88.0%).
Latent Class Analysis of Patient Presenting Concerns
Comparison of fit statistics (
Table 2) suggested that the lowest BIC and aBIC values were obtained for the four-class model, and VLMR results indicated that a four-class model fit better than a three-class model but that a five-class model did not fit better than the four-class model. Therefore, we selected the four-class model as the best fitting model.
Profiles representing the estimated probability of the PCP, patient, or family reporting each presenting concern are shown in
Figure 1. Of note, class counts and proportions were based on estimated posterior probabilities. Item endorsement patterns revealed an anxiety-only class (44.2%, N=3,069), characterized by a high probability of anxiety and a low probability of other symptoms; a behavior problems–only class (30.7%, N=2,132), characterized by a high probability of behavior problems and a low probability of other symptoms; a mood and anxiety class (17.1%, N=1,187), characterized by a high probability of mood symptoms, moderate probability of anxiety, and low probability of other symptoms; and an attention, behavior, and learning problems class (8.0%, N=551), characterized by a high probability of attention-concentration, behavior, and learning problems and a low probability of other symptoms.
We examined associations between patient and service characteristics and class membership by using the largest class (anxiety class) as the reference. Class membership varied by covariates (
Table 3). Compared with individuals in the anxiety-only class, patients in the mood and anxiety class were less likely to be male, to be younger than 8 years, or to be privately insured and more likely to have BHIPP recommend distribution of psychoeducational handouts, in-office behavioral interventions, and referral to mental health services or community resources. Compared with patients in the anxiety-only class, those in the attention, behavior, and learning problems class were more likely to be male, to be already receiving mental health–related services, to be seen for DMHI, and to have BHIPP recommend handouts and referral to mental health services or community resources and were less likely to be privately insured. Compared with individuals in the anxiety-only class, patients in the behavior problems–only class were more likely to be male, to be younger than 8 years, to be already receiving mental health–related services, and to have BHIPP recommend handouts, in-office behavioral interventions, and referral to mental health services or community resources and were less likely to be privately insured.
Discussion
Maryland BHIPP is a CPAP supporting PCPs in managing pediatric mental health conditions through three interconnected services: CAPC, R/RN, and DMHI. Our findings indicate that DMHI was the most utilized of the three services, followed by R/RN and CAPC. The most common presenting concerns that led PCPs and families to seek BHIPP services were anxiety, behavior problems, mood problems, and attention-concentration problems. The most common diagnostic impressions recorded by PCPs and BHIPP staff were anxiety, ADHD, and depression. These findings align with the top three clinical presentations reported to most CPAPs: anxiety, depression, and ADHD (
13–
16,
31), which are the most common pediatric mental health conditions (
32) nationwide and which the American Academy of Pediatrics has emphasized as priorities for PCPs to address (
6).
One-third of the patients were already receiving mental health services before contacting BHIPP, with most receiving medication evaluation and treatment, followed by school-based and psychotherapy services, which may indicate PCPs’ growing comfort with recognizing mental health problems and initiating in-office treatment or connecting families to community resources. The notable proportion of DMHI contacts underscores the important role of embedded social workers in primary care and as part of CPAP teams. BHIPP’s use of DMHI is novel; only one other CPAP (in Michigan) employs a similar service. Such interdisciplinary care supports PCPs and mental health providers in providing high-quality patient care and referring patients for other psychosocial treatments. Thus, onsite and off-site CPAP services are complementary (
11).
Differences in patient characteristics among services aligned with each service’s focus. For example, more young children, children with behavior problems, and those not already taking medication were seen through DMHI, an observation that is consistent with recommendations for evaluation and treatment of disruptive behavior problems (
33,
34). Similarly, more patients already prescribed medication and taking multiple medications were seen for CAPC, a finding consistent with research on Washington’s CPAP, which reported that 66% of CAPC patients were taking a psychotropic medication (
13).
To better understand the nature and complexity of the presenting concerns of patients served by CPAPs and associations of patient factors with CPAP service type and recommendations, we used latent class analysis to identify four classes of presenting concerns: anxiety only; mood and anxiety; behavior problems only; and attention, behavior, and learning problems. These classes are consistent with mental disorders—ADHD, anxiety, and depression—that the American Academy of Pediatrics recommends PCPs achieve competency to treat (
6). These classes also highlight key differences (e.g., behavior problems alone) that go beyond the most common subtype of ADHD, the combined subtype that includes both inattention symptoms and impulsivity and hyperactivity symptoms (behavioral symptoms), and emphasize key related conditions (e.g., learning problems such as a learning disability) that increase complexity of treatment needs.
The four latent classes of presenting concerns had important similarities and differences (
Table 3). Consistent with epidemiological data, patients in the mood and anxiety class were more likely to be female and older, whereas patients in the two behavior problems classes were more likely to be male and younger (
35). Patients in the two behavior problems classes were more likely to already be receiving mental health–related services at BHIPP contact, and those in the attention, behavior, and learning problems class were more likely to receive BHIPP’s DMHI. These findings are in line with previous work suggesting that youths with behavior problems are typically referred to and access mental health services at higher rates, compared with those with anxiety and depression (
36).
No between-class differences were noted in BHIPP recommendations for mental health screening or medication evaluation, which may indicate that most PCPs had already screened or conducted a medication evaluation before contacting BHIPP. Conversely, compared with patients in the anxiety-only class, patients in the other three classes were more likely to be recommended psychoeducational handouts and mental health services and community resources, and two classes were more likely to be recommended in-office intervention. Differences in BHIPP recommendations may signal the more complex needs of these subgroups compared with patients with anxiety symptoms alone. In summary, examining profiles of presenting concerns (rather than individual concerns) can improve understanding of the clinical complexity of the conditions of patients served through BHIPP. Knowledge of differences in CPAP service use by presenting mental health concern profile will inform improvements to CPAP training provided to PCPs in addressing the needs of pediatric patients with these profiles.
To our knowledge, these findings provide novel insights by describing patient characteristics within and across a broader array of CPAP services and examining profiles of presenting concerns and how they vary by service type and recommendations. However, this study had some limitations. As recommended by the American Academy of Pediatrics (
6), PCPs seem to seek CPAP services for patients with more complex and severe conditions, which may have affected the generalizability of the findings. Although CAPC and R/RN are available statewide, DMHI is available only in eight rural Maryland counties, which may have affected the demographic differences by service type in this study. Additionally, DMHI may be more expensive and difficult to implement and expand statewide, reflecting real-world limitations. Further, CGI-S ratings made during CAPC are based on provider-to-provider consultation instead of direct patient assessment. Study strengths included a sample of patients with a wide array of characteristics, which enhanced generalizability, and examination of presenting concern profiles rather than individual symptoms, which better captured co-occurring mental health conditions.
Conclusions
CPAPs are regional or statewide programs that are designed to decrease gaps between the need for and the availability of pediatric mental health services by bolstering PCPs’ comfort and skill in treating these conditions. This descriptive study explored utilization of CAPC, DMHI, and R/RN provided by Maryland’s CPAP. Each service appears to be serving patients with mental health needs aligned with that service’s focus (e.g., greater polypharmacy among CAPC patients). To our knowledge, this study is the first to examine symptom profiles to better understand the nature and complexity of patient needs across CPAP services. This study also identified greater use of embedded DMHI, compared with CAPC and R/RN, empowering PCPs to provide comprehensive care onsite. These findings provide guidance for expansion of CPAP services across the country and considerations for adjusting and expanding training and support for PCPs to improve the quality and availability of mental health services.