Skip to main content

Abstract

Objective:

Maryland’s Behavioral Health Integration in Pediatric Primary Care (BHIPP) is a child psychiatry access program offering child-adolescent psychiatry consultation, resource and referral networking, and direct-to-patient mental health intervention. This study investigated characteristics of patients for whom primary care providers sought BHIPP services.

Methods:

Data from 6,939 unique patient contacts between October 2012 and March 2020 were collected on service type, demographic characteristics, presenting concerns, clinical severity, clinicians’ diagnostic impressions, current treatments, and BHIPP recommendations. Descriptive statistics and latent class analysis were used.

Results:

Of the 6,939 patient contacts, 38.6% were for direct-to-patient mental health intervention, 27.3% for child-adolescent psychiatry consultation, and 34.2% for resource and referral networking. In total, 50.3% of patients were female, 58.7% were White, and 32.7% were already receiving mental health services. Latent class analysis identified four classes of presenting concerns: anxiety only (44.2%); behavior problems only (30.7%); mood and anxiety (17.1%); and attention, behavior, and learning problems (8.0%). Compared with patients in the anxiety-only class, those in the attention, behavior, and learning problems class were more likely to receive direct-to-patient mental health intervention (OR=3.59), and BHIPP clinicians were more likely to recommend in-office behavioral interventions for those in the mood and anxiety class (OR=1.62) and behavior problems–only class (OR=1.55).

Conclusions:

Patients supported through BHIPP varied in presenting concerns, condition severity and complexity, current receipt of services, and BHIPP utilization. Latent class analysis yielded more clinically useful information about the nature and complexity of patients’ concerns than did consideration of individual presenting concerns.

HIGHLIGHTS

This study examined characteristics of patients served through Maryland’s statewide child psychiatry access program (CPAP).
Associations were analyzed between patient characteristics and specific type of CPAP service used, including child-adolescent psychiatry consultation, resource and referral networking, and direct-to-patient mental health intervention.
Four clinical profiles of patient concerns were derived from the study data, which provided insight into the nature and complexity of patient needs across different types of CPAP services.
An obstacle to increasing access to pediatric mental health care is the significant shortage and unequal distribution of mental health professionals (e.g., child and adolescent psychiatrists) (13). To fill this gap, pediatric primary care providers (PCPs) are often tasked with diagnosing and treating mental health conditions (4). PCPs are a reasonable choice, given their longitudinal contact with families and that primary care represents a nonstigmatizing setting in which to address mental health concerns. The American Academy of Pediatrics recommends that PCPs play a central role in assessment and management of common mental health problems (e.g., anxiety) (5, 6). However, PCPs may lack the time and training to provide mental health care and may not be comfortable doing so (79).
A growing body of research supports embedded and off-site integration of mental health care with primary care to assist PCPs in meeting patients’ mental health needs (10, 11). Child psychiatry access programs (CPAPs) represent one promising strategy for increasing mental health care access. These programs, now operating in >30 states (12), provide continuing education, child-adolescent psychiatry consultation (CAPC), and resource and referral networking (R/RN) by telephone; several programs also offer limited direct-to-patient face-to-face or telehealth consultation with child-adolescent psychiatrists (1316). Two programs (in Maryland and Michigan) offer time-limited, face-to-face mental health treatment with embedded social workers (15, 17). However, CPAP services vary across states (13, 18).
Maryland Behavioral Health Integration in Pediatric Primary Care (BHIPP), a statewide CPAP, supports PCPs in managing their patients’ mental health needs through several interconnected services. PCPs’ calls to BHIPP’s warmline, a telephone service available Monday–Friday from 9 a.m. to 5 p.m., are answered by licensed social workers who assist with general questions and R/RN tailored to patients, as well as triaging calls for CAPC. BHIPP child-adolescent psychiatrists and licensed social workers collaborate on disposition letters sent to PCPs after a CAPC and meet twice a month to review patients served through CAPC to ensure consistency of guidance provided. BHIPP also offers continuing education to build PCP knowledge and skills. In collaboration with Salisbury University, and under supervision by licensed social workers, BHIPP also embeds master’s-level social work students in primary care practices in eight rural Maryland counties to provide direct-to-patient mental health intervention (DMHI), including screening, brief treatment (i.e., four to six therapy sessions), and case management, as well as to facilitate PCPs’ use of BHIPP’s warmline. Families access DMHI through PCP referral or self-referral. BHIPP child-adolescent psychiatrists and licensed social workers also support DMHI through provision of monthly training and supervision for master’s-level social work students and by recommending DMHI through CAPC and R/RN.
Previous research on CPAPs has primarily focused on program use, including characteristics of practices, providers, and patients served by CPAPs and provider and family satisfaction with services (19, 20). However, among studies examining patient characteristics, most have focused exclusively on CAPC, with only two studies from Michigan’s CPAP examining patient characteristics both across and within CPAP service types (15, 17). Further, all studies have relied on descriptive statistics to examine patient characteristics (e.g., call rates about depression vs. attention-deficit hyperactivity disorder [ADHD]), which limits understanding of the complex and overlapping mental health needs of patients served by CPAPs. To address these gaps, this study aimed to describe the demographic and clinical characteristics of patients served across BHIPP and by BHIPP service type (i.e., CAPC, R/RN, and DMHI) and to use latent class analysis, an exploratory person-centered approach, to examine patterns of presenting concerns in order to determine whether there are distinct subgroups of patients served by BHIPP and whether subgroups differ in patient characteristics, BHIPP service received, and BHIPP care recommendations provided. Addressing these aims will yield more clinically useful knowledge about the nature and complexity of the needs of patients served through CPAPs and will inform training and consultation provided to PCPs.

Methods

Study Sample

Between October 2012 and March 2020, a total of 9,569 patient-specific BHIPP contacts across three services (CAPC, R/RN, and DMHI) were completed. For DMHI, we restricted the sample to the first visit to avoid double counting patients (the original DMHI sample comprised 5,305 patient contacts involving 2,840 unique patients). Additionally, 165 (6%) of the 2,840 DMHI patients were excluded because they could not be connected with a PCP. Therefore, this analysis focused on 6,939 unique patients (N=1,893 in CAPC, N=2,371 in R/RN, and N=2,675 in DMHI) associated with 823 unique PCPs. Institutional review board approval was obtained from Johns Hopkins University, University of Maryland, and Maryland’s Department of Health.

Variables

Service type and patient data.

BHIPP service type included CAPC, R/RN, or DMHI. For descriptive statistics, a three-category variable indicated the service received. For latent class analysis, a binary variable comparing receipt of DMHI to receipt of warmline services (CAPC and R/RN) was created. Patient demographic data included gender, age, race-ethnicity, and insurance type (i.e., private, public, and none or unknown or missing).

Patient presenting concerns.

During BHIPP contacts, the PCP, patient, or family describes presenting concerns, and BHIPP clinicians select from a list of 44 presenting concerns. For this study, options were grouped into six categories: anxiety (anxiety, worries-fears, avoidance, dissociation, somatic complaints, obsessions, and compulsions), mood symptoms (depressed mood, emotion dysregulation, expansive mood, and labile mood), behavior problems (parent-child conflict, behavior problems at home and school, destructive behaviors, risky behaviors, sexual acting out, truancy, aggression, hurting animals, hyperactivity, and impulsivity), attention-concentration problems, learning problems (learning problems, learning disability, and underachievement at school), and self-injury (suicidal ideation, suicide attempt, and nonsuicidal self-injury). Binary variables were created for each category: 1, any presenting concerns within that category; 0, no presenting concerns within that category. Binary variables were used in descriptive analyses and as latent class indicators.

Mental health diagnostic impressions.

Diagnostic impressions regarding patients’ mental health were grouped into seven categories: ADHD with or without a learning disability; adjustment disorder; anxiety disorders; depressive disorders; disruptive behavior disorder or oppositional defiant disorder; trauma and related disorders; and more serious disorder, including autism spectrum disorder, bipolar disorder, eating disorder, mood disorder not otherwise specified, psychotic disorder, or substance use disorder. Each diagnostic impression was designated for each patient if either the PCP or BHIPP staff indicated that it was present.

Current treatments and case severity.

Current mental health–related treatments reported by the PCP, patient, or family during the contact included emergency department or crisis services, residential treatment, inpatient stay or hospitalization, day hospital, intensive outpatient treatment, outpatient psychotherapy, medication treatment, assessment-evaluation, mental health consultation, in-home services, early childhood mental health clinic, Infants and Toddlers Program, special education services, early learning center, home visiting, family education and support, school-based services, case management and family navigation, ancillary services (e.g., speech therapy), and other. A binary variable was created to indicate any or no service receipt, and similar services were grouped (e.g., emergency department and inpatient stay were grouped into a higher level of care) for descriptive analyses.
Case severity was based on BHIPP clinician ratings on the Clinical Global Impressions–Severity (CGI-S) scale, a single-item assessment capturing impressions of severity on a 7-point scale, from 1, normal, to 7, extremely ill (21). The CGI-S includes the clinician’s impression of the patient’s level of distress, illness severity, and functional impairment and has strong reliability and validity (21, 22). BHIPP clinicians receive ongoing training on the CGI-S to promote interrater reliability. Previous CPAP research has employed similar severity measures (13, 2325).

BHIPP recommendations.

BHIPP recommendations are made to the PCP, patient, and family regarding medication evaluation or change, symptom assessment with a screening tool, provision of psychoeducational handouts to the family, behavioral interventions in the PCP’s office (e.g., relaxation and behavior management), or referral of patients to mental health services or community resources. A binary variable was created to reflect whether each recommendation was made during BHIPP contact.

Statistical Analyses

Patient characteristics were examined with descriptive statistics. Latent class analysis, accounting for nesting of patients within PCPs, was conducted to identify classes of patients experiencing similar patterns of presenting concerns and to compare classes on patient characteristics, BHIPP service receipt, and BHIPP recommendations. Latent class models were estimated with Mplus, version 8.1 (26). Missing data were addressed by using full information maximum likelihood estimation. The number of latent classes was selected by comparing model fit statistics and class size. Model fit was assessed with standard fit statistics, including Bayesian information criterion (BIC) and sample size–adjusted BIC (aBIC) (27, 28). Decreases in fit statistics indicate model fit improvements. The Vuong-Lo-Mendell-Rubin likelihood ratio test (VLMR) was used to compare the relative fit of a model with k classes to a model with one fewer class. A statistically significant VLMR test indicates that the model with fewer classes should be rejected in support of the model with more classes (27). Entropy (range 0–1) was also examined; higher entropy values indicate better classification accuracy. Finally, class sizes were also examined, because research has shown that small or uncommon classes can be difficult to reliably identify and that it is important not to overextract classes (28, 29).
Once the best-fitting unconditional latent class model was identified, patient characteristics, BHIPP service type, and BHIPP recommendations were added to examine associations with class membership by using multinomial logistic regression through the auxiliary function R3step. This approach was selected because covariates were not intended to serve as latent class indicators or to directly influence the structure or size of latent classes but were hypothesized to be associated with class membership (30).

Results

Characteristics of Patients for Whom PCPs Sought BHIPP Services

Table 1 presents data on patient characteristics overall and by service type. Among the 6,939 unique patient contacts, 38.6% were for DMHI, 34.2% for R/RN, and 27.3% for CAPC. Half (50.3%) of the patients were female, and 58.7% were White. The mean±SD age of the sample was 11.3±5.1 years, and 37.6% were publicly insured. The most common presenting concerns were anxiety (39.7%), behavior problems (36.5%), mood problems (26.5%), and attention-concentration problems (17.5%). At BHIPP contact, 32.7% of patients were already receiving mental health–related services. Among the patients receiving services, 60.3% were receiving medication evaluation and treatment, 14.5% outpatient psychotherapy, and 15.1% school-based services; 27.3% were already taking psychotropic medications, and of this group, 28.4% were taking multiple medications. The most common diagnostic impressions were anxiety disorders (36.8%), ADHD with or without a learning disability (28.0%), and depressive disorders (19.1%). Approximately 55.0% of patients were rated in the mild-to-moderate impairment range on the CGI-S.
TABLE 1. Characteristics of patients for whom primary care providers sought services from Behavioral Health Integration in Pediatric Primary Care (BHIPP) and BHIPP recommendations, across all services and by service typea
 All patient contacts (N=6,939)CAPC (N=1,893)R/RN (N=2,371)DMHI (N=2,675)
CharacteristicN%N%N%N%
Gender
 Female3,49350.387746.31,22151.51,39552.1
 Male3,34148.199952.81,09846.31,24446.5
 Other7.12.12.13.1
 Unknown981.415.8502.1331.2
Race-ethnicity
 African American1,40120.228715.258524.652919.8
 Asian831.2231.2431.817.6
 Other3384.9774.1793.31826.8
 White4,07258.71,22564.71,02543.21,82268.1
 Unknown1,04515.128114.863927.01254.7
Age in years
 0–51,01014.61879.92219.360222.5
 6–122,83940.975740.092338.91,15943.3
 13–182,66238.479942.21,05744.680630.1
 >183715.31437.61456.1833.1
 Unknown57.87.4251.125.9
Patient insurance type
 Private3,03143.787446.21,44961.170826.5
 Public2,60937.657430.383735.31,19844.8
 None, unknown, or missing1,29918.744523.5853.676928.7
Presenting concerns at BHIPP service contactb
 Anxiety2,75639.780842.794039.61,00837.7
 Attention-concentration problems1,21617.538920.530112.752619.7
 Behavior problems2,53436.569236.665127.51,19144.5
 Learning problems4566.61377.2974.12228.3
 Mood problems1,83926.558330.878433.147217.6
 Self-injury3575.11457.71044.41084.0
Currently receiving any mental health–related services
 Yes2,27232.71,30869.050721.445717.1
 No4,33562.556529.81,71172.22,05977.0
 Unknown3324.8201.11536.11595.9
Type of mental health–related service currently receivingc
 Higher level of care (e.g., emergency department or inpatient)15.73.261.261.3
 Outpatient psychotherapy33014.518414.110019.74610.1
 Outpatient medication evaluation and treatment1,37060.390269.033165.313730.0
 Mental health consultation or evaluation18.86.551.071.5
 Early childhood services (e.g., Infants and Toddlers Program)371.612.92.4235.0
 School support services (e.g., Individualized Education Program)34415.115712.0418.114631.9
 Family support services (e.g., family navigation)683.01.11.26614.4
 Ancillary services (e.g., speech therapy)452.0282.1163.21.2
 Other452.0151.151.0255.5
Taking psychotropic medications
 Yes1,89727.31,11458.836715.541615.6
 No3,86055.669536.71,15648.82,00975.1
 Unknown1,18217.0844.584835.62509.3
Polypharmacyd
 Yes53828.435932.29425.68520.4
 No1,35971.675567.827374.433179.6
Clinicians’ diagnostic impression of patientb
 ADHD with or without learning disability1,94428.087046.044118.663323.7
 Adjustment disorder2794.0613.2532.21656.2
 Anxiety disorder2,55536.891448.379433.584731.7
 Depressive disorder1,32819.153228.158124.52158.0
 Disruptive behavior disorder or oppositional defiant disorder5087.324112.7753.21927.2
 More serious disorder92213.343623.028912.21977.4
 Trauma and related disorders2673.81105.8512.21064.0
Clinical severity rating by BHIPP staffe
 Normal3607.79.5  35013.2
 Borderline mentally ill96420.5301.7  92334.7
 Mildly ill85418.21789.8  63123.7
 Moderately ill1,72936.81,02256.4  59422.4
 Markedly ill64113.646425.6  1294.9
 Severely ill1282.7925.1  22.8
 Extremely ill27.617.9  8.3
a
CAPC, child-adolescent psychiatry consultation; DMHI, direct-to-patient mental health intervention; R/RN, resource and referral networking.
b
Patients could have multiple presenting concerns or diagnostic impressions.
c
Data for this variable are for the 2,272 patients who were engaged in some form of treatment at BHIPP contact.
d
Data on polypharmacy are for the 1,897 patients who were taking medications at BHIPP contact.
e
Assessed with the Clinical Global Impressions–Severity (CGI-S) scale; ratings were not routinely available for patients who received R/RN services. Therefore, analysis of CGI-S ratings was based on only 4,469 patients (CAPC, N=1,812; DMHI, N=2,657).
In the DMHI group, 52.1% of patients were female, most (68.1%) were White, 73.4% were ages 6–18, and 44.8% were publicly insured. Notably, the largest proportion of patients in the 0-to-5-year-old range (22.5%) were seen through BHIPP’s DMHI service. In the CAPC group, 52.8% were male, most (64.7%) were White, 82.2% were ages 6–18, and 30.3% were publicly insured. In the R/RN group, 51.5% were female, most were White (43.2%) or African American (24.6%), 83.5% were ages 6–18, and 35.3% were publicly insured.
The most common presenting concerns for patients receiving DMHI were behavior problems and anxiety, and most DMHI patients were not currently receiving mental health–related services or taking medication. For most DMHI patients, the diagnostic impression of the PCP or the BHIPP social work student was anxiety disorder or ADHD. Among patients served through CAPC, anxiety and behavior problems were the most common concerns, and at the initial BHIPP contact, most were already receiving mental health–related services, primarily through outpatient medication evaluation and treatment; about one-third were taking multiple medications. For the CAPC group, the most common diagnostic impressions were anxiety and ADHD. For the R/RN group, anxiety and mood problems were the most common presenting concerns, and most patients were not receiving mental health–related services or taking medication. For the R/RN group, the most common diagnostic impressions of PCPs or BHIPP staff were anxiety and depressive disorders. Severity ratings varied by service group; most patients receiving DMHI were rated as borderline mentally ill, mildly ill, or moderately ill (80.8%); most patients receiving CAPC were rated as moderately, markedly, severely, or extremely ill (88.0%).

Latent Class Analysis of Patient Presenting Concerns

Comparison of fit statistics (Table 2) suggested that the lowest BIC and aBIC values were obtained for the four-class model, and VLMR results indicated that a four-class model fit better than a three-class model but that a five-class model did not fit better than the four-class model. Therefore, we selected the four-class model as the best fitting model.
TABLE 2. Common model fit indices for latent class models of patient presenting concerns reported at time of BHIPP contacta
     Smallest class size
N of classesBICaBICVLMR-LRT p valueEntropyN%
139,12939,110nananana
237,53837,497<.001.582,66238.4
337,19837,135<.001.591,20717.4
437,08536,999<.001.635518.0
537,11337,005.206.682083.0
637,16337,033.263.74701.0
a
The analysis was based on 6,939 unique patient contacts with Behavioral Health Integration in Pediatric Primary Care (BHIPP) with complete information on referring provider. BIC, Bayesian information criterion; aBIC, sample size–adjusted BIC; VLMR-LRT, Vuong-Lo-Mendell-Rubin likelihood ratio test. VLMR-LRT and entropy were not applicable (na) for the one-class model.
Profiles representing the estimated probability of the PCP, patient, or family reporting each presenting concern are shown in Figure 1. Of note, class counts and proportions were based on estimated posterior probabilities. Item endorsement patterns revealed an anxiety-only class (44.2%, N=3,069), characterized by a high probability of anxiety and a low probability of other symptoms; a behavior problems–only class (30.7%, N=2,132), characterized by a high probability of behavior problems and a low probability of other symptoms; a mood and anxiety class (17.1%, N=1,187), characterized by a high probability of mood symptoms, moderate probability of anxiety, and low probability of other symptoms; and an attention, behavior, and learning problems class (8.0%, N=551), characterized by a high probability of attention-concentration, behavior, and learning problems and a low probability of other symptoms.
FIGURE 1. Conditional item probability plots for the four-class model of presenting concerns of patients who were the focus of contacts with a child psychiatry access programa
a Item responses that make up the latent classes are listed along the x-axis. The probability of endorsing each item is reported by class membership. Values shown on the y-axis indicate the probability of endorsing a particular item for participants within each latent class. The proportions of patients with Maryland’s Behavioral Health Integration in Pediatric Primary Care reflected in each latent class are shown in the figure key. Class counts and proportions were based on estimated posterior probabilities. Counts for the classes were as follows: anxiety only (N=3,069), behavior problems only (N=2,132), mood and anxiety (N=1,187), and attention, behavior, and learning problems (N=551).
We examined associations between patient and service characteristics and class membership by using the largest class (anxiety class) as the reference. Class membership varied by covariates (Table 3). Compared with individuals in the anxiety-only class, patients in the mood and anxiety class were less likely to be male, to be younger than 8 years, or to be privately insured and more likely to have BHIPP recommend distribution of psychoeducational handouts, in-office behavioral interventions, and referral to mental health services or community resources. Compared with patients in the anxiety-only class, those in the attention, behavior, and learning problems class were more likely to be male, to be already receiving mental health–related services, to be seen for DMHI, and to have BHIPP recommend handouts and referral to mental health services or community resources and were less likely to be privately insured. Compared with individuals in the anxiety-only class, patients in the behavior problems–only class were more likely to be male, to be younger than 8 years, to be already receiving mental health–related services, and to have BHIPP recommend handouts, in-office behavioral interventions, and referral to mental health services or community resources and were less likely to be privately insured.
TABLE 3. Odds of patient characteristics and BHIPP service type as predictors of latent class membershipa
 Class
Patient characteristicMood and anxietyAttention, behavior, and learning problemsBehavior problems only
Male.75*3.33**3.28**
<8 years old.00**1.245.87**
Private insurance.62**.59**.47**
Already receiving mental health–related services at time of BHIPP contact1.252.61**1.63**
Received BHIPP DMHI.753.59**1.23
BHIPP staff recommendation   
 Medication evaluation or medication change1.291.221.32
 Administration of mental health screening instrument.901.36.84
 Provide psychoeducational handouts1.72*1.74**1.50*
 In-office behavioral intervention1.62*1.301.55**
 Referral to mental health services or community resources3.30**2.57**1.46**
a
Values are ORs estimated in multinomial logistic regression analysis; the reference group was the anxiety-only class. The analysis was based on data for 6,485 patients because of missing data related to age, gender, and current receipt of mental health services. BHIPP, Behavioral Health Integration in Pediatric Primary Care; DMHI, direct-to-patient mental health intervention.
*p<0.05, **p<0.01.

Discussion

Maryland BHIPP is a CPAP supporting PCPs in managing pediatric mental health conditions through three interconnected services: CAPC, R/RN, and DMHI. Our findings indicate that DMHI was the most utilized of the three services, followed by R/RN and CAPC. The most common presenting concerns that led PCPs and families to seek BHIPP services were anxiety, behavior problems, mood problems, and attention-concentration problems. The most common diagnostic impressions recorded by PCPs and BHIPP staff were anxiety, ADHD, and depression. These findings align with the top three clinical presentations reported to most CPAPs: anxiety, depression, and ADHD (1316, 31), which are the most common pediatric mental health conditions (32) nationwide and which the American Academy of Pediatrics has emphasized as priorities for PCPs to address (6).
One-third of the patients were already receiving mental health services before contacting BHIPP, with most receiving medication evaluation and treatment, followed by school-based and psychotherapy services, which may indicate PCPs’ growing comfort with recognizing mental health problems and initiating in-office treatment or connecting families to community resources. The notable proportion of DMHI contacts underscores the important role of embedded social workers in primary care and as part of CPAP teams. BHIPP’s use of DMHI is novel; only one other CPAP (in Michigan) employs a similar service. Such interdisciplinary care supports PCPs and mental health providers in providing high-quality patient care and referring patients for other psychosocial treatments. Thus, onsite and off-site CPAP services are complementary (11).
Differences in patient characteristics among services aligned with each service’s focus. For example, more young children, children with behavior problems, and those not already taking medication were seen through DMHI, an observation that is consistent with recommendations for evaluation and treatment of disruptive behavior problems (33, 34). Similarly, more patients already prescribed medication and taking multiple medications were seen for CAPC, a finding consistent with research on Washington’s CPAP, which reported that 66% of CAPC patients were taking a psychotropic medication (13).
To better understand the nature and complexity of the presenting concerns of patients served by CPAPs and associations of patient factors with CPAP service type and recommendations, we used latent class analysis to identify four classes of presenting concerns: anxiety only; mood and anxiety; behavior problems only; and attention, behavior, and learning problems. These classes are consistent with mental disorders—ADHD, anxiety, and depression—that the American Academy of Pediatrics recommends PCPs achieve competency to treat (6). These classes also highlight key differences (e.g., behavior problems alone) that go beyond the most common subtype of ADHD, the combined subtype that includes both inattention symptoms and impulsivity and hyperactivity symptoms (behavioral symptoms), and emphasize key related conditions (e.g., learning problems such as a learning disability) that increase complexity of treatment needs.
The four latent classes of presenting concerns had important similarities and differences (Table 3). Consistent with epidemiological data, patients in the mood and anxiety class were more likely to be female and older, whereas patients in the two behavior problems classes were more likely to be male and younger (35). Patients in the two behavior problems classes were more likely to already be receiving mental health–related services at BHIPP contact, and those in the attention, behavior, and learning problems class were more likely to receive BHIPP’s DMHI. These findings are in line with previous work suggesting that youths with behavior problems are typically referred to and access mental health services at higher rates, compared with those with anxiety and depression (36).
No between-class differences were noted in BHIPP recommendations for mental health screening or medication evaluation, which may indicate that most PCPs had already screened or conducted a medication evaluation before contacting BHIPP. Conversely, compared with patients in the anxiety-only class, patients in the other three classes were more likely to be recommended psychoeducational handouts and mental health services and community resources, and two classes were more likely to be recommended in-office intervention. Differences in BHIPP recommendations may signal the more complex needs of these subgroups compared with patients with anxiety symptoms alone. In summary, examining profiles of presenting concerns (rather than individual concerns) can improve understanding of the clinical complexity of the conditions of patients served through BHIPP. Knowledge of differences in CPAP service use by presenting mental health concern profile will inform improvements to CPAP training provided to PCPs in addressing the needs of pediatric patients with these profiles.
To our knowledge, these findings provide novel insights by describing patient characteristics within and across a broader array of CPAP services and examining profiles of presenting concerns and how they vary by service type and recommendations. However, this study had some limitations. As recommended by the American Academy of Pediatrics (6), PCPs seem to seek CPAP services for patients with more complex and severe conditions, which may have affected the generalizability of the findings. Although CAPC and R/RN are available statewide, DMHI is available only in eight rural Maryland counties, which may have affected the demographic differences by service type in this study. Additionally, DMHI may be more expensive and difficult to implement and expand statewide, reflecting real-world limitations. Further, CGI-S ratings made during CAPC are based on provider-to-provider consultation instead of direct patient assessment. Study strengths included a sample of patients with a wide array of characteristics, which enhanced generalizability, and examination of presenting concern profiles rather than individual symptoms, which better captured co-occurring mental health conditions.

Conclusions

CPAPs are regional or statewide programs that are designed to decrease gaps between the need for and the availability of pediatric mental health services by bolstering PCPs’ comfort and skill in treating these conditions. This descriptive study explored utilization of CAPC, DMHI, and R/RN provided by Maryland’s CPAP. Each service appears to be serving patients with mental health needs aligned with that service’s focus (e.g., greater polypharmacy among CAPC patients). To our knowledge, this study is the first to examine symptom profiles to better understand the nature and complexity of patient needs across CPAP services. This study also identified greater use of embedded DMHI, compared with CAPC and R/RN, empowering PCPs to provide comprehensive care onsite. These findings provide guidance for expansion of CPAP services across the country and considerations for adjusting and expanding training and support for PCPs to improve the quality and availability of mental health services.

References

1.
Kim WJ, American Academy of Child and Adolescent Psychiatry Task Force on Workforce Needs: Child and adolescent psychiatry workforce: a critical shortage and national challenge. Acad Psychiatry 2003; 27:277–282
2.
McBain RK, Kofner A, Stein BD, et al: Growth and distribution of child psychiatrists in the United States: 2007–2016. Pediatrics 2019; 144:e20191576
3.
National Projections of Supply and Demand for Selected Behavioral Health Practitioners: 2013–2025. Rockville, MD, U.S. Department of Health and Human Services, National Center for Health Workforce Analysis, 2015
4.
Williams J, Palmes G, Klinepeter K, et al: Referral by pediatricians of children with behavioral health disorders. Clin Pediatr 2005; 44:343–349
5.
Zuckerbrot RA, Cheung A, Jensen PS, et al: Guidelines for Adolescent Depression in Primary Care (GLAD-PC): part I. Practice preparation, identification, assessment, and initial management. Pediatrics 2018; 141:e20174081
6.
Foy JM, Green CM, Earls MF, et al: Mental health competencies for pediatric practice. Pediatrics 2019; 144:e20192757
7.
Horwitz SM, Storfer-Isser A, Kerker BD, et al: Barriers to the identification and management of psychosocial problems: changes from 2004 to 2013. Acad Pediatr 2015; 15:613–620
8.
Campo JV, Geist R, Kolko DJ: Integration of pediatric behavioral health services in primary care: improving access and outcomes with collaborative care. Can J Psychiatry 2018; 63:432–438
9.
Heneghan A, Garner AS, Storfer-Isser A, et al: Pediatricians’ role in providing mental health care for children and adolescents: do pediatricians and child and adolescent psychiatrists agree? J Dev Behav Pediatr 2008; 29:262–269
10.
Platt RE, Spencer AE, Burkey MD, et al: What’s known about implementing co-located paediatric integrated care: a scoping review. Int Rev Psychiatry 2018; 30:242–271
11.
Spencer AE, Platt RE, Bettencourt AF, et al: Implementation of off-site integrated care for children: a scoping review. Harv Rev Psychiatry 2019; 27:342–353
12.
Child Psychiatry Access Programs in the United States. Boston, National Network of Child Psychiatry Access Programs, 2021. https://www.nncpap.org/map. Accessed March 15, 2021
13.
Hilt RJ, Romaire MA, McDonell MG, et al: The Partnership Access Line: evaluating a child psychiatry consult program in Washington State. JAMA Pediatr 2013; 167:162–168
14.
Kaye DL, Fornari V, Scharf M, et al: Description of a multi-university education and collaborative care child psychiatry access program: New York State’s CAP PC. Gen Hosp Psychiatry 2017; 48:32–36
15.
Marcus S, Malas N, Dopp R, et al: The Michigan Child Collaborative Care program: building a telepsychiatry consultation service. Psychiatr Serv 2019; 70:849–852
16.
Sarvet B, Gold J, Bostic JQ, et al: Improving access to mental health care for children: the Massachusetts Child Psychiatry Access Project. Pediatrics 2010; 126:1191–1200
17.
Marcus SM, Malas NM, Quigley JM, et al: Partnerships with primary care for the treatment of preschoolers. Child Adolesc Psychiatr Clin N Am 2017; 26:597–609
18.
Sullivan K, George P, Horowitz K: Addressing national workforce shortages by funding child psychiatry access programs. Pediatrics 2021; 147:e20194012
19.
Bettencourt AF, Plesko CM: A systematic review of the methods used to evaluate child psychiatry access programs. Acad Pediatr 2020; 20:1071–1082
20.
Cotton A, Riddle MA, Reinblatt SP, et al: Characteristics of providers using a child psychiatry access program. Psychiatr Serv 2021; 72:1213–1217
21.
Guy W: Clinical Global Impressions (CGI) scale, modified; in Handbook of Psychiatric Measures. Edited by Rush AJ. Washington, DC, American Psychiatric Association, 2000
22.
Busner J, Targum SD: The Clinical Global Impressions scale: applying a research tool in clinical practice. Psychiatry 2007; 4:28–37
23.
Barclay RP, Hilt RJ, Garrison M: A statewide pediatric psychiatry consultation to primary care program and the care of children with trauma-related concerns. J Behav Health Serv Res 2016; 43:691–699
24.
Platt R, Pustilnik S, Connors E, et al: Severity of mental health concerns in pediatric primary care and the role of child psychiatry access programs. Gen Hosp Psychiatry 2018; 53:12–18
25.
Bettencourt AF, Allen CL, Coble K, et al: Trends in mental health concerns reported to two pediatric mental health care access programs during the COVID-19 pandemic. Psychiatr Serv 2022; 73:670–673
26.
Muthén LK, Muthén BO: Mplus: Statistical Analysis With Latent Variables. User’s Guide, Version 8.0. Los Angeles, Muthén and Muthén, 2017
27.
Nylund KL, Asparouhov T, Muthén BO: Deciding on the number of classes in latent class analysis and growth mixture modeling: a Monte Carlo simulation study. Struct Equ Model 2007; 14:535–569
28.
Nylund-Gibson K, Choi AY: Ten frequently asked questions about latent class analysis. Transl Issues Psychol Sci 2018; 4:440–461
29.
Morgan GB: Mixed mode latent class analysis: an examination of fit index performance for classification. Struct Equ Model 2015; 22:76–86
30.
Asparouhov T, Muthén B: Auxiliary Variables in Mixture Modeling: A 3-Step Approach Using Mplus. Los Angeles, Muthén and Muthén, 2013
31.
Van Cleave J, Holifield C, Perrin JM: Primary care providers’ use of a child psychiatry telephone support program. Acad Pediatr 2018; 18:266–272
32.
Data and Statistics on Children’s Mental Health. Atlanta, Centers for Disease Control and Prevention, 2021. https://www.cdc.gov/childrensmentalhealth/data.html. Accessed Nov 2, 2022
33.
Wolraich ML, Hagan JF Jr, Allan C, et al: Clinical practice guideline for the diagnosis, evaluation, and treatment of attention-deficit/hyperactivity disorder in children and adolescents. Pediatrics 2019; 144:e20192528
34.
Rule Breaking, Defiance, & Acting Out. Washington, DC, American Psychological Association, Society of Clinical Child and Adolescent Psychology, 2021. https://effectivechildtherapy.org/concerns-symptoms-disorders/disorders/rule-breaking-defiance-and-acting-out. Accessed Nov 2, 2022
35.
Ghandour RM, Sherman LJ, Vladutiu CJ, et al: Prevalence and treatment of depression, anxiety, and conduct problems in US children. J Pediatr 2019; 206:256–267.e3
36.
Costello EJ, He JP, Sampson NA, et al: Services for adolescents with psychiatric disorders: 12-month data from the National Comorbidity Survey–Adolescent. Psychiatr Serv 2014; 65:359–366

Information & Authors

Information

Published In

Go to Psychiatric Services
Go to Psychiatric Services
Psychiatric Services
Pages: 718 - 726
PubMed: 36475823

History

Received: 20 June 2022
Revision received: 26 September 2022
Accepted: 7 October 2022
Published online: 7 December 2022
Published in print: July 01, 2023

Keywords

  1. Child psychiatry access program
  2. Pediatrics
  3. Integrated care
  4. Primary care
  5. Program evaluation
  6. Utilization patterns and review

Authors

Details

Amie F. Bettencourt, Ph.D. [email protected]
Department of Psychiatry and Behavioral Sciences, Division of Child and Adolescent Psychiatry, Johns Hopkins University School of Medicine, Baltimore (Bettencourt, Reinblatt, Khan, Riddle); Department of Psychiatry, Division of Child and Adolescent Psychiatry, University of Maryland School of Medicine, Baltimore (Coble, Reinblatt); Kennedy Krieger Institute, Baltimore (Jadhav).
Kelly Coble, M.S.W.
Department of Psychiatry and Behavioral Sciences, Division of Child and Adolescent Psychiatry, Johns Hopkins University School of Medicine, Baltimore (Bettencourt, Reinblatt, Khan, Riddle); Department of Psychiatry, Division of Child and Adolescent Psychiatry, University of Maryland School of Medicine, Baltimore (Coble, Reinblatt); Kennedy Krieger Institute, Baltimore (Jadhav).
Shauna P. Reinblatt, M.D.
Department of Psychiatry and Behavioral Sciences, Division of Child and Adolescent Psychiatry, Johns Hopkins University School of Medicine, Baltimore (Bettencourt, Reinblatt, Khan, Riddle); Department of Psychiatry, Division of Child and Adolescent Psychiatry, University of Maryland School of Medicine, Baltimore (Coble, Reinblatt); Kennedy Krieger Institute, Baltimore (Jadhav).
Sneha Jadhav, M.D.
Department of Psychiatry and Behavioral Sciences, Division of Child and Adolescent Psychiatry, Johns Hopkins University School of Medicine, Baltimore (Bettencourt, Reinblatt, Khan, Riddle); Department of Psychiatry, Division of Child and Adolescent Psychiatry, University of Maryland School of Medicine, Baltimore (Coble, Reinblatt); Kennedy Krieger Institute, Baltimore (Jadhav).
Kainat N. Khan, M.S.
Department of Psychiatry and Behavioral Sciences, Division of Child and Adolescent Psychiatry, Johns Hopkins University School of Medicine, Baltimore (Bettencourt, Reinblatt, Khan, Riddle); Department of Psychiatry, Division of Child and Adolescent Psychiatry, University of Maryland School of Medicine, Baltimore (Coble, Reinblatt); Kennedy Krieger Institute, Baltimore (Jadhav).
Mark A. Riddle, M.D.
Department of Psychiatry and Behavioral Sciences, Division of Child and Adolescent Psychiatry, Johns Hopkins University School of Medicine, Baltimore (Bettencourt, Reinblatt, Khan, Riddle); Department of Psychiatry, Division of Child and Adolescent Psychiatry, University of Maryland School of Medicine, Baltimore (Coble, Reinblatt); Kennedy Krieger Institute, Baltimore (Jadhav).

Notes

Send correspondence to Dr. Bettencourt ([email protected]).

Competing Interests

The authors report no financial relationships with commercial interests.

Funding Information

A poster presentation of these findings was exhibited at the virtual annual meeting of the American Academy of Child and Adolescent Psychiatry, Chicago, October 12–24, 2020.
Maryland Behavioral Health Integration in Pediatric Primary Care (BHIPP) is supported by funding from the Behavioral Health Administration (BHA), Maryland Department of Health, and operates as a collaboration between the University of Maryland School of Medicine, the Johns Hopkins University School of Medicine, Salisbury University, and Morgan State University. BHIPP and this study were also supported by award U4CMC32913 from the Health Resources and Services Administration (HRSA), U.S. Department of Health and Human Services (HHS).
The views expressed are those of the authors and do not necessarily represent the official views of, nor an endorsement by, BHA, HRSA, HHS, or the U.S. government.

Metrics & Citations

Metrics

Citations

Export Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format
Citation style
Style
Copy to clipboard

View Options

View options

PDF/EPUB

View PDF/EPUB

Login options

Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.

Personal login Institutional Login Open Athens login
Purchase Options

Purchase this article to access the full text.

PPV Articles - Psychiatric Services

PPV Articles - Psychiatric Services

Not a subscriber?

Subscribe Now / Learn More

PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.

Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).

Media

Figures

Other

Tables

Share

Share

Share article link

Share