Skip to main content
Full access
Open Forum
Published Online: 19 February 2024

Three Lessons Learned About Power and Improving Recruitment of Underrepresented Populations in Clinical Trials

Abstract

This Open Forum is relevant for investigators who conduct research with historically understudied and marginalized populations. The authors introduce a U.S. Department of Veterans Affairs clinical trial that experienced challenges with recruitment of African American or Black veterans and was terminated for not achieving its recruitment goals. The role of power dynamics in clinical research is discussed, specifically how unequal distributions of power may create recruitment challenges. The authors summarize three lessons learned and offer recommendations for sharing power equitably between investigators and potential participants. By recounting these experiences, the authors seek to promote culturally sensitive, veteran-centered approaches to recruitment in future clinical trials.
In the Veterans Health Administration, the rate of alcohol use disorder remains high among veterans who identify as American of African descent or Black (1, 2). Although effective therapeutics for alcohol use disorder exist, identification of novel, safe, and effective medications remains a top priority (3). However, most clinical trials foreground White participants, a bias contributing to disparities in access to empirically supported treatments (4). Clinical trials that equitably include African American or Black participants are needed to provide efficacy data and improve the quality of health care for underserved populations.
A U.S. Department of Veterans Affairs clinical trial, titled “Topiramate Treatment of Alcohol Use Disorder in African Americans” (the VA-TOP study), aimed to test the efficacy of the medication topiramate for the treatment of African American or Black veterans with alcohol use disorder (5). However, a challenge arose in meeting trial recruitment goals (target N=160 participants). Although successful in recruiting, obtaining consent from, and randomly assigning a number of African American or Black patients (N=35) to treatment, the study’s researchers were unable to enroll the number of patients necessary for statistical power calculations, and the study was discontinued. This experience is not uncommon. Well-publicized barriers to participation by underrepresented groups include participants’ discomfort with the research process, time and resource constraints, discriminatory research practices, and lack of diversity in the research workforce (4). To eliminate the proliferation of flawed and underpowered clinical trials, a nuanced understanding of challenges with recruitment is needed.
We suggest that power dynamics must be recognized and embraced so that underserved populations can participate equitably (6, 7). Traditionally, power in clinical research has been thought to be wielded exclusively by the investigator. However, although rarely acknowledged, participants also hold power (e.g., through their ability to decide under what conditions they will participate in research). When researchers ignore or are naïve about such power dynamics, imbalances in power result, creating recruitment challenges.
Late into recruitment for the VA-TOP study, it was discovered that 50% (N=505 of 1,010) of potential participants contacted by the study team declined to participate. This high rate of declined participation had not been anticipated and initially puzzled the study team. To better understand nonparticipation, the team collected data about reported concerns of the contacted veterans who had declined participation (N=505), which included the following: skepticism of medication research (N=141, 28%), beliefs that one’s drinking was not problematic or a preference to reduce it on one’s own (N=67, 13%), the time commitment required (N=62, 12%), and transportation difficulties (N=15, 3%). Once these problems were known, the research team approached the Veterans Community Advisory Board (VCAB) for input into how to address these issues. However, recruitment for the clinical trial had fallen too far behind its stated goals, leading to discontinuation of the study. Importantly, the VCAB’s input revealed the decision map that veteran participants follow and emphasized several important lessons. Therefore, we encourage investigators who engage with historically understudied populations to consciously reflect on power dynamics and their effects on recruitment. In the following, we offer recommendations for ensuring an equitable balance of power between investigators and participants in clinical trials.

Lessons Learned From the VA-TOP Study

Meaningfully Connect With the Population

We urge investigators to form meaningful relationships with the population of focus as early as possible and to consider representation of the chosen population on their research team from the outset. A team of individuals from different racial and ethnic backgrounds is beneficial regardless of the type of research undertaken but could be pivotal for research with underserved populations. More crucial for behavioral health research is the stigmatization around conditions such as alcohol use disorder, which can be ameliorated by having members of the population of interest on the study team (6). Although greater attention to solutions that ensure diversity in the research workforce is needed, efforts by investigators to include participants’ voices in research can still be meaningful (8). For example, the VCAB recommended simple fixes to ensure that the study population saw itself represented on the study team: that veterans be among those performing consent procedures and that an African American or Black representative from the VCAB observe consent procedures to offer specific feedback. When a research team neglects inclusion of members from the population of interest on the study team, power imbalances occur, such as unfounded assumptions by investigators regarding acceptability of research processes, patronizing and condescending conversations with participants, and research interpretation and outcomes that fail to mirror the realities of the patients involved and of the larger population of patients that clinical trials are designed to serve (7).
Moreover, it is well established that investment in the research study by the specific population that is the focus of the research will build trust, offer credibility, and engender an equitable balance of power between the research team and participants (9). Research shows that being in visible partnership with champions from within the community is effective for recruitment (6, 10, 11). It is important to consider what resources will be needed to facilitate these partnerships (e.g., staff salaries and consultant fees) and to add costs of these resources to grant budgets. The expectations that will be placed on the selected partners for the study also need to be considered. Although formal responsibilities can be outlined, investigators should also consider implicit institutional biases that members of the community might encounter (7). It is key to reflect on these issues from the outset and to establish plans for how community members will be meaningful members of the research team—with shared power and agency. These practices promote equity and inclusion within a research ecosystem and make members of the community true research partners.

Ensure That Eligibility Criteria Are Inclusive

Because investigators designate study eligibility criteria, they are in a position of power as gatekeepers. Importantly, eligibility criteria are commonly modeled on previous clinical trials consisting of predominantly White samples. Consequently, individuals from racial and ethnic minority groups may be disproportionately excluded owing to a host of discriminatory factors based in histories of marginalization (12). We witnessed this phenomenon in the VA-TOP study: top reasons for excluding potential participants during chart review (N=2,669 reviews) were use of ineligible medications (N=347, 13%), a history of schizophrenia or bipolar spectrum disorder diagnoses in the medical record (N=239, 9%), and chronic health conditions (N=82, 3%).
When developing eligibility criteria for a condition such as alcohol use disorder, researchers should consider limiting medication exclusions to those solely based on safety for the specific study medication. Additionally, researchers should be aware of potentially stigmatizing diagnoses that may be historically disproportionately used among individuals from marginalized groups, such as people with bipolar disorder or schizophrenia (13, 14). Specifically, we caution against using a lifetime diagnosis in a medical record as the basis for exclusion. Instead, we suggest beginning with a lower screening threshold and adding clinical assessments that sensitively ask questions about comorbid conditions and diagnoses.

Seek Continuous Partnered Collaboration

Although it was not initially apparent why participant recruitment into the VA-TOP trial became challenging, problems were quickly identified by the VCAB, reinforcing the advantages of including the community early on. First, several changes to the consent form were suggested, including simplifying the language, emphasizing the benefits of the research, and providing clearer descriptions of the study medication and possible adverse effects. Another important suggestion was that participants have an opportunity to meet with the principal investigator during informed consent visits to ask questions about the study, facilitating trust. Additionally, the payment schedule was altered to better compensate participants for their time. Finally, recruitment materials were redesigned after the VCAB noted stock images that were stigmatizing and discriminatory.
Meaningful inclusion of the study population centers empowerment: power is reflected in decisions that count (7, 9). In clinical research, especially in studies focused on stigmatized behavioral health conditions such as alcohol use disorder, power is unequally distributed between a study team and study participants. Although consulting with the population about ways to share power will raise issues that may evoke discomfort, such consultation is invaluable (7). Without such collaboration, participants may behave passively, as observed in the VA-TOP study, exercising what power they do have through drifting away from the study rather than firmly expressing reasons for their unwillingness to participate.
We recommend that investigators seek collaboration (rather than mere feedback) continuously from study conceptualization to dissemination. Investigators should consider the institutional environment and who in the institution can offer insight, even if such contributors are external to the research program. Most importantly, researchers should empower collaborators with real decision-making capacities, ensuring not only that their perspectives and experiences are being sought but also meaningfully incorporated (7, 10, 15). Ongoing collaboration with the population of interest will ensure that study design and materials are culturally sensitive, increase the population’s investment in the research, and facilitate greater ecological validity and clinical applicability, preventing many of the issues experienced with the VA-TOP study. Further, collaboration equitably shares power within clinical research processes and outcomes.

Implications and Conclusions

The inclusion of marginalized groups in clinical trials is crucial to building culturally informed treatment practices. Investigators should create research environments that mirror the needs of populations underrepresented in research, rather than interpreting low recruitment as a pathology of the population itself. Even though investigators traditionally have been perceived to hold all power in clinical research, it remains important to acknowledge the power that participants hold and will exert when studies are not culturally sensitive. Ideally, future research will incorporate thoughtful choices that meaningfully empower the population researchers are seeking to recruit throughout all phases of the study. Such intentions will increase knowledge of effective medication treatments for patients from underserved populations, boost engagement among individuals from the population of interest, and reduce health disparities. We conclude with the words of a VA-TOP participant and contributing author (C.L.) about his experience in the study after the VCAB’s recommendations were implemented:
I was already motivated to participate, but the more I interacted with the study, the more invested I felt. The study team encouraged and empowered me to be involved through their language and their demeanor. I felt extremely comfortable due to the level of transparency, constant communication, and humility from the research team. There was no point where I was vacillating in my decision to participate. I felt that I was important to the study. Being in the study is what I needed to be doing, not only for myself but for other veterans.

Acknowledgments

The authors acknowledge Maria Arevalo Gonzalez, B.A., and Erin Ingram, B.A., for help with data management and cleaning in preparation of the manuscript. The authors also acknowledge Dr. Francis Ennels, who reviewed and offered feedback on the manuscript. The authors thank the VCAB for being an essential partner in this research and the study participants for contributing their time and sharing their experiences.

References

1.
Caetano R: Alcohol-related health disparities and treatment-related epidemiological findings among Whites, Blacks, and Hispanics in the United States. Alcohol Clin Exp Res 2003; 27:1337–1339
2.
Williams EC, Gupta S, Rubinsky AD, et al: Racial/ethnic differences in the prevalence of clinically recognized alcohol use disorders among patients from the US Veterans Health Administration. Alcohol Clin Exp Res 2016; 40:359–366
3.
Litten RZ, Wilford BB, Falk DE, et al: Potential medications for the treatment of alcohol use disorder: an evaluation of clinical efficacy and safety. Subst Abus 2016; 37:286–298
4.
Reopell L, Nolan TS, Gray DM, et al: Community engagement and clinical trial diversity: navigating barriers and co-designing solutions—a report from the “Health Equity Through Diversity” seminar series. PLoS One 2023; 18:e0281940
5.
Blodgett JC, Del Re AC, Maisel NC, et al: A meta‐analysis of topiramate’s effects for individuals with alcohol use disorders. Alcohol Clin Exp Res 2014; 38:1481–1488
6.
Young K, Kaminstein D, Olivos A, et al: Patient involvement in medical research: what patients and physicians learn from each other. Orphanet J Rare Dis 2019; 14:21
7.
Kaminstein DS, Brown KM: Conceptualizing the carrying function of community advisory boards. J Appl Behav Sci 2023:002188632311554
8.
Maxwell HL, Smith-Benson PA, Velasquez B, et al: The importance of the veteran’s voice: three veterans recount their engagement with VA research. J Gen Intern Med 2022; 37:88–90
9.
Safo S, Cunningham C, Beckman A, et al: “A place at the table”: a qualitative analysis of community board members’ experiences with academic HIV/AIDS research. BMC Med Res Methodol 2016; 16:80
10.
Gallegos D, Durham J, Rutter C, et al: Working towards the active participation of underrepresented populations in research: a scoping review and thematic synthesis. Health Soc Care Community 2023; 2023:1–26
11.
Cramer ME, Lazoritz S, Shaffer K, et al: Community advisory board members’ perspectives regarding opportunities and challenges of research collaboration. West J Nurs Res 2018; 40:1032–1048
12.
Humphreys K, Weisner C: Use of exclusion criteria in selecting research subjects and its effect on the generalizability of alcohol treatment outcome studies. Am J Psychiatry 2000; 157:588–594
13.
Barnes A: Race and hospital diagnoses of schizophrenia and mood disorders. Soc Work 2008; 53:77–83
14.
Schwartz RC, Blankenship DM: Racial disparities in psychotic disorder diagnosis: a review of empirical literature. World J Psychiatry 2014; 4:133–140
15.
Brown KM, Walker L, Kaminstein DS: Building an effective and empowered community advisory board for veterans. J Humanist Psychol 2020:002216782097603

Information & Authors

Information

Published In

Go to Psychiatric Services
Go to Psychiatric Services
Psychiatric Services
Pages: 820 - 823
PubMed: 38369885

History

Received: 19 April 2023
Revision received: 2 August 2023
Revision received: 9 November 2023
Accepted: 19 December 2023
Published online: 19 February 2024
Published in print: August 01, 2024

Keywords

  1. Research design and methodology
  2. Underrepresented populations
  3. Patient perceptions
  4. Clinical trial
  5. Alcohol use disorder
  6. Veteran

Authors

Details

Lauren Rodriguez, Ph.D. [email protected]
Mental Illness Research, Education, and Clinical Center (MIRECC) (Rodriguez, Oslin), Center for Health Equity Research and Promotion (Brown, Lindsay), and Veterans Community Advisory Board (VCAB) (Brown, Lindsay), Corporal Michael J. Crescenz Medical Center, U.S. Department of Veterans Affairs (VA), Philadelphia; Center for Integrated Healthcare, Syracuse VA Medical Center, Syracuse, New York (Remmert); Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia (Oslin).
Kimberly M. Brown, Ph.D.
Mental Illness Research, Education, and Clinical Center (MIRECC) (Rodriguez, Oslin), Center for Health Equity Research and Promotion (Brown, Lindsay), and Veterans Community Advisory Board (VCAB) (Brown, Lindsay), Corporal Michael J. Crescenz Medical Center, U.S. Department of Veterans Affairs (VA), Philadelphia; Center for Integrated Healthcare, Syracuse VA Medical Center, Syracuse, New York (Remmert); Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia (Oslin).
Charles Lindsay
Mental Illness Research, Education, and Clinical Center (MIRECC) (Rodriguez, Oslin), Center for Health Equity Research and Promotion (Brown, Lindsay), and Veterans Community Advisory Board (VCAB) (Brown, Lindsay), Corporal Michael J. Crescenz Medical Center, U.S. Department of Veterans Affairs (VA), Philadelphia; Center for Integrated Healthcare, Syracuse VA Medical Center, Syracuse, New York (Remmert); Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia (Oslin).
Jocelyn E. Remmert, Ph.D.
Mental Illness Research, Education, and Clinical Center (MIRECC) (Rodriguez, Oslin), Center for Health Equity Research and Promotion (Brown, Lindsay), and Veterans Community Advisory Board (VCAB) (Brown, Lindsay), Corporal Michael J. Crescenz Medical Center, U.S. Department of Veterans Affairs (VA), Philadelphia; Center for Integrated Healthcare, Syracuse VA Medical Center, Syracuse, New York (Remmert); Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia (Oslin).
David W. Oslin, M.D.
Mental Illness Research, Education, and Clinical Center (MIRECC) (Rodriguez, Oslin), Center for Health Equity Research and Promotion (Brown, Lindsay), and Veterans Community Advisory Board (VCAB) (Brown, Lindsay), Corporal Michael J. Crescenz Medical Center, U.S. Department of Veterans Affairs (VA), Philadelphia; Center for Integrated Healthcare, Syracuse VA Medical Center, Syracuse, New York (Remmert); Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia (Oslin).

Notes

Send correspondence to Dr. Rodriguez ([email protected]).

Competing Interests

The authors report no financial relationships with commercial interests.

Funding Information

This study was supported by grant CX001507 from VA Clinical Science Research and Development awarded to Dr. David Oslin. Manuscript preparation was supported in part by the VA Office of Academic Affiliations Advanced Fellowship Program in Mental Illness Research and Treatment and the Corporal Michael J. Crescenz Veterans Integrated Services Network 4.The funding source had no other role in this research except for financial support for data collection. All claims expressed in this Open Forum are solely those of the authors and do not necessarily represent those of their affiliated organizations. The VCAB of the VA Center for Health Equity Research and Promotion provided feedback on materials during the active clinical trial and reviewed and critiqued the manuscript. The authors value veteran voices and worked to ensure such voices are reflected in this Open Forum.

Metrics & Citations

Metrics

Citations

Export Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format
Citation style
Style
Copy to clipboard

View Options

View options

PDF/EPUB

View PDF/EPUB

Login options

Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.

Personal login Institutional Login Open Athens login

Not a subscriber?

Subscribe Now / Learn More

PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.

Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).

Media

Figures

Other

Tables

Share

Share

Share article link

Share