E-Mental Health: A Rapid Review of the Literature
Abstract
Objective
The authors conducted a review of the literature on e-mental health, including its applications, strengths, limitations, and evidence base.
Methods
The rapid review approach, an emerging type of knowledge synthesis, was used in response to a request for information from policy makers. MEDLINE was searched from 2005 to 2010 by using relevant terms. The search was supplemented with a general Internet search and a search focused on key authors.
Results
A total of 115 documents were reviewed: 94% were peer-reviewed articles, and 51% described primary research. Most of the research (76%) originated in the United States, Australia, or the Netherlands. The review identified e-mental health applications addressing four areas of mental health service delivery: information provision; screening, assessment, and monitoring; intervention; and social support. Currently, applications are most frequently aimed at adults with depression or anxiety disorders. Some interventions have demonstrated effectiveness in early trials. Many believe that e-mental health has enormous potential to address the gap between the identified need for services and the limited capacity and resources to provide conventional treatment. Strengths of e-mental health initiatives noted in the literature include improved accessibility, reduced costs (although start-up and research and development costs are necessary), flexibility in terms of standardization and personalization, interactivity, and consumer engagement.
Conclusions
E-mental health applications are proliferating and hold promise to expand access to care. Further discussion and research are needed on how to effectively incorporate e-mental health into service systems and to apply it to diverse populations.
Innovations in information and communication technology (ICT) are transforming the landscape of health service delivery. This emerging field, often referred to as “e-health,” includes key features, such as electronic, efficient, enhancing quality, evidence based, empowering, encouraging, education, enabling, extending, ethics, and equity (1). E-health is a broader concept than telehealth (and telemedicine), which involves the use of ICT to connect patients and providers in real time across geographical distances (2) for the delivery of typical care and where the use of real-time video is the main modality (3).
Interest is also increasing in the application of ICT in mental health care. For example, the first international e-mental health summit was held in 2009 in Amsterdam, and a summit-specific issue of the Journal of Medical Internet Research was published (4). Christensen and colleagues (5) defined e-mental health as “mental health services and information delivered or enhanced through the Internet and related technologies.” However, there is no agreement on a field-specific definition. Some scholars consider e-mental health to include only initiatives delivered directly to mental health service users (6) and only on the Internet (6,7) (as opposed to, for example, delivery via stand-alone computers or video seminars). Others adopt a wider definition that includes frontline delivery activities related to screening, mental health promotion and prevention, provision of treatment, staff training, administrative support (for example, patient records), and research (4).
Because of the growth of the e-mental health field, it is difficult for policy makers and practitioners to stay abreast of available applications and the evidence for their effectiveness. In response to a request from a Canadian executive-level policy maker, we conducted a rapid review of the literature on e-mental health. In this article, we report briefly on the review methods and summarize key findings.
Methods
Rapid reviews are an emerging type of knowledge synthesis used to inform health-related policy decisions and discussions, especially when information needs are immediate (8–11). Rapid reviews streamline systematic review methods—for example, by focusing the literature search (8) while still aiming to produce valid conclusions. The requirements for the review, which was undertaken with a two-week deadline, were for a short (maximum eight pages) but in-depth synthesis of the current state of the science on the topic. The personnel available was one senior (doctoral-level) mental health services researcher (CEA). Later, a second (doctoral-level) mental health services researcher (SL) validated the conclusions by screening all titles and abstracts, extracting and synthesizing additional data, and reviewing the findings.
The overarching review question was: What is currently known on the topic of e-mental health? (Even though telepsychiatry is typically included in e-mental health definitions, we did not include this subtopic because its literature is already well developed with several systematic reviews and reviews of reviews.)
Several secondary questions were developed and refined as the review progressed: What types of e-mental health initiatives have been developed? What are the strengths and benefits of e-mental health? What are the concerns with and barriers to use of e-mental health? What is the state of the evidence for the effectiveness of e-mental health? How has e-mental health been integrated in service systems and policy?
The rapid review method used is similar to Khangura and colleagues’ (10) seven-step process. Briefly, the search focused on English, peer-reviewed full abstracts in MEDLINE from 2005 to 2010 and used the MESH terms mental disorders and internet and the following non-MESH key words: e-mental health, e-therapy, computer, computer-based therapy, computer-based treatment, web-based therapy, web-based treatment. We excluded search terms related to telehealth because that is a distinct, and well-established subset of the e-health field that mainly considers the use of telecommunications to connect service providers and patients across geographical distances (3) (as opposed to delivering automated, self-management interventions, for example). The search was run in MEDLINE because of time constraints and because it is the most widely searched database for health-related topics, has comprehensive coverage (more than 5,500 journals), and has substantial capture of the content of health services research and overlap with similar sources.
The initial search (December 2010) yielded 158 titles or abstracts. Similar keywords were also used in a brief on-line grey literature search, which retrieved additional relevant documents, such as a list of in-progress trials, a policy report, and recent conference proceedings. Two experts on e-mental health were also contacted by e-mail for comment on the appropriateness of the identified literature and additional articles. Final searches focused on the work of prominent authors (for example, Christensen, Hickie, and Titov). These searches yielded an additional 50 titles and abstracts, resulting in 208 titles and abstracts screened for duplicates and relevancy.
Further details on the rapid review method and our search and selection strategy are provided in an online data supplement to this article.
Results
General description of the literature
The screening process resulted in 115 documents, which were reviewed. Of these, 108 (94%) had been peer reviewed. Publication dates were from 2000 to 2010, with most (N=91, 79%) published between 2007 and 2010, which confirmed an expected increase in the volume of literature on the topic over time. Of the 115 documents, 59 (51%) reported primary empirical studies, of which 25 (42%) were conducted in the United States, 13 (22%) in Australia, and seven (12%) in the Netherlands.
Types of e-mental health initiatives
The review identified e-mental health applications addressing four areas of mental health service delivery: information provision (6,12); screening, assessment, and monitoring (13–20); intervention (21–24); and social support (25). Many applications addressed several areas of mental health service delivery concurrently (26–29). [A table listing examples of these e-mental health programs and initiatives is provided in the online data supplement. It summarizes information on the purpose of the application, the health conditions and populations targeted, and the components and technologies used.]
With respect to information provision, there is an identified need to ensure the quality of information about mental health. Therefore, tools such as the Brief DISCERN (13) have been developed to help users assess the quality of mental health–related content on Web sites.
Screening and assessment tools have been available for many years on stand-alone computers, but more recent developments are Internet-based screening tools to provide broader access to individuals for self-assessment (particularly to underserved or hard-to-reach groups) or for use by professionals in specific settings (for example, primary care) (30). For example, Diamond and colleagues (16) described an Internet-based behavioral health screening tool for adolescents and young adults in primary care. It requires minimal time to complete; addresses a broad spectrum of psychiatric symptoms, risk behaviors, and patient strengths; is automatically scored online; and allows results to be integrated into the patient’s electronic medical record and into system-level performance measurement.
Social support in e-mental health occurs through several types of Web-based formats, including discussion groups, bulletin boards, chat rooms, blogs, and social media. For example, Scharer (25) reported on a pilot study that examined the effectiveness of an online electronic bulletin board to provide social support to parents of children with mental illness. Parents made use of the bulletin board over a four-month period, actively posting messages to each other about their children’s illness or about the group.
E-mental health interventions were classified in our review by stage (promotion, prevention, early intervention, active treatment, maintenance, and relapse prevention), type of relationship (for example, between a professional and a consumer, between consumers, and between professionals), and treatment or therapy modality (for example, cognitive-behavioral therapy [CBT] and psychoeducation). Treatments identified were self-led or led by a therapist or were a combination (for example, self-led and therapist guided). Interventions were provided as the primary therapy or adjunct to conventional in-person therapy and were delivered to individuals or groups or both. For example, MoodGYM is an exemplary Web-based, interactive intervention that has been developed and evaluated in several randomized controlled trials (27,31–33). Its purpose is to enhance coping skills in relation to depression, and it includes assessments, workbooks, games, online exercises, and feedback. MoodGYM is freely available to the public and has been translated into several languages.
Most of the interventions studied were situated on a specific point of the continuum of care (for example, prevention, mental health promotion, or intervention) and used a single format; however, a few incorporated several types of approaches. For example, Tillfors and colleagues (34) investigated whether an Internet-delivered self-help intervention in conjunction with minimal e-mail contact was as effective as adding in-person group sessions to the Internet intervention. They found that adding in-person group sessions did not result in significant differences in outcomes.
Typically, e-mental health interventions mimicked traditional treatment approaches in that they often addressed single disorders; none were designed for individuals with comorbid mental and substances use disorders. The most frequent disorders addressed by the 59 empirical studies were depression or anxiety (18 studies, 31%). Several interventions focused on mental health promotion or prevention, including early identification (eight studies, 14%). Most interventions were developed specifically for adults (40 studies, 68%), followed by interventions targeting adolescents or young adults (11 studies, 19%). Recent e-mental health initiatives reflect the shift in the mid-2000s to Web 2.0 technologies (that is, more interactive, multimedia, and user-driven technologies) (35).
Strengths and benefits
Many authors believe that e-mental health has enormous potential to address the gap between the identified need for mental health services in the population and the limited capacity and resources to provide conventional treatment services (13,30). Strengths of e-mental health initiatives noted in the literature include improved accessibility, reduced costs (although start-up and research and development costs are necessary), flexibility in terms of standardization and personalization, interactivity, and consumer engagement (5,30,34–38). E-health technologies are considered to be particularly promising for rural and remote populations. They are also promising for subpopulations that have other barriers to access (attitudinal, financial, or temporal) or that avoid treatment because of stigma. For example, by using Internet-based social support, individuals can share their perspectives freely while preserving their anonymity. Further details and examples of benefits are summarized in a box on the next page.
Concerns and barriers
Some concerns and barriers are associated with using e-mental health. There are concerns that e-mental health will replace important and needed conventional services; divert attention away from improvements to or funding for conventional services; and be costly to develop, deploy, and evaluate (5). Another issue raised in the literature is related to the financial interests of developers and researchers, which may produce a risk of publication bias (39). Others have highlighted the limited evidence base for interventions, lack of quality control and care standards, and slow uptake by or reluctance among health care professionals (39,40). Some question the ability of professionals to establish therapeutic relationships on line and the feasibility of online treatment for certain population groups (for example, patients with severe depression) (39). Emmelkamp (39) described “technological phobia,” whereby professionals may be unfamiliar with technology and anxious about its use in professional care. Concerns have also been expressed about the potential to further marginalize individuals who have physical, financial, or cognitive barriers in terms of access to conventional services. Finally, some are concerned that the availability of e-mental health services may lead some individuals to postpone seeking needed conventional care or that some will receive inappropriate or harmful care when there is insufficient quality control over content (7).
Ethical and liability concerns have been cited. For example, when participants are from outside the regulatory jurisdiction, ethical responsibilities cannot be met; other concerns are that participants cannot be reliably identified and that privacy cannot be guaranteed for typed or recorded communications (5,34,37,38,41). To address these issues, several professional organizations (for example, the American Psychological Association) have developed guidelines (38), and an international organization to set standards has been established—the International Society for Mental Health Online. Even so, adherence has been found to be lacking, and concerns remain (7,39,42,43). At the same time, remedies for the above-mentioned concerns are emerging. Technology for the protection of security and confidentiality has improved, and some efforts are being made to review Web site content for quality (35,44,45). In Australia, a Web portal called Beacon has been set up that provides quality ratings for mental health Web sites and recommends evidence-based interventions (46).
Consumer engagement, reach, and response
A handful of recent studies have shed some light on the role of e-mental health providing prevention or intervention programming for particular groups of individuals, such as youths, socioeconomically diverse populations, rural and remote populations, the general public, and patients. One study investigated the preferences for e-mental health services in an online Australian sample (N=218) (47). Among individuals in the general population who were already using the Internet, a large majority (77%) expressed a preference for face-to-face services, but less than 10% indicated that they would not use e-mental health services. The authors highlighted the importance of raising public awareness, knowledge, and understanding about e-mental health services. More than 50% of the sample expressed the need to learn more about e-mental health services and about issues related to confidentiality.
More than 90% of youths now use the Internet, and it is seen as a promising medium for reaching that age group (28,48). In a large population-based sample of 2,000 young people aged 12 to 25 in Australia, 77% reported seeking information about mental health problems whether or not they had the problem themselves (49). In another study among military personnel, who are predominantly younger males, one-third of 352 respondents who reported that they were not willing to talk to a counselor in person indicated that they would be willing to use technology to address their concerns (50).
Preliminary research has also indicated that mental health service users value the use of e-mental health. A qualitative study of 36 participants found that their primary motive for Internet use was to access social support and their secondary motive was for information (51). Respondents noted that hearing about other individuals’ experiences helped them to feel less isolated and more hopeful. Respondents also liked the convenience, privacy, and anonymity of the Internet. On the other hand, several authors have documented low access to and use of the Internet among persons with more serious mental illnesses, such as those with co-occurring substance use and serious mental illness (52,53). Cost, lack of training, and impairment (in cognition, concentration, executive function, and motor control) can present barriers for individuals with serious mental illness, further disenfranchising them from services (54). However, evidence is emerging that with a user-friendly interface, high levels of engagement and positive outcomes can be obtained in online interventions for individuals with serious mental illnesses such as schizophrenia and their families (26). Nonetheless, access to and attitudes toward technology, as well as socioeconomic factors, need to be taken into account in planning Internet-based interventions for specific population groups (55).
| Improved accessibility |
|---|
| For geographically hard-to-reach populations |
| For populations with other types of barriers, such as lack of child care, transportation, insurance coverage, and time off work |
| For populations desiring anonymity or persons who feel stigma or who are dissatisfied with conventional services |
| From multiple locations, such as schools, workplaces, clinics, and hospitals |
| In terms of convenience and timing; for example, can be available at any time of day and in private, and the user can control the pace |
| Reduced costs |
| In terms of operating cost (although start-up and research and development costs are necessary) |
| In relation to reaching large numbers simultaneously (for example, can be broad scale or stand alone) |
| In terms of therapist time optimization and communication efficiencies |
| Flexibility in terms of standardization and personalization |
| Can be implemented with high fidelity and also tailored to individual needs |
| Can be developed according to the best research and design evidence |
| Can be designed for virtually any mental health issue or topic |
| Interactivity and consumer engagement |
| Through incorporation of multimedia |
| Through consumer empowerment |
| Can improve continuity of care (for example, can be integrated within a set of services across the service continuum) |
Evidence base for e-mental health
Although evaluation of some interventions is limited, an encouraging amount of rigorous research is available, depending on the developmental stage of the intervention. Research on Web-based interventions has both opportunities and challenges. Studies are relatively inexpensive to conduct, and large samples can be used. Interventions are easily standardized, randomized or controlled designs are feasible (often with wait list controls), and data are easily collected. Challenges include low rates of completion because of the relative ease with which participants can drop out of studies. In addition, it is difficult to study both the intervention and the mode of delivery; contamination of the control group is possible because participants can access similar services elsewhere on the Web; the ability to conduct double-blind studies is limited; and biases related to using self-report measures are a problem (56–58). Increasingly, resources for optimizing practice and evaluation are available; for example, guidelines for program design and for study methods have been published (36,59).
In the past five years, several reviews, including systematic reviews and meta-analyses of randomized controlled trials, have documented the progress made; effectiveness has been demonstrated in particular for interventions (both therapist assisted and self-directed) addressing depression and anxiety disorders (57,59,60). For example, a systematic review of meta-analyses of the efficacy of Internet-based self-help for depression and anxiety disorders reported that these interventions are effective and that effect sizes are comparable to those observed in similar interventions delivered in person (60). Systematic reviews of Internet-based CBT interventions (prevention and treatment) for anxiety and depression among adults have found that they are as effective as or more effective than treatment as usual (57). Preliminary evidence has also been reported for the effectiveness of Internet-based interventions to address issues such as stress, insomnia, and substance abuse (61). There are still some interventions for which evidence is weak or contrary, such as one CBT-based program for individuals with obsessive-compulsive disorder (62), and not all studies evaluating the effectiveness of Internet-based interventions for depression and anxiety have found positive results (62,63). Lower effect sizes have generally been found for interventions targeting alcohol and smoking cessation compared with those for anxiety and depression (61). There are some indications that programs work best for individuals with mild to moderate disorders; however, this group has been the focus of most research. Despite the popularity of online support groups, concerns about the encouragement of maladaptive behaviors, or support for continuing such behaviors, have surfaced—for example, in a recent survey of members of an eating disorders forum (64).
Systematic reviews are also beginning to appear that address e-health interventions for children and youths. For example, Stinson and colleagues (65) found that symptoms improved in seven of nine identified self-management interventions. A recent narrative review of Internet-based prevention and treatment programs for anxiety and depression among children and adolescents concluded that there was early support for effectiveness but a need for more rigorous research as well as interventions specifically targeting children (66). Recent innovations, such as those that embed prevention and early-intervention content in online games, need more evaluation. A study of one such program found a nonsignificant worsening effect on support seeking, avoidance, and resilience outcomes, especially among males (29). An interactive fantasy gaming approach has also been developed by Sally Merry, M.D., of Auckland, New Zealand (personal communication, Merry S, Dec. 2010). A recently published randomized controlled trial demonstrated its effectiveness among adolescents seeking help for depression in primary care settings (67).
In the area of substance use and abuse, a systematic review of Internet-based interventions for young people found small positive effects for programs aimed at alcohol abuse; the effects were of similar magnitude to those of brief in-person interventions, but the Internet-based interventions had the advantage of much broader delivery (68). However, programs aimed at preventing subsequent development of alcohol-related problems among those who were nondrinkers at baseline were generally not effective.
More research is needed on individual or subgroup predictors of differential outcomes of e-mental health interventions (21,69). Moreover, even though there is some preliminary evidence supporting the lower cost of using e-mental health approaches, true cost-effectiveness studies are just beginning to appear in the literature (70).
E-mental health, systems, and policy
Most of the literature reviewed described the development, implementation, and evaluation of single interventions in isolation. One very important question that has been given limited attention is how e-mental health interventions might best be situated in relation to an array of related services for a broad population. In a rare exception, van Straten and colleagues (71) discussed a stepped-care approach for depression in primary care wherein interventions advance from watchful waiting through self-guided but supported intervention (including Web-based formats), brief face-to-face psychotherapy, and finally longer-term face-to-face psychotherapy with consideration of antidepressant medication. To ensure continuity of care, a care manager monitors patient status at all levels and makes decisions about necessary transitions. Treatments at all levels are evidence based. These authors described trials of two different e-mental health interventions, including one for younger adults, and most important, how they fit within the full stepped-care model. Data on cost-effectiveness of the full model are unavailable, but the authors suggested that the incidence of new cases of depression and anxiety could be halved by introducing this model.
Andrews and Titov (72) described the promotion of Internet-based treatment programs (a virtual clinic) connected to a hospital in Sydney, Australia. The programs are considered to be cost-effective alternatives to medication or face-to-face CBT treatment. Programs are offered for major depression, social phobia, panic disorder, and generalized anxiety disorder. Programs are available free or at very low cost directly to the public; general practitioners and other mental health professionals can use these programs in addition to or instead of conventional care. Trial results show high levels of patient adherence and strong reductions in symptoms with very little investment of clinician time. The authors discuss how e-mental health programs might fit in a broader health service delivery context (for example, in U.S. health maintenance organizations, health care trusts in the United Kingdom, and regional health authorities in Canada). They suggest that the programs could be the first level of treatment for the proportion of the population that desires Internet-based treatment; however, with the support of a small team, individuals who need more support could be identified and referred for more intensive intervention.
An approach that reaches out to the total population but that is not fully connected to conventional services has been described by Bennett and colleagues (27). At its center is “e-hub,” which is an online self-help mental health service available free to the public. The service provides automated Web interventions for several needs, such as symptoms of depression, anxiety, and social anxiety, and an online bulletin board. Programs focus on the prevention and early-intervention end of the spectrum. There is no therapist involvement in the interventions, and the bulletin board is moderated by trained consumers under the supervision of a clinical psychologist. Interested individuals can contact the e-hub by e-mail. The organizers report a high volume of use by individuals with and without mental disorders, some over a lengthy period. The service is considered most suitable for those who prefer to receive help anonymously, prefer self-help, or reside in rural or remote areas. Quality control processes are included.
No peer-reviewed articles had a central focus on policy-level discussions about e-mental health. However, the gray literature search yielded one major report on the topic from Australia, E-Mental Health in Australia: Implications of the Internet and Related Technologies for Policy (5). Although the report was published in 2004, much of the content is relevant for other countries, because many are only at the beginning stages of e-mental health implementation. The report describes the advantages of e-mental health initiatives and barriers to implementation (as described above). Five major recommendations for moving forward are included related to access, ethical issues, quality and effectiveness, technology, and funding.
Discussion
The purpose of this rapid review was to synthesize and describe what is currently known on the topic of e-mental health. On the basis of the findings, several considerations for future research and practice in the field of e-mental health are evident. First, it is important to consider the fit of e-mental health initiatives within the context of the existing service system and to ensure that they complement—and not detract from—needs for direct care. Second, it is important to select interventions and initiatives on the basis of available evidence regarding both design features and effectiveness and to build research and evaluation into any new initiatives. Third, it is important to consider the needs of the population as well as the greatest potential for benefit when choosing or investing in e-mental health initiatives—for example, the intervention’s suitability for a diverse group of participants (in age, ethnocultural status, literacy, and disability) should be considered. Fourth, it is important to ensure that ethical and quality issues are addressed. Fifth, the extent to which interventions have or can be applied in cross-cultural and international contexts is an important consideration. Sixth, the involvement of consumers, as well as other relevant key stakeholder groups (such as families and caregivers, service providers, and policy makers), in the development and deployment of initiatives is paramount. Seventh, further research is needed in relation to conditions other than common disorders, such as psychotic disorders. Eighth, more rigorously conducted research is needed, such as randomized controlled trials, and it is important to understand which groups of individuals will benefit the most from such interventions and to take into account cross-cultural and international factors (for example, cultural adaptations).
It is important to acknowledge the limits of rapid review. They include focusing the search on one electronic database source (although we used the database that contains by far the largest number of health and medical journals). The search was also complemented by gray literature searches on the Internet, focused author searches, and brief key-informant consultations. A second limitation of our review is that only one author (CEA) initially screened the titles and abstracts from the total set of documents retrieved, although this author is knowledgeable about the content area and has experience conducting systematic reviews. However, the second author (SL) rescreened all extracted titles and abstracts from the total set. This rescreening uncovered additional nuances in various content areas, identified further studies for review, and provided the opportunity for incorporating more detailed information in this article (for example, technologies and components of e-mental health initiatives described in the online data supplement). Some minor errors in the initial review were also uncovered. Although the initial review was well received by its sponsors and was reported to inform key policy discussions, the effectiveness of rapid reviews in terms of their ultimate impact on health policy decisions and service outcomes remains to be systematically considered.
Conclusions
This rapid review identified a small but rich set of information on the topic of e-mental health, which was found to be highly useful for its specific intended policy discussion. The apparent promise and pitfalls of e-mental health and the increasing interest of policy makers in its potential for service system transformation indicate that careful monitoring of the evidence base is warranted.
Acknowledgments and disclosures
While conducting this review, Dr. Lal was partially supported by a postdoctoral fellowship from Knowledge Translation Canada. Dr. Adair conducted the initial review while under contract with the Mental Health Commission of Canada. The authors acknowledge Jayne Barker, Ph.D., and Janice Popp, M.S.W., for their assistance in refining the research questions to serve a policy purpose. The views expressed herein are solely those of the authors.
The authors report no competing interests.
Supplementary Material
Supplemental Material (24_ds001.pdf)
- View/Download
- 279.26 KB
References
1.
Eysenbach G: What is e-health? Journal of Medical Internet Research 3:E20, 2001
2.
Sood S, Mbarika V, Jugoo S, et al.: What is telemedicine? A collection of 104 peer-reviewed perspectives and theoretical underpinnings. Telemedicine and e-Health 13:573–590, 2007
3.
Wade VA, Karnon J, Elshaug AG, et al.: A systematic review of economic analyses of telehealth services using real time video communication. BMC Health Services Research 10:233, 2010
4.
Riper H, Andersson G, Christensen H, et al.: Theme issue on e-mental health: a growing field in Internet research. Journal of Medical Internet Research 12:e74, 2010
5.
Christensen H, Griffiths K, Evans K: E-Mental Health in Australia: Implications of the Internet and Related Technologies for Policy. Canberra, Commonwealth Department of Health and Ageing, 2002
6.
Lambousis E, Politis A, Markidis M, et al.: Development and use of online mental health services in Greece. Journal of Telemedicine and Telecare 8(suppl 2):51–52, 2002
7.
Ybarra ML, Eaton WW: Internet-based mental health interventions. Mental Health Services Research 7:75–87, 2005
8.
Watt A, Cameron A, Sturm L, et al.: Rapid reviews versus full systematic reviews: an inventory of current methods and practice in health technology assessment. International Journal of Technology Assessment in Health Care 24:133–139, 2008
9.
Ganann R, Ciliska D, Thomas H: Expediting systematic reviews: methods and implications of rapid reviews. Implementation Science 5:56, 2010
10.
Khangura S, Konnyu K, Cushman R, et al.: Evidence summaries: the evolution of a rapid review approach. Systematic Reviews 1:10, 2012
11.
Konnyu KJ, Kwok E, Skidmore B, et al.: The effectiveness and safety of emergency department short stay units: a rapid review. Open Medicine 6:e10–e16, 2012
12.
Santor DA, Poulin C, LeBlanc JC, et al.: Online health promotion, early identification of difficulties, and help seeking in young people. Journal of the American Academy of Child and Adolescent Psychiatry 46:50–59, 2007
13.
Khazaal Y, Chatton A, Cochand S, et al.: Brief DISCERN, six questions for the evaluation of evidence-based content of health-related Websites. Patient Education and Counseling 77:33–37, 2009
14.
Becker J, Fliege H, Kocalevent R-D, et al.: Functioning and validity of a Computerized Adaptive Test to measure anxiety (A-CAT). Depression and Anxiety 25:E182–E194, 2008
15.
Chinman M, Hassell J, Magnabosco J, et al.: The feasibility of computerized patient self-assessment at mental health clinics. Administration and Policy in Mental Health and Mental Health Services Research 34:401–409, 2007
16.
Diamond G, Levy S, Bevans KB, et al.: Development, validation, and utility of Internet-based, behavioral health screen for adolescents. Pediatrics 126:e163–e170, 2010
17.
Donker T, van Straten A, Marks I, et al.: A brief Web-based screening questionnaire for common mental disorders: development and validation. Journal of Medical Internet Research 11:e19, 2009
18.
Gringras P, Santosh P, Baird G: Development of an Internet-based real-time system for monitoring pharmacological interventions in children with neurodevelopmental and neuropsychiatric disorders. Child: Care, Health and Development 32:591–600, 2006
19.
Gualtieri CT: An Internet-based symptom questionnaire that is reliable, valid, and available to psychiatrists, neurologists, and psychologists. Medscape General Medicine 9:3, 2007
20.
Heron KE, Smyth JM: Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. British Journal of Health Psychology 15:1–39, 2010
21.
Spek V, Nyklícek I, Cuijpers P, et al.: Predictors of outcome of group and Internet-based cognitive behavior therapy. Journal of Affective Disorders 105:137–145, 2008
22.
Bergström J, Andersson G, Ljótsson B, et al.: Internet- versus group-administered cognitive behaviour therapy for panic disorder in a psychiatric setting: a randomised trial. BMC Psychiatry 10:54, 2010
23.
Khanna MS, Kendall PC: Computer-assisted cognitive behavioral therapy for child anxiety: results of a randomized clinical trial. Journal of Consulting and Clinical Psychology 78:737–745, 2010
24.
Khanna MS, Kendall PC: Computer-Assisted CBT for Child Anxiety: the Coping Cat CD-ROM. Cognitive and Behavioral Practice 15:159–165, 2008
25.
Scharer K: An Internet discussion board for parents of mentally ill young children. Journal of Child and Adolescent Psychiatric Nursing 18:17–25, 2005
26.
Rotondi AJ, Anderson CM, Haas GL, et al.: Web-based psychoeducational intervention for persons with schizophrenia and their supporters: one-year outcomes. Psychiatric Services 61:1099–1105, 2010
27.
Bennett K, Reynolds J, Christensen H, et al.: e-hub: an online self-help mental health service in the community. Journal of Medical Internet Research 192(suppl):S48–S52, 2010
28.
Burns JM, Durkin LA, Nicholas J: Mental health of young people in the United States: what role can the Internet play in reducing stigma and promoting help seeking? Journal of Adolescent Health 45:95–97, 2009
29.
Shandley K, Austin D, Klein B, et al.: An evaluation of “Reach Out Central”: an online gaming program for supporting the mental health of young people. Health Education Research 25:563–574, 2010
30.
Farrell SP, Mahone IH, Zerull LM, et al.: Electronic screening for mental health in rural primary care: implementation. Issues in Mental Health Nursing 30:165–173, 2009
31.
Christensen H, Griffiths KM, Jorm AF: Delivering interventions for depression by using the Internet: randomised controlled trial. British Medical Journal 328:265, 2004
32.
O’Kearney R, Gibson M, Christensen H, et al.: Effects of a cognitive-behavioural Internet program on depression, vulnerability to depression and stigma in adolescent males: a school-based controlled trial. Cognitive Behaviour Therapy 35:43–54, 2006
33.
Hickie IB, Davenport TA, Luscombe GM, et al.: Practitioner-supported delivery of Internet-based cognitive behaviour therapy: evaluation of the feasibility of conducting a cluster randomised trial. Medical Journal of Australia 192(suppl):S31–S35, 2010
34.
Tillfors M, Carlbring P, Furmark T, et al.: Treating university students with social phobia and public speaking fears: Internet delivered self-help with or without live group exposure sessions. Depression and Anxiety 25:708–717, 2008
35.
Ginn S: Evidence based mental health and Web 2.0. Evidence-Based Mental Health 13:69–72, 2010
36.
Coyle D, Doherty G, Matthews M, et al.: Computers in talk-based mental health interventions. Interacting with Computers 19:545–562, 2007
37.
Christensen H, Hickie IB: Using e-health applications to deliver new mental health services. Medical Journal of Australia 192(suppl):S53–S56, 2010
38.
Alleman JR: Online counseling: the Internet and mental health treatment. Psychotherapy 39:199–209, 2002
39.
Emmelkamp PM: Technological innovations in clinical assessment and psychotherapy. Psychotherapy and Psychosomatics 74:336–343, 2005
40.
Christensen H, Griffiths K: The internet and mental health practice. Evidence-Based Mental Health 6:66–69, 2003
41.
Perecherla S: Web matters. Evidence-Based Mental Health 12:4–6, 2009
42.
Humphreys K, Winzelberg A, Klaw E: Psychologists’ ethical responsibilities in Internet-based groups: issues, strategies, and a call for dialogue. Professional Psychology, Research and Practice 31:493–496, 2000
43.
Recupero P, Rainey SE: Forensic aspects of e-therapy. Journal of Psychiatric Practice 11:405–410, 2005
44.
Taylor C, Luce K: Computer- and Internet-based psychotherapy interventions. Current Directions in Psychological Science 12:18–22, 2003
45.
Christensen H, Hickie IB: E-mental health: a new era in delivery of mental health services. Medical Journal of Australia 192(suppl):S2–S3, 2010
46.
Santhiveeran J: Compliance of social work e-therapy websites to the NASW Code of Ethics. Social Work in Health Care 48:1–13, 2009
47.
Klein B, Cook S: Preferences for e-mental health services amongst an online Australian sample. Electronic Journal of Applied Psychology 6:27–38, 2010
48.
Horgan A, Sweeney J: Young students’ use of the Internet for mental health information and support. Journal of Psychiatric and Mental Health Nursing 17:117–123, 2010
49.
Burns JM, Davenport TA, Durkin LA, et al.: The Internet as a setting for mental health service utilisation by young people. Journal of Medical Internet Research 192(suppl):S22–S26, 2010
50.
Wilson JA, Onorati K, Mishkind M, et al.: Soldier attitudes about technology-based approaches to mental health care. Cyberpsychology and Behavior 11:767–769, 2008
51.
Powell J, Clarke A: Investigating Internet use by mental health service users: interview study. Studies in Health Technology and Informatics 129:1112–1116, 2007
52.
Borzekowski DLG, Leith J, Medoff DR, et al.: Use of the Internet and other media for health information among clinic outpatients with serious mental illness. Psychiatric Services 60:1265–1268, 2009
53.
Clayton S, Borzekowski D, Himelhoch S, et al.: Media and internet ownership and use among mental health outpatients with serious mental illness. American Journal of Drug and Alcohol Abuse 35:364–367, 2009
54.
Nicholson JRA, Rotondi AJ: The Internet, health promotion, and community participation. Psychiatric Services 61:96–97, 2010
55.
Yellowlees P, Marks S, Hilty D, et al.: Using e-health to enable culturally appropriate mental healthcare in rural areas. Telemedicine Journal and e-Health 14:486–492, 2008
56.
Eysenbach G: Issues in evaluating health websites in an Internet-based randomized controlled trial. Journal of Medical Internet Research 4:E17, 2002
57.
Kaltenthaler E, Parry G, Beverley C, et al.: Computerised cognitive-behavioural therapy for depression: systematic review. British Journal of Psychiatry 193:181–184, 2008
58.
Christensen H, Griffiths KM, Farrer L: Adherence in Internet interventions for anxiety and depression. Journal of Medical Internet Research 11:e13, 2009
59.
Smit F, Riper H: E-Mental Health: Presence and Future. Utrecht, Netherlands, Innovation Centre of Mental Health and Technology, 2010
60.
Van’t Hof E, Cuijpers P, Stein DJ: Self-help and Internet-guided interventions in depression and anxiety disorders: a systematic review of meta-analyses. CNS Spectrums 14(suppl 3):34–40, 2009
61.
Amstadter AB, Broman-Fulks J, Zinzow H, et al.: Internet-based interventions for traumatic stress-related mental health problems: a review and suggestion for future research. Clinical Psychology Review 29:410–420, 2009
62.
Computerised Cognitive Behaviour Therapy for Depression and Anxiety (review). London, National Institute for Health and Clinical Excellence, 2008
63.
Griffiths KM, Farrer L, Christensen H: The efficacy of Internet interventions for depression and anxiety disorders: a review of randomised controlled trials. Medical Journal of Australia 192(suppl):S4–S11, 2010
64.
Ransom DC, La Guardia JG, Woody EZ, et al.: Interpersonal interactions on online forums addressing eating concerns. International Journal of Eating Disorders 43:161–170, 2010
65.
Stinson J, Wilson R, Gill N, et al.: A systematic review of Internet-based self-management interventions for youth with health conditions. Journal of Pediatric Psychology 34:495–510, 2009
66.
Calear AL, Christensen H: Review of Internet-based prevention and treatment programs for anxiety and depression in children and adolescents. Medical Journal of Australia 192(suppl):S12–S14, 2010
67.
Merry SN, Stasiak K, Shepherd M, et al.: The effectiveness of SPARX, a computerised self help intervention for adolescents seeking help for depression: randomised controlled non-inferiority trial. British Medical Journal 344:e2598, 2012
68.
Tait RJ, Christensen H: Internet-based interventions for young people with problematic substance use: a systematic review. Medical Journal of Australia 192(suppl):S15–S21, 2010
69.
Postel M, De Haan H, De Jong C: E-therapy for mental health problems: a systematic review. Telemedicine and e-Health 14:707–714, 2008
70.
Woolderink M, Smit F, van der Zanden R, et al.: Design of an Internet-based health economic evaluation of a preventive group-intervention for children of parents with mental illness or substance use disorders. BMC Public Health 10:470, 2010
71.
van Straten A, Seekles W, Beekman ATF, et al.: Stepped care for depression in primary care: what should be offered and how? Medical Journal of Australia 192(suppl 11):S36–S39, 2010
72.
Andrews G, Titov N: Is Internet treatment for depressive and anxiety disorders ready for prime time? Medical Journal of Australia 192(suppl):S45–S47, 2010
73.
Barnes DE, Yaffe K, Belfor N, et al.: Computer-based cognitive training for mild cognitive impairment: results from a pilot randomized, controlled trial. Alzheimer Disease and Associated Disorders 23:205–210, 2009
74.
Swanton R, Collin P, Burns J, et al.: Engaging, understanding and including young people in the provision of mental health services. International Journal of Adolescent Medicine and Health 19:325–332, 2007
75.
Carroll KM, Ball SA, Martino S, et al.: Computer-assisted delivery of cognitive-behavioral therapy for addiction: a randomized trial of CBT4CBT. American Journal of Psychiatry 165:881–888, 2008
76.
Crilly J, Lewis J: Internet-based psychiatric interventions: applications for rural veterans at risk for suicide. Presented at the International Conference on Society and Information Technology, Orlando, Fla, April 6–9, 2010
77.
Cukrowicz KC, Smith PN, Hohmeister HC, et al.: The moderation of an early intervention program for anxiety and depression by specific psychological symptoms. Journal of Clinical Psychology 65:337–351, 2009
78.
Deegan PE, Rapp C, Holter M, et al.: A program to support shared decision making in an outpatient psychiatric medication clinic. Psychiatric Services 59:603–605, 2008
79.
Deegan PE: A Web application to support recovery and shared decision making in psychiatric medication clinics. Psychiatric Rehabilitation Journal 34:23–28, 2010
80.
Deitz DK, Cook RF, Billings DW, et al.: A Web-based mental health program: reaching parents at work. Journal of Pediatric Psychology 34:488–494, 2009
81.
Freeman E, Barker C, Pistrang N: Outcome of an online mutual support group for college students with psychological problems. Cyberpsychology and Behavior 11:591–593, 2008
82.
Golkaramnay V, Bauer S, Haug S, et al.: The exploration of the effectiveness of group therapy through an Internet chat as aftercare: a controlled naturalistic study. Psychotherapy and Psychosomatics 76:219–225, 2007
83.
Horgan D: Www.DoctorsHealth.com.au. Australian and New Zealand Journal of Psychiatry 42:173–174, 2008
84.
Clarke G, Eubanks D, Reid E, et al.: Overcoming Depression on the Internet (ODIN) (2): a randomized trial of a self-help depression skills program with reminders. Journal of Medical Internet Research 7:e16, 2005
85.
Matano RA, Koopman C, Wanat SF, et al.: A pilot study of an interactive Web site in the workplace for reducing alcohol consumption. Journal of Substance Abuse Treatment 32:71–80, 2007
86.
Kessler D, Lewis G, Kaur S, et al.: Therapist-delivered Internet psychotherapy for depression in primary care: a randomised controlled trial. Lancet 374:628–634, 2009
87.
Klein B, Richards J: A brief Internet-based treatment for panic disorder. Behavioural and Cognitive Psychotherapy 29:113–117, 2001
88.
Klein B, Mitchell J, Gilson K, et al.: A therapist-assisted Internet-based CBT intervention for posttraumatic stress disorder: preliminary results. Cognitive Behaviour Therapy 38:121–131, 2009
89.
Klinger E, Bouchard S, Légeron P, et al.: Virtual reality therapy versus cognitive behavior therapy for social phobia: a preliminary controlled study. Cyberpsychology and Behavior 8:76–88, 2005
90.
Lange A, Rietdijk D, Hudcovicova M, et al.: Interapy: a controlled randomized trial of the standardized treatment of posttraumatic stress through the Internet. Journal of Consulting and Clinical Psychology 71:901–909, 2003
91.
Lin C-C, Bai Y-M, Liu C-Y, et al.: Web-based tools can be used reliably to detect patients with major depressive disorder and subsyndromal depressive symptoms. BMC Psychiatry 7:12, 2007
92.
Linke S, Murray E, Butler C, et al.: Internet-based interactive health intervention for the promotion of sensible drinking: patterns of use and potential impact on members of the general public. Journal of Medical Internet Research 9:e10, 2007
93.
McCrone P, Knapp M, Proudfoot J, et al.: Cost-effectiveness of computerised cognitive-behavioural therapy for anxiety and depression in primary care: randomised controlled trial. British Journal of Psychiatry 185:55–62, 2004
94.
Perini S, Titov N, Andrews G: Clinician-assisted Internet-based treatment is effective for depression: randomized controlled trial. Australian and New Zealand Journal of Psychiatry 43:571–578, 2009
95.
Piasecki TM, Hufford MR, Solhan M, et al.: Assessing clients in their natural environments with electronic diaries: rationale, benefits, limitations, and barriers. Psychological Assessment 19:25–43, 2007
96.
Rabiner DL, Murray DW, Skinner AT, et al.: A randomized trial of two promising computer-based interventions for students with attention difficulties. Journal of Abnormal Child Psychology 38:131–142, 2010
97.
Ritterband LM, Thorndike FP, Gonder-Frederick LA, et al.: Efficacy of an Internet-based behavioral intervention for adults with insomnia. Archives of General Psychiatry 66:692–698, 2009
98.
Ruggiero KJ, Resnick HS, Acierno R, et al.: Internet-based intervention for mental health and substance use problems in disaster-affected populations: a pilot feasibility study. Behavior Therapy 37:190–205, 2006
99.
Spence SH, Holmes JM, March S, et al.: The feasibility and outcome of clinic plus Internet delivery of cognitive-behavior therapy for childhood anxiety. Journal of Consulting and Clinical Psychology 74:614–621, 2006
100.
Titov N, Andrews G, Johnston L, et al.: Shyness programme: longer term benefits, cost-effectiveness, and acceptability. Australian and New Zealand Journal of Psychiatry 43:36–44, 2009
101.
van Spijker BAJ, van Straten A, Kerkhof AJFM: The effectiveness of a Web-based self-help intervention to reduce suicidal thoughts: a randomized controlled trial. Trials 11:25, 2010
102.
Van Voorhees BW, Fogel J, Reinecke MA, et al.: Randomized clinical trial of an Internet-based depression prevention program for adolescents (Project CATCH-IT) in primary care: 12-week outcomes. Journal of Developmental and Behavioral Pediatrics 30:23–37, 2009
103.
Wims E, Titov N, Andrews G, et al.: Clinician-assisted Internet-based treatment is effective for panic: a randomized controlled trial. Australian and New Zealand Journal of Psychiatry 44:599–607, 2010
Information & Authors
Information
Published In
Cover: A ‘Bear’ Chance, by Philip Russell Goodwin, 1907. Oil on canvas. Minneapolis Institute of Arts, gift of the National Biscuit Company; the Bridgeman Art Library, New York.
History
Published in print: January 2014
Published online: 15 October 2014
Authors
Metrics & Citations
Metrics
Citations
Export Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
View Options
View options
PDF/EPUB
View PDF/EPUBLogin options
Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.
Personal login Institutional Login Open Athens loginNot a subscriber?
PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.
Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).