Although patients who have psychoses are treated primarily in the community, inpatient units play an important role in the treatment of patients who have severe psychotic disorders and suicidality (
1,
2). Several studies have demonstrated the importance of the treatment environment for inpatients with psychoses (
3,
4,
5,
6,
7,
8). The Ward Atmosphere Scale (WAS) is the most widely used instrument for capturing aspects of the treatment environment (
9).
The ward atmosphere may be experienced differently by different groups, giving the impression that patients and staff live in "different worlds," even though they share the same physical and social environment (
10,
11,
12,
13,
14). These differences in perception are important, because they directly challenge the common views that staff's perceptions of the ward atmosphere reflect those of inpatients (
15,
16) and that patients' and staff's WAS scores can be pooled (
17,
18).
Studies of differences between patient's and staff's perceptions of the treatment environment have had inconsistent results (
19,
20,
21,
22), probably because the studies have used individual WAS scores, whose reliability is unsatisfactory for most subscales (
23). In contrast, mean WAS scores have satisfactory reliability. However, to our knowledge, only two studies have examined differences between patient's and staff's scores at the ward level. Moos (
10) found that staff's scores were higher on all the WAS subscales except for the order and organization subscale, on which staff and patients had equal scores, and the staff control subscale, on which staff had lower scores. Friis (
24) replicated these findings, except that staff's scores were lower on the order and organization subscale in that study.
To better understand the different perspectives of patients and staff, it is important also to examine other aspects of the treatment climate, such as patient and staff satisfaction, and the work environment as perceived by staff. Patient satisfaction is considered to be a critical health care indicators (
25). The potentially stressful nature of a poor work environment is associated with reduced job satisfaction, absenteeism, somatic complaints, burnout, and depression among staff (
26,
27,
28,
29,
30).
However, only two studies have examined various aspects of staff's working conditions and patient satisfaction. Garman and colleagues (
31) found a significant positive relationship between staff burnout and patient satisfaction. Corrigan and associates (
32) found a strong relationship between different styles of team leadership and consumer satisfaction. To our knowledge, no previous studies have explicitly examined the relationship between the core dimensions of the working environment and patient satisfaction. We undertook such an investigation by including a short and user-friendly working-environment questionnaire comprising ten items—the Working Environment Scale-10 (WES-10). The WES-10 has been shown to measure the core dimensions of the work environment (
33).
Our main aim was to further examine the different perspectives of patients and staff. First, we wanted to examine whether we would obtain the same findings as those of Moos (
10) and Friis (
24), which showed that patients and staff perceive the ward atmosphere differently. Because many aspects of inpatient treatment have changed since the 1970s—for example, inpatient stays are shorter, and a higher percentage of patients have psychoses—these earlier findings need to be replicated in the current inpatient setting. Second, we wanted to examine the relationship between patient and staff satisfaction and the extent to which patient and staff satisfaction are related to WAS and WES-10 scores. We hypothesized that patient and staff satisfaction would be significantly correlated and that the working environment as perceived by staff would be significantly correlated with patient satisfaction. Furthermore, we hypothesized that WAS scores would be most strongly correlated with patient satisfaction and that WES-10 scores would be most strongly correlated with staff satisfaction.
Methods
During the period 1990 through 2000 a total of 640 staff members on 42 wards for psychotic patients completed the WAS and the WES-10. A total of 424 inpatients on the same wards completed the WAS during the same period. All data were collected within five days on each ward, and each ward was rated only once. All the psychiatric wards were part of the community hospital system in Norway. The chairman of the regional ethical committee approved the study.
Most of the wards were short-term wards (36 wards), but six intermediate and long-term wards were also included. We included wards only when more than two-thirds of the patients had diagnoses within the psychotic range. So that reliable means would be obtained for each ward, at least five patients had to complete the WAS. If fewer than five patients on a ward completed the questionnaires, that ward was excluded from the study. All staff members—physicians, psychologists, nurses, and aides—were included in the study. Night staff were excluded, however, because of difficulties in obtaining an acceptable number of completed questionnaires from the night staff. Each staff member was asked about his or her duration of employment on the psychiatric ward. Ninety-six staff members (15 percent) had been employed for less than six months, 141 (22 percent) between six months and 18 months, 128 (20 percent) between 18 months and three years, and 275 (43 percent) for more than three years.
Staff and patients participated in the study on a voluntary basis. Participants were asked to complete a modified version of the WAS for the ward as they experienced it, or a "real ward" WAS (WAS-R). The WAS-R is a self-report questionnaire containing 100 statements about the ward, each requiring a true or false answer. We used a revised version of the WAS-R comprising 80 items, as described previously (
23,
34). In addition, we modified the true-or-false format to a 4-point scale ranging from 0, totally disagree, to 3, totally agree.
The revised WAS comprised 11 subscales: involvement (a measure of how active and energetic patients are in the program), support (a measure of how much patients help and support each other and how supportive the staff are toward patients), spontaneous behavior (a measure of the level of open expression of feelings by patients and staff), autonomy (a measure of how self-sufficient and independent patients are in making their own decisions), practical orientation (a measure of the extent to which patients learn practical skills and are prepared for release from the program), personal problem orientation (a measure of the extent to which patients seek to understand their feelings and personal problems), angry and aggressive behavior (a measure of how much patients argue with other patients and staff, become openly angry, and display other aggressive behavior), order and organization (a measure of how important order and organization are in the program), program clarity (a measure of the extent to which patients know what to expect in their day-to-day routine and the explicitness of program rules and procedures), staff control (a measure of the extent to which the staff use procedures to keep patients under necessary controls), and staff's attitude toward expressed feelings (a measure of the extent to which staff encourage patients to express their feelings openly).
The WES-10 is also a self-report questionnaire. The staff rated the items on a 5-point scale ranging from 1, totally disagree, to 5, totally agree. The WES-10 measures four clinically meaningful subscales and has been examined in a previous study (
33). The four subscales are self-realization (a measure of the extent to which the staff members feel supported and whether they feel that they are able to use their knowledge working on the ward), workload (a measure of the number of tasks imposed on the staff members and the extent to which they feel that they should have been in several places at the same time), conflict (a measure of the extent to which the staff members experience conflicts and loyalty problems), and nervousness (a measure of the extent to which staff are worried about going to work and the extent to which they feel nervous or tense on the ward). The mean±SD scores for the four subscales were 3.64±.22 for self-realization, 3.42±.36 for workload, 2.06± .28 for conflict, and 1.99± .21 for nervousness.
Both patients and staff responded to three questions developed by Moos (
35) to capture general satisfaction: How satisfied are you with this ward?; How much do you like the patients on this ward?; and How much do you like the staff on this ward? The questions were rated on a 5-point scale ranging from 1, very unsatisfied, to 5, very satisfied. The staff members' mean±SD scores on these three questions were 4.03±.33 for question 1; 4.20±.20 for question 2; and 4.43±.21 for question 3. The patients' respective scores on the same questions were 3.74±.46, 3.82±.31, and 4.05±.43.
In a previous study (
23), we found that even if the internal consistency of the WAS subscales was doubtful at an individual level, it was satisfactory at the ward level. This finding is in accordance with the literature, which suggests that a Cronbach's alpha greater than .7 is satisfactory for individual comparisons and that a Cronbach's alpha greater than .5 is satisfactory for group comparisons (
36,
37). Consequently, the ward means were used in all the statistical analyses of the WAS subscales, the WES-10 subscales, and the three general satisfaction items. Because we had changed the original true-or-false rating scale (0 or 1) to a 4-point scale ranging from 0 to 3, we divided the sum of the item scores by 3. Because of the reduced number of items, we divided the sum score by the total number of items included and multiplied the resultant value by 10. This approach allowed us to compare the mean values obtained in this study with the mean values obtained in previous studies that used the original ten-item, 2-point scale. Consequently, the mean WAS subscale scores reported here range from 0 (low) to 10 (high).
Nonpaired t tests were used to analyze the differences between patients' and staff members' perceptions of the ward atmosphere. Correlations between the WAS subscales, WES-10 subscales, and general satisfaction items were calculated as Pearson product-moment coefficients. Data were analyzed by using the Statistical Package for the Social Sciences (version 11.0).
Results
As can be seen from
Table 1, the mean scores for staff were significantly higher than those for patients on nine of the 11 WAS subscales. No significant difference between groups was found on the order and organization subscale, whereas the staff scored significantly lower than the patients on the staff control subscale.
The subscale scores for patients and staff were moderately correlated. The strongest correlation was between autonomy scores (r=.58), and the weakest correlation was between spontaneous behavior scores (r=.27). The median intercorrelation coefficient was .41. No significant correlations were found between patients and staff on the three satisfaction items.
As can be seen from
Table 2, patients' WAS scores were strongly correlated with the three patient satisfaction items but not with the three staff satisfaction items.
Table 3 shows that the staff WAS scores were fairly strongly correlated with the three staff satisfaction items. The staff perceptions of involvement, personal problem orientation, and angry and aggressive behavior were also significantly correlated with the patients' general liking for the ward.
Tables 2 and
3 indicate that satisfaction was more strongly linked to perceived ward atmosphere for patients than for staff, probably because staff satisfaction is also strongly dependent on the work environment.
As can be seen from
Table 4, the work environment scores were strongly correlated with staff members' general liking of the ward, liking of patients, and liking of staff. In contrast, no significant relationship was found between the three patient satisfaction items and the work environment as perceived by staff.
Discussion and conclusions
Our finding that WAS scores were significantly higher among staff than among patients on nearly all WAS subscales is consistent with the findings of Moos (
10) and Friis (
24). Both our data and data from those studies suggest that staff tend to view the treatment environment more favorably than do patients. As pointed out by Main and colleagues (
38), staff's perceptions are expected to be higher on dimensions that represent positive aspects of their roles and lower in areas that could have negative implications. This expectation is consistent with our results, with the exception of the angry and aggressive behavior subscale scores. A low level of angry and aggressive behavior has been associated with a better treatment outcome and a higher level of patient satisfaction (
7,
39,
40,
41).
Our study showed no significant correlation between patient and staff satisfaction and no significant relationship between patient satisfaction and the work environment as perceived by staff. The main reason for the lack of correlation between patient and staff satisfaction may be that different aspects of the treatment environment are related to patient and staff satisfaction. Patient satisfaction was strongly correlated with patients' WAS scores and was moderately correlated with staff's WAS scores but was not correlated with WES-10 scores. In contrast, staff satisfaction was moderately correlated with staff's WAS and WES-10 scores but not with patients' WAS scores.
Consequently, it appears that the ward atmosphere is more important for patient satisfaction than for staff satisfaction. It is important to consider the different roles and viewpoints of patients and staff, each of whom are on the ward for different reasons. Most notable is that, unlike most of the patients, staff members can leave the ward after their shifts and may withdraw from the ward milieu if they experience it as too stressful. Thus the ward atmosphere is likely to be more important for patient satisfaction than for staff satisfaction.
Several studies have shown a significant relationship between the work environment and burnout among mental health workers (
26,
27,
28,
29,
30). Garman and associates (
31) found a significant relationship between burnout and patient satisfaction in inpatient and community programs that used psychosocial rehabilitation approaches. On the basis of the results of these studies, we expected to find a significant correlation between patient and staff satisfaction. The main reason for the contrary results in our study may be that we examined primarily short-term units. A shorter inpatient stay may give patients less access to different aspects of the treatment environment and may strengthen the impression that patients and staff live in "different worlds." This explanation is supported to some extent by the stronger correlation between patients' and staff's WAS scores in a sample from the 1970s (
42), when patients were admitted for a longer time than in our study. The average correlations between patients' and staff's WAS scores were .61 in the 1970s (
24) and .41 in our study.
It is possible that our study would have had different results if all patients and staff members had completed the questionnaires. We did not collect information about patients who did not complete the questionnaires. It is possible that the patients who refused or were unable to complete the questionnaires were the more severely disturbed patients. However, in a previous study (
8), perceptions of the ward atmosphere did not differ between the more severely disturbed patients and other patients. Moreover, an average of ten patients completed the questionnaires on each ward, which should have minimized any possible selection bias.
We used three questions to capture general satisfaction with the treatment climate. It could be argued that a more sophisticated instrument would have yielded different results. The reliability of these three items has not been examined. However, the use of ward means instead of individual scores increases the reliability of the satisfaction scores (
43).
Our study provides new information about the different perspectives of patients and staff on the treatment environment. The ward atmosphere seems to be most important for patient satisfaction, and staff tend to view the treatment environment more favorably than do patients. Our data suggest that patients' and staff's scores should be analyzed separately and not pooled to provide one single measurement of the treatment environment. Furthermore, our data suggest that the commonly held view that the working conditions of staff influence patient satisfaction and their perceptions of the treatment environment needs to be moderated.