Journal of Rehabilitation Research & Development (JRRD)

Quick Links

  • Health Programs
  • Protect your health
  • Learn more: A-Z Health
Veterans Crisis Line Badge
 

Volume 51 Number 1, 2014
   Pages 161 — 174

Health and well-being of homeless veterans participating in transitional and supported employment: Six-month outcomes

Meaghan Leddy, PhD;1–2* Elina Stefanovics, PhD;2 Robert Rosenheck, MD1–2

1Department of Veterans Affairs Connecticut Health Care System, West Haven, CT; 2Yale University School of Medicine, New Haven, CT

Abstract — Supported employment, specifically individual placement and support (IPS), improves competitive employment (CE) rates for individuals with serious mental illness, but has not shown greater improvement in non-vocational outcomes than other rehabilitation approaches. The Department of Veterans Affairs offers two types of vocational services, IPS and transitional work experience (TWE), but no study has compared the effectiveness of these approaches. This secondary analysis of data from a study of homeless veterans compared 6 mo improvement in diverse outcomes for five employment patterns: never worked, worked only in TWE, worked in TWE followed by CE, worked in CE without IPS, and worked in CE with IPS referral. Veterans referred to IPS were more likely to be competitively employed. Those who worked in CE (whether following TWE or with or without IPS referral) showed the greatest increase in days worked, employment income, and total income and the greatest decrease in public support income when compared with those who worked only in TWE or not at all. Veterans in TWE showed the greatest increase in residential treatment days, but there were no other differences in non-vocational outcomes between groups. There are multiple paths to CE, but few differences in non-vocational outcomes across employment experiences.

Key words: compensated work therapy, employment, homeless, individual placement and support, recovery, severe mental illness, substance use, supported employment, transitional work experience, veterans.

Abbreviations: ANCOVA = analysis of covariance, ASI = Addiction Severity Index, CE = competitive employment, CWT = compensated work therapy, DPA = diversified placement approach, IPS = individual placement and support, IRB = institutional review board, MCS = mental health composite score, PCS = physical health composite score, PTSD = posttraumatic stress disorder, SCL-30 = 33 items from Symptom Checklist 90, SE = supported employment, SF-12 = 12-Item Short Form Health Survey, SMI = severe mental illness, TEPS = therapeutic employment placement and support, TWE = transitional work experience, VA = Department of Veterans Affairs.
*Address all correspondence to Meaghan Leddy, PhD; Department of Veterans Affairs Connecticut Healthcare System, 950 Campbell Ave, Bldg 15, Rm 127, West Haven, CT 06516; 203-444-6191. Email: meaghan.leddy@yale.edu
http://dx.doi.org/10.1682/JRRD.2013.01.0011
INTRODUCTION

One of the most serious consequences of severe mental illness (SMI) is that it impedes participation in employment [1–3]. Diverse approaches have been used to facilitate employment for individuals diagnosed with SMI, including sheltered workshops, skills training, clubhouses, and supported employment (SE) [4]. Some of these programs specifically seek to foster competitive employment (CE) (i.e., jobs in the competitive economy that are open to all workers and pay standard wages) and some seek non-CE (i.e., protected jobs that are “owned” by programs that set their own, often reduced, wages and may be less demanding and more acceptable to clients) [5–7].

The Department of Veterans Affairs (VA) has offered therapeutic work programs through its compensated work therapy (CWT) program since the 1970s. Initially, veterans were offered employment opportunities in sheltered workshops, but more recently the program has emphasized transitional work experience (TWE) offering non-CE in both therapeutically managed VA [8] jobs and jobs with community employers [8–10]. In December 2003, as a result of new legislation [11], SE services following the individual placement and support (IPS) model began to be offered along with TWE within VA’s CWT programs.

Supported Employment

The IPS model of SE [12–16] emphasizes rapid job placement, competitive jobs, ongoing support without a time limit, client choice of jobs, integration of vocational support and clinical care, and openness to all who want to work [17]. Clinical trials have shown IPS to be associated with higher CE rates, shorter time to entering CE, greater numbers of hours worked per week, and more weeks worked per year among individuals diagnosed with SMI [13,16–26] and, most recently, among veterans with posttraumatic stress disorder (PTSD) [27]. The program is most effective when fidelity to the model is high [28–30].

In addition to employment-related outcomes, many researchers and program planners have hoped non-vocational outcomes would also improve through vocational programs. Those who obtain CE via IPS have been shown to have improved self-esteem, quality of life, social inclusion, and psychiatric symptoms [20,31–33], and improvements have been shown to be maintained during follow-up, for as many as 12 yr [7,34]. Although IPS has been associated with improvements in some non-vocational outcomes in observational outcome studies, these improvements have not been greater than those demonstrated by other rehabilitation programs when evaluated in randomized trials [33,35–38]. Several other studies that favored IPS with regard to vocational outcomes failed to find greater improvement in non-vocational outcomes [27,37].

Nor have advantages been found for IPS in studies that specifically evaluated psychiatric symptoms [39–42], quality of life [39,41–42], self-esteem [40], global functioning [40–42], relapses [41], coping [41], social support [42], or substance misuse [42]. When differences on non-vocational outcomes have been identified, they have been small [20] or possibly due to baseline differences and resultant regression to the mean [42]. Nevertheless, some suggest that IPS can positively affect non-vocational outcomes because of its association with increased rates of CE, which has been associated, in turn, with improved non-vocational outcomes [43].

Transitional Work Experience

When compared to traditional job placement services, VA’s TWE program has been associated with an increased likelihood of engaging in paid activity, a greater number of hours and weeks worked, and higher income [44]. Groups did not differ, however, in more specifically improving CE. In an earlier randomized trial, Kashner and colleagues demonstrated that when compared to no vocational intervention, TWE was associated with greater reductions in substance use, fewer periods of homelessness and incarceration, and less of a decline in physical health [9]. TWE has also been associated with decreased utilization of inpatient care and increased outpatient care for individuals with SMI or those who are dually diagnosed [45].

As of yet, there has been no direct comparison of IPS and TWE or of either with the sequence of CWT followed by CE on either vocational or non-vocational outcomes. However, VA TWE (i.e., non-CE) has been described [44] as similar to Koop and colleagues’ [46] diversified placement approach (DPA), which has been compared with IPS [47–48]. DPA has been associated with lower rates of CE, fewer total weeks of competitive work, and less income earned when compared with IPS. However, when only individuals who had obtained at least one job were examined, these differences were no longer significant and DPA had superior outcomes on total number of weeks of paid employment [47].

Current Study

This observational study is the first to compare vocational and non-vocational outcomes between VA’s TWE and IPS programs and for the sequence of TWE followed by CE. This is a secondary analysis of data from a previous VA demonstration program, the therapeutic employment placement and support (TEPS). The TEPS study demonstrated that for homeless veterans, many of whom had primary substance use disorders rather than SMI, IPS was associated with more days of CE and fewer days of homelessness than standard VA care, but showed no differences on other outcomes [49]. The original study compared IPS and treatment as usual in an intention-to-treat analysis, but because both cohorts in the demonstration had access to TWE services, the data set provides the opportunity to conduct an observational analysis in which data from the cohorts are combined and changes in employment and other outcomes from the time of program entry to 6 mo are compared under five employment conditions: (1) never worked, (2) worked only in TWE, (3) worked in TWE followed by CE (either with or without IPS), (4) worked only in CE without IPS, and (5) worked only in CE with IPS referral. Individuals who worked first in CE and then in TWE were excluded because of small numbers, as were those with incomplete follow-up data.

The comparison of IPS and TWE is of particular importance in the VA context given that TWE has a long history within VA and that IPS has been implemented only over the past decade. We hypothesized that improvement on non-vocational outcomes would be greater for all work conditions than not working at all, but that non-vocational outcomes would not differ among employment conditions.

METHODS

In January 2000, funds were allocated for nine VA medical centers to hire and train employment specialists to provide IPS services to homeless veterans with psychiatric or substance use disorders. Veterans were considered eligible if they met all three of the following criteria:

1.
Veteran was homeless and not receiving VA health services. Participants were considered to be homeless if they had slept in a shelter or on the street in the past 90 d.
2.
Veteran expressed interest in seeking CE. Veterans were deemed interested in CE if they answered in the affirmative when asked, “Are you interested in working for pay in the community—somewhere other than at the VA?”
3.
Veteran was diagnosed with a psychiatric disability and/or substance use problem.

Beginning on January 1, 2001, eligible veterans were recruited at each site before the implementation of IPS (cohort 1, n = 308) and were offered standard VA care (including TWE). They were subsequently assessed by an independent evaluation assistant every 3 mo for up to 2 yr. After the nine sites had hired and trained employment specialists (as described by Rosenheck and Mares [49]), a second group of homeless veterans, cohort 2 (n = 322), was recruited and offered both IPS and standard care (including TWE). They were assessed in the same way over the next 2 yr. No participants in cohort 1 participated in cohort 2. Follow-up data collection continued through March 2005.

Data were collected by independent, trained research assistants, and efforts were made to collect outcome data in the original study on all veterans regardless of the VA rehabilitation services they were receiving. Veterans gave written informed consent to participate in the study and for employment specialists to communicate with employers. Participants received $10.00 for each interview they completed. Original institutional review board (IRB) approval was obtained at the authors’ parent institution and at each of the nine participating VA facilities. Overall follow-up rates across all time points averaged 70 percent (n = 1,730 interviews) for cohort 1 and 72 percent (n = 1,858 interviews) for cohort 2.

In the present study, data from the two cohorts were combined and changes in employment and other outcomes from the time of program entry to 6 mo follow-up were compared among homeless veterans (n = 440) in five groups defined by their patterns of employment during the first 6 mo of program participation: not working at any time, working only in TWE, working in TWE followed by CE, working only in CE before IPS was available, and working only in CE after IPS was available (Figure). Individuals who worked in other patterns (n = 14) or who had missing data from the first or second follow-up assessments were excluded (n = 176). The analysis was limited to the first 6 mo of program participation to limit both the amount of missing follow-up data and the potential number of combinations and permutations of work experiences (Figure).


Figure 1. Employment conditions examined over 6 mo in this study. IPS = individual placement and support.

Figure 1.

Employment conditions examined over 6 mo in this study. IPS = individual placement and support.

Click Image to Enlarge. View as PowerPoint Slide

Measures
Employment Status

Employment was assessed by three measures representing the number of days in the past 30 of (1) CE, (2) non-CE (e.g., TWE in VA’s CWT program), (3) casual or volunteer work, and (4) any type of employment (i.e., the sum of the previous three measures). Employment data were based on client interviews.

Health Status

Diagnoses were based on clinical assessments by homeless outreach staff. Subjective distress was measured with 33 items from the Symptom Checklist 90 (SCL-30) (range 0–4) [50]. Alcohol and substance use problems were assessed by using composite scores from the Addiction Severity Index (ASI) (range 0–1) [51]. The 12-item Short Form Health Survey (SF-12) [52] was used to assess mental (mental health composite score [MCS]) and physical health status (physical health composite score [PCS]) (range = standardized scores × 10).

Community Adjustment and Housing Status

Housing status was measured by questions concerning sleeping arrangements during the previous 90 d in each of 12 types of places and used to calculate days of independent housing (whether in their own place or with others), days homeless, and days in institutions (hospitals or time-limited transitional residences).

Attitudes Toward Employment, Self-Esteem, and Quality of Life

Attitudes toward work were assessed using a 21-item measure used in the Social Security Administration’s Project NetWork [53]. A factor analysis of these 21 items (varimax rotation) produced a 5-component measure reflecting attitudes toward work that can be summarized as “I can’t work,” “I want to work,” “Work helps me cope with problems,” “I don’t like the jobs I get,” and “Others expect me to work” [54]. Self-esteem was assessed with the Rosenberg Self-Esteem measure [55], and quality of life was measured by the single summary item in the Lehman Quality of Life Interview [56].

Analysis

For the current study, both cohorts were combined to create one sample (n = 588). Six-month follow-up data were available for 440 veterans who fit into one of the five work patterns previously described.

First, baseline sociodemographic variables and clinical characteristics that were significantly different (at p < 0.05) across employment patterns were identified because they could potentially confound outcome analysis (Tables 12). These variables were included as covariates to adjust for potentially confounding baseline characteristics in the subsequent analysis of covariance (ANCOVA) of 6 mo changes in outcome measures from the time of program entry across the five work patterns. ANCOVAs of change also controlled for the baseline value of the dependent variable in each. Least square (adjusted) means were compared between pairs of conditions if the overall difference across work patterns was significant at p < 0.01, selected as the alpha level to adjust for multiple comparisons across many (often related) outcomes.

VA TWE programs are often linked with transitional residences, domiciliaries, and other VA residential programs, and preliminary analysis confirmed that veterans in the TWE-only group spent substantially more days residing in institutional settings than the other groups. To adjust for this potentially confounding variable, the number of days in VA residential or inpatient treatment was also included as a covariate in the ANCOVAs of nonhousing outcomes (i.e., this variable was not used as a covariate when comparing groups on housing outcomes). The significance level for paired comparisons was also set at p < 0.01 because of the multiple planned comparisons. Data management and statistical analysis was performed by using SAS® version 9.2 (SAS Institute; Cary, North Carolina).

RESULTS

The initial bivariate analyses identified baseline measures that were significantly associated with the employment classification (Tables 12). Significant differences were observed in a limited number of variables including marital status, application for or receipt of VA or non-VA disability benefits, PTSD diagnosis, age, days homeless, baseline days of employment, self-esteem, and two measures of psychiatric symptoms. The strongest effects (p < 0.01) showed veterans who worked were less interested in applying for disability at baseline, less likely to have a diagnosis of PTSD, were younger, had higher self-esteem, were working more days at the time of program entry, and had lower psychiatric symptom scores.


Table 1. 
No Work
(
n = 100)
TWE Only
(
n = 96)
p-Value
CE = competitive employment, df = degrees of freedom, IPS = individual placement and support, PTSD = posttraumatic stress disorder, TWE = transitional work experience, VA = Department of Veterans Affairs.

Table 2. 
p-Value
No Work (1) (n = 100)

It is notable, first of all, that there were highly significant differences in the work patterns before and after IPS became available (χ2 (3) = 45.0, p < 0.001). In cohort 1, 30.7 percent worked in CE, as compared with 62.2 percent in cohort 2 (when IPS was available); 9.0 percent worked in TWE and then CE in cohort 1, as compared with 5.2 percent in cohort 2; 32.3 percent worked only in TWE in cohort 1, as compared with 13.9 percent in cohort 2; and 28.0 percent did not work at all, as compared with 18.7 percent in cohort 2. Thus, 39.7 percent worked in CE at some time during the first 6 mo of cohort 1, as compared with 67.3 percent in cohort 2.

Employment-Related Outcomes

When looking at change in the number of days worked from baseline to 6 mo follow-up, those in TWE only had a significantly smaller increase in days worked than the other three groups that were employed at all (all p < 0.001) (Table 3). Not surprisingly, by definition, those who had not worked in the previous 6 mo had a significantly poorer outcome on days worked compared with all other groups (all p < 0.001).

Those who had gained work through TWE only had increases in public support income, which was significantly different from those in CE with IPS referral, who had relative reductions in public support income (p = 0.009). Those in the no work group also showed increased receipt of public support income, which was significantly different from the TWE then CE (p = 0.002), CE without IPS (p = 0.0002), and CE with IPS referral (p < 0.001) groups, who showed reduced public assistance income. Those in no work did not differ from TWE only in this regard (p = 0.14).

Veterans who had had any CE (TWE then CE, CE without IPS, or CE with IPS referral) during the 6 mo period had superior outcomes in work-related income (all p < 0.004) and total income (all p < 0.001) when compared with those who had only worked TWE or those who had not worked at all. Again, the TWE only and no work groups did not differ.

Housing-Related Outcomes

As expected, the TWE only group showed a far greater increase in days living in institutions (domiciliaries, transitional residences, or hospitals) than did those who worked through IPS (p < 0. 001) and those who did not work (p < 0.001; Table 3). The no work group showed a significantly smaller decline in days living with others than CE with IPS referral (p = 0.004) and CE without IPS (p < 0.008), but there were no differences in days homeless or days living independently in one’s own place.


Table 3. 
p-Value
Health, Wellness, Self-Esteem, and Quality of Life

There were no significant differences between the five groups with regard to clinical outcomes as measured by the ASI-Alcohol, ASI-Drug, or ASI-Psych, the SCL-30, SF-12 MCS or PCS, quality of life, self-esteem, or social support measures.

Employment Attitude Changes

There was only one significant difference with regard to changes in positive work attitudes or beliefs about work. With regard to the belief “I want to work,” the No Work group had a significantly larger decline in this attitude than did CE without IPS (p < 0.001).

DISCUSSION

This secondary analysis compared the magnitude of 6 mo change in vocational and non-vocational outcomes associated with five employment patterns: not working, working only in TWE, working in TWE followed by CE (either with or without IPS referral), CE without IPS, and CE with IPS referral. IPS was associated with increased rates of achieving CE (39% in cohort 1 vs 67% in cohort 2), which has been robustly demonstrated in the literature on people with SMI [16–19]. However, IPS was not associated with universally superior outcomes on other employment-related variables when compared with other competitive work patterns (i.e., TWE then CE or CE without IPS). These results are similar to other studies that have found that IPS influences achievement of CE, but does not necessarily improve employment of any kind or employment income more than other approaches [47].

Not surprisingly, having had any CE, regardless of how it was achieved, was associated with better employment-related outcomes than non-CE or no employment. For example, having had any CE was associated with greater number of days worked and greater increases in total and work income than TWE or no work. Reciprocally, public support income increased most among those who did not work or who worked in TWE, though those receiving public support payments may have less incentive to work or may fear it could lead to reduction or loss of public support income [7,57–59].

Benefits did not extend beyond work and financial domains. There were relatively few differences between the five groups with regard to health, wellness, quality of life, self-esteem, and housing outcomes. This corroborates previous reports that the benefits of vocational services are limited to vocational outcomes [33,35–38].

Of particular interest was the comparison of TWE and IPS, given that VA currently offers both these vocational services (although, in contrast to the study described here, IPS in VA is limited to those with SMI). There were baseline differences between those who enrolled in TWE only and those who achieved CE with referral to IPS. For example, individuals in the CE with IPS referral group were younger, had less severe mental health symptoms, reported less subjective distress, had been homeless for fewer days, had higher levels of self-esteem, and less strongly held the belief “I can’t work” than others.

When adjustment was made for these baseline differences at 6 mo follow-up, IPS was superior to TWE with regard to all employment and financial outcomes, such as the number of days worked, income from work, and total income. Those in TWE had more days living in a domiciliary, hospital, or transitional residence, as expected given that many TWE programs are affiliated with these types of residential settings. The two groups did not differ on any other non-vocational outcomes. Also notable is that the TWE only and CE with IPS referral groups did not differ on work attitudes at 6 mo follow-up, indicating that these two types of vocational rehabilitation did not differentially affect their attitudes toward work and, more specifically, their feeling external pressure to work. This last finding highlights that the additional support provided by vocational programs (e.g., vocational counselors) is not viewed as a source of pressure to pursue employment beyond their personal preferences.

Several methodological limitations deserve comment. Given that this study is observational in nature, there is inherent causal ambiguity with regard to outcomes. The associational nature of the data does not allow unambiguous determination of whether employment status influences clinical outcomes or whether improved clinical outcomes lead to better employment status. However, in the absence of significant associations, one can reasonably conclude that neither is the case. Further, the 6 mo follow-up period is a relatively brief time compared with some studies and may not have been long enough for individuals to have engaged in enough work to influence their non-vocational status; it has been demonstrated that it is steady work, rather than mere exposure to work (i.e., 1 d or more) that influences outcomes [31–32,60]. However, this was the most manageable time frame for which we could calculate the work pattern for each individual (e.g., working in TWE first, followed by CE).

In addition, these two nonrandomized cohorts were combined to create one sample, despite the fact that cohort 1 preceded cohort 2, resulting in a potential historical confound. However, given that the literature suggests that IPS is superior in fostering CE, the current context would make conducting a randomized clinical trial difficult, given the perceived lack of equipoise. It should also be noted that IPS does not have a large evidence base for improving employment in a largely substance using, homeless population and research has primarily focused on clients with SMI. There is some evidence that IPS helps individuals with co-occurring mental health and substance use diagnoses achieve better employment outcomes than other vocational services [60–61]; however, IPS may be less advantageous for the population studied here, offering a possible explanation for the lack of significant findings in non-vocational outcomes between the groups. These findings may have also been influenced by the 70–72 percent follow-up rates, leading to a potential selection bias; differences may have gone unmeasured because of attrition, which may have confounded the comparison of groups.

The lack of significant differences in non-vocational outcomes may also have reflected less than optimal fidelity to the IPS model. While fidelity was rated as “adequate” at most sites [49], adequate implementation may not have been enough to demonstrate the differences in outcomes between IPS and other employment groups [62], especially given that outcomes have been noted to show most improvement when IPS fidelity is high [28–30]. Finally, while there is some circularity in comparing employment outcomes among groups with different predefined work patterns (e.g., comparing no work and IPS on number of days worked), information is gained from examining employment outcomes among the four groups that were characterized by employment, such as comparing number of days worked for those in TWE only and CE with IPS referral.

Despite these limitations, this study is the first to compare the outcomes of individuals enrolled in both VA vocational programs, IPS and TWE, finding few differences between them and further demonstrating the distinctive role of IPS in fostering CE but not improvements in non-vocational outcomes.

CONCLUSIONS

In this study, IPS was, and has previously been, robustly associated with increased rates of achieving CE [16–19]. However, IPS has not been generally found to be associated with superior outcomes on other employment-related variables, such as employment income, when compared with other competitive work patterns or rehabilitative approaches [47].  Whether or not it was obtained via IPS, CE was associated with better employment-related outcomes than non-CE or no employment. Benefits were not found to carry over to non-vocational outcomes, and it seems that the benefits of vocational services are limited to achieving employment [33,35–38]. Specifically relevant to the VA context is the comparison of IPS and TWE. IPS was superior to TWE with regard to vocational outcomes, though the two did not differ on non-vocational outcomes or attitudes towards working. There are several reasons this may have occurred: IPS may be less advantageous for Veterans experiencing homelessness and predominantly with substance use problems, fidelity to the IPS model may have been less than optimal, and attrition may have attenuated observed benefits. This study is the first to compare the outcomes of VA’s two vocational programs, IPS and TWE, and provides further evidence demonstrating that IPS fosters engagement in CE but does not result in improvements in non-vocational domains.

ACKNOWLEDGMENTS
Author Contributions:
Study concept and design: M. Leddy, E. Stefanovics, R. Rosenheck.
Statistical analysis: E. Stefanovics, R. Rosenheck.
Interpretation of data: E. Stefanovics, R. Rosenheck, M. Leddy.
Drafting/revision of manuscript: M. Leddy, R. Rosenheck,
E. Stefanovics.
Financial Disclosures: The authors have declared that no competing interests exist.
Funding/Support: This material was based on work supported by the Mental Health and Behavioral Sciences Service, VA Central Office, Washington, DC.
Institutional Review: IRB approval for the initial study was obtained at the authors’ parent institution and at each of the nine participating VA facilities; IRB approval for this secondary analysis of the data was granted by the authors’ parent institution. Veterans gave written informed consent to participate in the project and for their employment specialist to communicate with employers.
Participant Follow-Up: Human study participants will not be informed about the accepted publication.
REFERENCES
5.
Strauss JS, Harding CM, Silberman M, Eichler A, Lieberman M. Work as treatment for psychiatric disorders: A puzzle in pieces. In: Ciardiello JA, Bell MD, editors. Vocational rehabilitation of persons with prolonged psychiatric disorders. Baltimore (MD): Johns Hopkins Press; 1988. p. 47–55.
This article and any supplementary material should be cited as follows:
Leddy M, Stefanovics E, Rosenheck R. Health and well-being of homeless veterans participating in transitional and supported employment: Six-month outcomes. J Rehabil Res Dev. 2014;51(1):161–74.
http://dx.doi.org/10.1682/JRRD.2013.01.0011
iThenticateCrossref

Go to TOP

Last Reviewed or Updated  Wednesday, April 9, 2014 11:17 AM

Valid HTML 4.01 Transitional