Home > Codebook > Measures > Dimensions of Organizational Functioning - Subject Release

Dimensions of Organizational Functioning - Subject Release

This measure appears in the following time-points: Release.

Related Construct

Description of Measure

Unlike other sections of the codebook which describe a specific measures, this section of the codebook describes a set of computed constructs ("dimensions") that we have generated to summarize the institutional experience along key constructs. A subset of release interview items were used to generate ratings about eight dimensions of organizational functioning. Each of the dimensions reflects general attributes of the setting that are likely to affect the later adjustment of adolescents who spent time in the institution. The eight dimensions are akin to latent constructs that are comprised of two to three components each. The components (a total of 20 across all eight dimensions) are scores from scales incorporated in the release interview or derived during factor analysis. Details regarding the definition of and methods used to develop the dimensions can be found in Mulvey, Schubert & Odgers, 2010. We provide a summary of the dimensions below, however, other sections of the release interview codebook should be consulted for more in-depth information regarding the measures from which the dimension are derived.

There were several steps involved in the development of the eight dimensions of organizational functioning. First, items from scales included in the release interview were grouped under the most relevant of the eight dimensions (safety, institutional order, harshness, caring adults, fairness, antisocial peers, services, and reentry planning) based on face validity. Next, we derived a score or set of scores (components) to reflect each dimension using one of the following methods: (a) summing the number of endorsed items (e.g., to estimate the number of services received or vocational training opportunities within an institution), (b) calculating scores for measures with pre-established scales to correspond with previously validated scoring protocols (e.g., exposure to violence), and (c) creating new scales based on item sets selected to tap into relevant constructs and validating these scales through the application of exploratory and confirmatory factor analytic methods. When this last method was used, we assessed the internal consistency, parameter estimates, overall model fit, and convergent validity of newly created subscales for each dimension. We also tested whether each of the eight dimensions was best represented by a single factor (unidimensional) or multiple components (multidimensional). All structural equation models were evaluated using recommended fit indices, including the root mean square error of approximation (RMSEA), where values less than .08 indicate acceptable fit and values less than .05 indicate good fit, and the confirmatory fit index, where estimates greater than .90 indicate acceptable fit and values greater than .95 indicate good fit (Hu & Bentler, 1999; McDonald & Ho, 2002).

The dimensions were developed using information from 668 release interviews. No study participant contributed more than one interview, thus eliminating the possibility of bias produced by multiple ratings from the same individual. In situations where one study participant provided more than one release interview, only the first interview ratings obtained during the follow-up period were used in the development of the dimensions. The reports came roughly equivalently from the Philadelphia (n = 325) and Phoenix (n = 343) sites and the ratings represented 128 unique institutions.

The inter-correlation coefficients and multilevel reliability coefficients for subscales across the 128 institutions are as follows:

Dimension Components ICC Alpha, Multilevel
Safety Fear .08 .32
Exposure to Violence .14 .28
Institutional Order Overall organization .16 .65
Staff connectedness .52 .85
Staff negative behavior .25 .54
Harshness Sanctions .04 .18
Restrictions .50 .82
Punishment Costs .23 .66
Caring Adult Domains of Support .36 .73
Diversity of Support .18
Fairness Lack of bias .04 .21
Overall Fairness .15 .52
Antisocial Peers Peer Delinquency .06 .23
Peer Negative Influence .06 .08
Gangs (present/not present)
Services Mental Health services .48 .82
Vocational Services .34 .70
Having a primary caregiver (yes/no)
Reentry Planning Future orientation of the program .37/.36.75
Having a release counselor (yes/no)
*Intraclass correlations (ICCs) presented above are calculated for the 111 institutions with 2 or more raters. Because of the small cluster size, sensitivity analyses were conducted on the 46 institutions with 3 or more raters (average of 12.2 raters per institution). A similar pattern of ICC estimates was documented within this restricted sample. The ICC values obtained for each of the components in this restricted analysis are as follows: fear: .09, exposure to violence: .08, overall organization: .23, staff connectedness: .51, staff negative behavior: .18, sanctions: .03, restrictions: .46, punishment costs: .14, social support-domains: .37, social support-diversity: .24, lack of bias: .05, overall fairness: .17, peer delinquency: .06, peer negative influences: .04, mental health services: .50, vocational services: .31, future orientation of the program: .36/.21.

The variables that comprise the dimensions components noted above can be found in various release codebook measures (exclusive of three exceptions, which are noted below).

Three of the dimension components are available in this section because they are calculated in a different manner than the original version that was described in the "Sanctioning Practices and Institutional Climate" measure.

These items assess the participant's perceived safety while at the institution (e.g., "I felt safe when a staff member was present", "I always had to watch my back around other residents"), staff connectedness (e.g., "Staff did a lot of individual counseling", "If a resident did well, the staff would tell him/her so personally"), and overall organization (e.g., "The facility was always neat and clean", "We followed a regular schedule every day"). Participants respond on a 5-point Likert scale ranging from "Strongly disagree" to "Strongly agree".

The following components are available in this section.

Update: During the data cleaning phase, 11 of the 668 cases used to develop the dimensions were removed from the dataset because the interview was conducted outside of the window of opportunity allowed for data collection (either more than 60 days after their release from the institution, or after the end of the follow84 timepoint interview) or because more than one interview was mistakenly conducted on the same institution stay. We do not believe that this issue detracts from the validity of the dimensions since it rooted in the inability to match the time period covered by the release interview to the calendar data, not to a problem with the ratings provided by the study participant.

References