The activities of Oklahoma Systems of Care’s (OSOC) Evaluation Team are focused on four (4) primary goals.
State and community levels:
Providing families and community stakeholders
with information about the efforts and efficacy
of their local SOC, in order to provide
accountability and to answer local needs related
to education and sustainability
Providing the state management team with
outcomes and data to promote sustainability of
SOC and broadening support among legislators and
other state-level stakeholders
Providing data to the governing bodies and
management teams associated with SOC for quality
improvement and fidelity monitoring
National level:
Participation in the National Evaluation,
mandated for grant communities by the Center
for Mental Health Services (CMHS).
The OSOC Youth Information Systems (YIS)
The data in the Oklahoma Systems of Care Youth Information System (YIS) have been designed with input from families, communities, site staff and state management and are intended to provide reliable outcome and quality improvement measures while keeping the data collection effort imposed on families and staff at an acceptable level. The evaluation team is constantly modifying the system’s content and functionality to respond to requests and concerns of the entire OSOC community.
The table below lists the instruments that make up the OSOC YIS and the characteristics of their administration.
|
Instrument Name |
Source of |
Obtained by |
When |
Estimated time |
|
Referral Form |
Referred Youth |
Referring Entity |
Pre-Approval |
NA |
|
Enrollment Form |
Enrolled Youth |
Facilitator |
Enrollment |
10 min |
|
Youth Update |
Enrolled Youth |
Facilitator |
6-month intervals after Enrollment |
5 min |
|
Ohio Scales |
Enrolled Youth (12 or older), |
Facilitator |
Enrollment and 6-month intervals; Worker form also done at 3 months after enrollment |
15 min per form |
|
OSOC Assessment |
Youth / Caregiver not in National Evaluation |
Facilitator |
Enrollment and 6-month intervals |
15 min |
|
National Evaluation Longitudinal Study |
Youth / Caregiver in National Evaluation |
National Evaluation Interviewers |
Enrollment and 6-month intervals |
1½ - 3 hours |
|
Family Team Satisfaction Survey |
Family Team Participant |
Facilitator |
Following each Family Team Meeting |
5 min |
|
Wraparound Event Form |
Facilitator |
Facilitator |
Immediately following Wraparound Event |
5 min |
National Evaluation
The National Evaluation is composed of two data collection efforts, a cross-sectional study focused on demographic and other descriptive information about SOC enrollees and a longitudinal study concerned with details about the experience of families in SOC and whether SOC programs are improving the lives of its families.
Cross-sectional study data are collected at all OSOC sites for all enrolled youths. These data are gathered using the Enrollment Form and the Youth Update Form. These data address the following areas: 1) Demographics–age, ethnicity, gender; 2) Presenting problems, diagnoses; 3) Referral source and involvement with other agencies. The evaluation team subsequently extracts the information and submits it to CMHS’s national evaluation contractor.
Longitudinal (Outcome) study tracks SOC families for up to three years following their enrollment and involves an extensive set of instruments that are administered at baseline (enrollment) and every 6 months thereafter, even if the family has separated from SOC. The study interviewers are selected from graduated SOC families who were nominated by SOC sites with which they were involved.