EIR-Evaluation

EDUCATION INNOVATION AND RESEARCH (EIR)

Evaluation

Research Questions
Fidelity of Implementation (FOI)		To what extent was the YEES intervention implemented with fidelity in treatment classrooms and schools over time?
		How do school factors related to the implementation of fidelity differ across YEES and comparison schools over time?
		Is there significant variation in implementation fidelity across YEES schools and teachers over time?
Impact	Student (Confirmatory)	How does the YEES impact students’ academic (CSAAP scores), and social-behavioral (e.g., social competence, disciplinary referrals) outcomes relative to comparison students?
		What is the impact of YEES on students’ academic, and social-behavioral outcomes during the transition into middle school?
		What is the impact of YEES on academic and social-behavioral student outcomes over time?
	Teacher (Exploratory)	How does the implementation of YEES impact teachers’ instructional quality, classroom climate and disciplinary referrals?
		What is the impact of YEES on teachers’ practices and social-behavior outcomes over time?
Subgroup Impacts		How are the effects of YEES moderated or mediated by: · Student factors (i.e.: grade, gender, race/ethnicity, free or reduced-price lunch status, English language learner (ELL) status, percentage low income, parent perception of school climate, and level of implementation)? · School factors (i.e.: size, percentage ELL, percentage low income, parent perception of school climate, and level of implementation)? · Teacher factors (i.e., teaching experience, grade, gender, and race/ethnicity)?
Mediator Impacts		Is there a significant relationship among teacher (i.e., fidelity of implementation) and student outcomes (i.e., student academic achievement, and SEL skills)?

A project of this scope needs high quality evaluation. Our project includes hiring SPSG, Inc. as our independent Evaluator. SPSG has served as the independent Evaluator for PUSD since 2010, which has included previous state and federal grant programs received by PUSD that support students’ social and emotional needs, and is familiar with PUSD schools and our community, as well as the evidence-based practices included in this project. SPSG has extensive experience evaluating education, health, mental health and social services programs, and is proficient in all aspects and methods of evaluation stated in this proposal.

SPSG will conduct a comprehensive evaluation plan to ensure an ongoing review of the project’s progress and a thorough assessment of its overall effectiveness. The multi-method approach to our evaluation includes empowerment, process, fidelity, and outcome procedures. Our evaluation plan is designed to collect and analyze data on how the project is affecting individual student behavior, in accordance with privacy requirements, to ensure the programs are working to improve our students’ well being and our school environment.