System 44/READ 180: Napa Valley Unified School District
At a glance
  • Demonstrates a Rationale
  • Programs:System 44®,Read 180®
  • Subjects:Intervention Curriculum, Literacy Curriculum
  • Report Type:Efficacy Study, Study Conducted by Third Party
  • Grade Level:Elementary, Middle, High
  • Region:West
  • Population:Students with Disabilities, Students with Specific Learning Disabilities
  • District Urbanicity:Suburban
  • District Size:Large
  • Implementation Model:0-39 minutes, 40-59 minutes, 60-79 minutes, 80+ minutes
  • District:Napa Valley Unified School District, Napa Valley, CA
  • Participants:N=1394
  • Outcome Measure:California Standards Test of English Language Arts (CST ELA), California English Language Development Test (CELDT)
  • Evaluation Period:2011–2012
  • Study Conducted By:Whiteboard Advisors & Scholastic Research
District Characteristics
System 44andREAD 180Provide a Solid Return on Investment for Napa Valley Unified School District

Napa Valley Unified School District (NVUSD) is representative of school districts in California, serving 18,078 students in 30 schools during the 2011–2012 school year. Located in a demanding agricultural region, the district serves a large migrant population. At the time of this study, the majority of students in the district were Hispanic (52%). Approximately 37% were White, 8% were Asian, 2% were African American, and 1% were Native American. Nine percent were students with disabilities, 22% were English learners, and 46% were eligible for free or reduced-price lunch.

Implementation Overview

In the 2011–2012 school year, NVUSD partnered with Scholastic and Whiteboard Advisors to investigate the use ofSystem 44andREAD 180with its students in Grades 3 through 11.System 44andREAD 180were first approved for use in the district in the 2005–2006 school year as a small pilot program. NVUSD monitored its success and slowly grew the program from a pilot to a district-wide service. The programs were chosen by the district, as they are among the most researched, competency-based reading intervention programs available. Additionally,System 44andREAD 180are designed to support positive behavior interventions and supports (PBIS) that identify and sustain effective school-wide academic and behavioral practices that improve student outcomes. The programs do this by incorporating instructional management routines, classroom engagement, clear goal setting, and rewards that may be implemented in parallel with positive behavior interventions. In these ways,System 44andREAD 180are in line with NVUSD’s vision for improving student outcomes while reducing costs.

Implementation Model

Students who participated inSystem 44received 30 to 120 minutes of instruction daily, either as a stand-alone program or integrated withREAD 180. TheSystem 44implementation guidelines included specified time for three rotations that consisted of Small-Group differentiated instruction, apersonalized learningprogression through theSystem 44instructional software, and modeled or independent reading. A goal of the district was to reduce the number of students inSystem 44at the middle and high school levels, so they provided students in Grades 5 and 8 the opportunity to receive additional software time before or after school. This was very positively received by teachers, students, and parents.

Students who participated inREAD 180received 90 to 120 minutes of instruction daily. TheREAD 180implementation guidelines included specified time for three rotations that consisted of Small-Group differentiated instruction, a personalized progression through theREAD 180instructional software, and modeled or independent reading. In the integratedSystem 44/READ 180model, students followed the same implementation.

Participants

A total of 517 students who participated inSystem 44and 877 students who participated inREAD 180were included in these analyses. Students were included in theSystem 44analysis if they had completed the program at the end of the 2011–2012 school year and if they had assessment data from both the 2010–2011 school year and the 2011–2012 school year. Students were included in theREAD 180analysis if they were enrolled in the program at the end of the school year and if they had assessment data from both the 2010–2011 school year and the 2011–2012 school year.

Measures

California Standards Test of English Language Arts (CST ELA)The CST ELA is given to students in Grades 2–11 as a part of the Standardized Testing and Reporting (STAR) Program. Developed exclusively for California’s public schools, the CST ELA provides information that can be used to determine how well students are mastering state content standards. The CST ELA reports students’ performance as both a scale score (which can range from 150–600) and as one of five Performance Levels. Each of the five Performance Levels (Far Below Basic, Below Basic, Basic, Proficient, or Advanced) is associated with a range of scale scores for each grade level.

California English Language Development Test (CELDT)An English skills test is required by law for students in Grades K–12 whose home language is not English. The CELDT is the English skills test given in California. It was developed to identify students with limited English proficiency (LEP), determine the level of English language proficiency of those students, and assess the progress of LEP students in acquiring the skills of listening, speaking, reading, and writing in English. The CELDT results are reported by the following performance levels: Beginning, Early Intermediate, Intermediate, Early Advanced, and Advanced. Results show the overall English performance level attained by students as well as performance in each domain by level.

Results

California Standards Test of English Language Arts (CST ELA) and California English Language Development Test (CELDT) scores were obtained for bothSystem 44andREAD 180students in Grades 3 through 11 who used the programs in the 2011—2012 school year. Results from the CST ELA and CELDT demonstrated that both theSystem 44andREAD 180students significantly improved their reading comprehension skills after one year of using the programs.

As Graph 1 displays, the percentage ofSystem 44students in Grades 3 through 11 scoring Proficient and Above on the CST ELA increased from 6% in the 2010—2011 school year to 16% in the 2011—2012 school year, including a jump from 4% to 32% for the district’s fourth graders. The CELDT corroborated these gains. Students usingSystem 44experienced significant improvements. In 2012, 41% ofSystem 44students scored Early Advanced and Above on CELDT, up from 12% in the prior year.

1.4 Napa Valley Graph 1

GRAPH 1. Napa Valley Unified School DistrictSystem 44Students, Grades 3–11 (N = 517)

Performance on CST ELA and CELDT, 2011–2012

图2显示,2010 - 2011 school year, 6% of participatingREAD 180students in Grades 3 through 11 were scoring Proficient and Above on the CST ELA. In 2011–2012, this number increased to 13%, including a jump from 8% to 33% for the district’s fourth graders. The CELDT corroborated these gains. Students usingREAD 180experienced significant improvements from the 2010–2011 to the 2011–2012 assessment. In 2012, 48% ofREAD 180students scored Early Advanced and Above on CELDT, up from 17% in the prior year.

2.2 Graph 2

GRAPH 2. Napa Valley Unified School DistrictREAD 180Students, Grades 3–11 (N = 877)

Performance on CST ELA and CELDT, 2011–2012

In addition, the district tracked lower referral rates into special education since usingSystem 44andREAD 180(见图1),2004年该地区记录1,164 students with specific learning disabilities. In 2011, that count dropped to 695. This trend allowed NVUSD to reduce its special education caseload, reduce its associated costs for students with specific learning disabilities, and better focus its services on its academic and behavioral priorities.

1.4 Napa Valley Graph 2

FIGURE 1. Napa Valley Unified School District Students with Disabilities and Specific Learning Disabilities, Grades K–12 (N = 18,078)

Enrollment Trends, 2000-2011

While implemented as part of theResponse to Intervention (RTI) modelacross NVUSD, the core components ofSystem 44andREAD 180were also in line with the district’s Positive Behavioral Intervention Program. The district had been tracking some of the ancillary benefits of its Positive Behavioral Intervention Program, which included improved behavioral outcomes and cost savings (see Figure 2). In 2009, the district recorded 58 expulsions. That figure dropped to 26 expulsions in 2012, which represented $188,660 captured by the district. Suspensions dropped from 4,881 to 2,086 from 2010 to 2012, representing $83,850 that the district would otherwise have lost. The captured funds were reinvested back into NVUSD’s program and behavioral priorities.

1.4 Napa Valley Graph 3

FIGURE 2. Napa Valley Unified School District Students, Grades K–12 (N = 18,078)

Suspension and Expulsion Counts and Costs, 2006–2012

Conclusion

This study demonstrates that both theSystem 44andREAD 180programs produced a solid return on investment for NVUSD. Results from the CST ELA and CELDT showed that student outcomes on reading comprehension were significantly improved from one year to the next. The number of students scoring Proficient and Above on the CST ELA increased from 2011 to 2012, and the number of students scoring Early Advanced and Above on CELDT increased during the same time period. Lower referral rates into special education, along with a drop of almost half of the district’s population of students with specific learning disabilities, reduced costs for these services, allowing the district to allocate funds to other priorities. Additionally, decreased suspension and expulsion counts saved the district over $270,000. In sum, Napa Valley Unified School District was able to raise student achievement and reduce spending when implementingSystem 44andREAD 180programs.