How do I interpret students' domain based progress monitoring results?

How do I interpret students' domain based progress monitoring results?

Introduction

  1. Students' Progress Monitoring results are automatically graphed
  1. A trend line is added to the graph after the student has completed at least 3 CBMs
                                                                                    


  1. Classworks measures the effectiveness of the intervention by taking into account the student's:
    1. chronological grade level of the grade level of the CBM
    1. trend line compared to target rate of improvement
  1. View each student's results by navigating to the Progress Monitoring page, select the subject and click 'view details'


A printed report "Progress Monitoring Results" can also be generated to share progress with parents and guardians. 

Reading the Graph

  1. Compare the student’s trend line to the target line
  1. Over time the student’s trend line should be sloping very closely to the target rate of improvement (ROI) line
The trend line is automatically updated to provide an estimated amount of growth throughout the CBM session.
Focusing on the yellow trend line provides more insight than the individual scores (they are used to calculate their trend).  
How Classworks calculates the Rate of Improvement
  1. If it is sloping steeply above or below the target line, the student’s intervention might need an adaptation

  • Look at the graph above. In this example the student is has struggled but is now appears to be responding well to the interventions currently in place. 
  • The graph verifies this statement because the student's trend line (yellow) is closely aligned to the target rate of improvement (green line). 

Let's Look at Two Examples

There are three lines on each graph to notice.
  1. The yellow line is the student's trend line.
  1. The green line is the student's Target Rate of Improvement. It shows the expected achievement trend.
  1. The blue line with the dots show the student's actual weekly CBM scores.

Student 1: Trending below target - Adaptation Needed


  1. Student 1’s Rate of Improvement (yellow line) is trending below the Target Rate of Improvement (green line).
  1. It may be best to reevaluate the student’s intervention since the student's trend line is declining.


  1. Student 2’s Rate of Improvement (yellow line) is trending well above the Target Rate of Improvement (green line).
  2. The student could be responding well to the current interventions since the student’s performance is trending at a pace well above the Target Rate of Improvement
  3. This student may be a candidate for re-evaluation of their tier of support

Graph Details

When viewing the graph there are several things you should notice:
    1. Above the graph the content area and grade level of the CBMs are displayed
    1. Notice the start and end dates for this progress monitoring session

  1. At the top of the graph the student's rate of improvement and the target (expected) rate of improvement are displayed


There are three lines shown on this sample graph:


  1. The connected blue dots show how the student scored on each week's probe.

  • The solid green line is the Target Rate of improvement for the 12-week duration. The slope of this line is determined by the difference between the baseline score and the percentage needed to meet the Moderate or Aggressive goal. This includes a number that shows the expected percentage points gained each week (in this case, it is 5.1818% per week for 12 weeks to reach the aggressive goal of 80%).

  • The yellow line is the Current Rate of Improvement and is calculated based on the student's weekly results and estimates which way the student is heading based on their current trend. This line is calculated using a "least-squares" regression equation and requires at least 3 results. This shows the student's actual growth (in this case, it is 4.2518).


Assessment Details

The details of the Active progress monitoring session are the default view. Read more about viewing previously completed sessions.

When viewing the active session you will notice the following:
  1. Week column indicates each week of the 12 week session included with the CBM session.
  1. Date column indicates the CBM completion date. It says Skipped if the student skipped (missed a week) or is blank if it is an upcoming week.


  1. Time column indicates the number of hours, minutes and seconds the student spent completing each CBM.


  1. Score column indicates the scale score earned by the student on each CBM.


  1. Notes column displays anecdotal notes the teacher entered to provide a narrative of the student's performance on each CBM. 

Cumulative Question Responses

  1. Below the graph and weekly details, you will find the Cumulative Item Response table.
  1. This table breaks down which domains and assessment objectives the student was tested on and how well they did.

  1. The table is organized by curriculum strand with each skill or objective shown in its own row.
  2. The color dot shown represents a percent correct on the total items for that assessment objective.
    1. Red = 0% - 39%
    2. Yellow = 40% - 59%
    3. Green = 60% - 100%


Look at this example. Grace's performance with 'Show evidence that computational results are correct and that estimates are reasonable' skill varied each week.
  1. Weeks 4, 5, 7, 8, 9 and 11 she answered 60% or more of the questions correctly
  1. Weeks 1, 2, 3, 6 and 10 she answered less than 40% of the questions correctly
  1. Week 12 is grayed out because Grace didn't complete the CBM that week

Item Analysis

The actual question, correct and incorrect responses are accessible by clicking on each score dot.