Regional Reports – User Guide

Regional Reports has been developed to support school districts, City Departments of Education, Regional Educational Authorities and Ministries of Education to monitor and evaluate the progress of all schools under their charge.

This user guides describes the reporting metrics used to track adoption and progress through Math-Whizz.



Dashboard

The Dashboard section of the reports shows a snapshot of performance data based on all the students within the group. It covers three specific areas of reporting; Progress, Usage and Lesson performance.

dashboard

Progress relates to students’ growth over time, as measured by Math Age and related metrics. Each value represents the average of the reported group of students:

Label descriptions:

      • Progress Rate – Average student rate of learning
      • Math Age Improvement (in years) – Average student improvement
      • Current Math Delta (in years) – Average difference between students’ Math Age and actual age
      • Time Span (in years) – Average student timespan

Usage represents the average of time spent by each student in Tutor and Replay (which also includes Topic Bank).
Lesson performance is the percentage of the progression opportunities which are successfully passed.

A progression opportunity is a test that, if passed, would move the student to the next learning objective within that topic. Most learning objectives consist of an interactive exercise and test; the student progresses only if they have passed both. Pass rate relates to tutor mode only. Students must score 60% to pass a test.

Label descriptions:

      • Attempted Progressions – number of progression opportunities attempted.
      • Passed Progressions – number of progression opportunities passed.
      • Attempted Exercises– the number of exercises attempted.


Comparisons

The Comparison section allows you to see how each of the groups/schools compare against each other in terms of the Students’ Current Math Delta, Math age improvement, Progress rates and Usage.

comparisons

The performance for each sub-region or school can be seen within the table below each of the comparison lines. Performance is represented by the following status indicators:

  • tickGreen tick – Progress Rate is at least 1
  • cautionOrange warning question mark – Progress Rate < 1 and Average Weekly Usage >= 30
  • warningSerious blue warning – Progress Rate < 1 and Average Weekly Usage < 30


Math-Whizz Terms


Report Period

The Report Period is the period of time that the reporting values are based on. It can be set to one of the following options:

  • Full History
    For each student, the reporting period begins from the date of their first assessment.
  • Current Academic Year
    For each student, the reporting period begins from the start date of their academic year (September 1, for example) or OR from the date of the student’s first assessment – whichever one is the most recent.
  • Last 7 Days
    For each student, the reporting period begins from the start date of their academic year (September 1, for example) or OR from the date of the student’s first assessment – whichever one is the most recent.
  • Since Last Assessment
    For each student, the reporting period begins from the date of the student’s first assessment.
  • Custom Dates
    For each student, the reporting period begins from the specified start date or the student’s first assessment – whichever one is the most recent. The end date is taken to be as specified.


Math Age (MA)

You have probably heard of a “reading age”. Math Age is the Whizz analogue that measures students’ current math ability level. It is based on the structure of the underlying Math-Whizz curriculum and is first assigned to each topic (a Topic Age), from which an average is taken to give overall Math Age.

A Math Age of 9.5, for example, means that overall a student is performing at the level expected of a typical nine-and-a-half year-old.

Math Age is a powerful growth metric that reflects students’ dynamic intelligence; it is often useful to view Math Age as an indicator of relative performance between groups of students.

Start Age

The Start Math Age of a single student is their Math Age either at the start of the reporting period or their first assessment, whichever is more recent. It can be thought of as their baseline math ability.

Student:

Group:

The Start Math Age of a group of students is the average of their individual Start Math Ages.

Current Math Age

The Current Math Age of a single student is their Math Age on the present day (i.e. the end of the reporting period).

The Current Math Age of a group of students is the average of their individual Current Math Ages.

Student:

Group:

Math Age Improvement

The Math Age Improvement of a single student is the difference between their Current Math Age and Start Math Age. It is a measure of their learning growth during the reporting period.


The Math Age Improvement of a group of students is the improvement in their Average Math Age.

MA Improvement = End MA – Start MA
Group MA Improvement = Ave End MA – Ave Start MA


Time Span

The ‘Time Span’ of a group, is the average time period that Math-Whizz has been used for ‘Time Span’ is calculated in years. For example, 6 months is equal to a Time Span of 0.5 and one week is equal to a Time Span of 0.02. Whenever the time period spans less than 7 days, Time Span is set to 0.02.

Let a = Start Date, b = End Date
Define
Time Span (days) = # occurrences of midnight between Start and End

Then for a student:

For a group:


Progress Rate

The Progress Rate gives us a way of comparing progress for students who use Whizz across different timespans. A Progress Rate of 1 means the student has progressed at the expected rate, i.e. they have improved in line with the timespan. A Progress Rate of 0.7 means the student has progressed at 70% the expected rate. Progress Rate may be negative in cases where students have been reassessed at a lower age.

Student:

Group:


Math Delta

The Math Delta of a student, is the difference in a student’s math age and actual age.
Student:

MA delta = MA – Actual age (2dp)

Group:


Weekly usage

Weekly Usage is the time spent by each student in Tutor Mode and Replay (which also includes Topic Bank).

Tutor usage = time spent in tutor (rounded to nearest min)
Replay usage = time spent in Replay and Topic Bank (rounded to nearest min)
Total usage = Tutor usage + Replay usage

Student:

Group:

Average Total Usage = Average Tutor usage + Average Replay Usage


Usage band

The Usage Band filters students according to four usage brackets:

      • Show all: includes all students regardless of usage
      • Low usage: < 30 minutes per week.
      • Recommended usage: 30-90 minutes per week.
      • Excessive usage: >90 minutes per week.