Regional Reports – User Guide

Regional Reports has been developed to support school districts, City Departments of Education, Regional Educational Authorities and Ministries of Education to monitor and evaluate the progress of all schools under their charge.

This user guides describes the reporting metrics used to track adoption and progress through Maths-Whizz.



Dashboard

The Dashboard section of the reports shows a snapshot of performance data based on all the students within the group. It covers three specific areas of reporting; Progress, Usage and Lesson performance.

dashboard

Progress relates to students’ growth over time, as measured by Maths Age and related metrics. Each value represents the average of the reported group of students:

Label descriptions:

      • Progress Rate – Average student rate of learning
      • Maths Age Improvement (in years) – Average student improvement
      • Current Maths Delta (in years) – Average difference between students’ Maths Age and actual age
      • Time Span (in years) – Average student timespan

Usage represents the average of time spent by each student in Tutor and Replay (which also includes Topic Bank).
Lesson performance is the percentage of the progression opportunities which are successfully passed.

A progression opportunity is a test that, if passed, would move the student to the next learning objective within that topic. Most learning objectives consist of an interactive exercise and test; the student progresses only if they have passed both. Pass rate relates to tutor mode only. Students must score 60% to pass a test.

Label descriptions:

      • Attempted Progressions – number of progression opportunities attempted.
      • Passed Progressions – number of progression opportunities passed.
      • Attempted Exercises– the number of exercises attempted.


Comparisons

The Comparison section allows you to see how each of the groups/schools compare against each other in terms of the Students’ Current Maths Delta, Maths age improvement, Progress rates and Usage.

comparisons

The performance for each sub-region or school can be seen within the table below each of the comparison lines. Performance is represented by the following status indicators:

  • tick Green tick – Progress Rate is at least 1
  • caution Orange warning question mark – Progress Rate < 1 and Average Weekly Usage >= 30
  • warning Serious blue warning – Progress Rate < 1 and Average Weekly Usage < 30


Maths-Whizz Terms


Report Period

The Report Period is the period of time that the reporting values are based on. It can be set to one of the following options:

  • Full History
    For each student, the reporting period begins from the date of their first assessment.
  • Current Academic Year
    For each student, the reporting period begins from the start date of their academic year (September 1, for example) or OR from the date of the student’s first assessment – whichever one is the most recent.
  • Last 7 Days
    For each student, the reporting period begins from the start date of their academic year (September 1, for example) or OR from the date of the student’s first assessment – whichever one is the most recent.
  • Since Last Assessment
    For each student, the reporting period begins from the date of the student’s first assessment.
  • Custom Dates
    For each student, the reporting period begins from the specified start date or the student’s first assessment – whichever one is the most recent. The end date is taken to be as specified.


Maths Age (MA)

You have probably heard of a “reading age”. Maths Age is the Whizz analogue that measures students’ current maths ability level. It is based on the structure of the underlying Maths-Whizz curriculum and is first assigned to each topic (a Topic Age), from which an average is taken to give overall Maths Age.

A Maths Age of 9.5, for example, means that overall a student is performing at the level expected of a typical nine-and-a-half year-old.

Maths Age is a powerful growth metric that reflects students’ dynamic intelligence; it is often useful to view Maths Age as an indicator of relative performance between groups of students.

Start Age

The Start Maths Age of a single student is their Maths Age either at the start of the reporting period or their first assessment, whichever is more recent. It can be thought of as their baseline maths ability.

Student:

Group:

The Start Maths Age of a group of students is the average of their individual Start Maths Ages.

Current Maths Age

The Current Maths Age of a single student is their Maths Age on the present day (i.e. the end of the reporting period).

The Current Maths Age of a group of students is the average of their individual Current Maths Ages.

Student:

Group:

Maths Age Improvement

The Maths Age Improvement of a single student is the difference between their Current Maths Age and Start Maths Age. It is a measure of their learning growth during the reporting period.


The Maths Age Improvement of a group of students is the improvement in their Average Maths Age.

MA Improvement = End MA – Start MA
Group MA Improvement = Ave End MA – Ave Start MA


Time Span

The ‘Time Span’ of a group, is the average time period that Math-Whizz has been used for ‘Time Span’ is calculated in years. For example, 6 months is equal to a Time Span of 0.5 and one week is equal to a Time Span of 0.02. Whenever the time period spans less than 7 days, Time Span is set to 0.02.

Let a = Start Date, b = End Date
Define
Time Span (days) = # occurrences of midnight between Start and End

Then for a student:

For a group:


Progress Rate

The Progress Rate gives us a way of comparing progress for students who use Whizz across different timespans. A Progress Rate of 1 means the student has progressed at the expected rate, i.e. they have improved in line with the timespan. A Progress Rate of 0.7 means the student has progressed at 70% the expected rate. Progress Rate may be negative in cases where students have been reassessed at a lower age.

Student:

Group:


Maths Delta

The Maths Delta of a student, is the difference in a student’s maths age and actual age.
Student:

MA delta = MA – Actual age (2dp)

Group:


Weekly usage

Weekly Usage is the time spent by each student in Tutor Mode and Replay (which also includes Topic Bank).

Tutor usage = time spent in tutor (rounded to nearest min)
Replay usage = time spent in Replay and Topic Bank (rounded to nearest min)
Total usage = Tutor usage + Replay usage

Student:

Group:

Average Total Usage = Average Tutor usage + Average Replay Usage


Usage band

The Usage Band filters students according to four usage brackets:

      • Show all: includes all students regardless of usage
      • Low usage: < 30 minutes per week.
      • Recommended usage: 30-90 minutes per week.
      • Excessive usage: >90 minutes per week.