Home > Uncategorized > Vermont Story on Delayed Test Results Illustrates Everything Wrong with Testing

Vermont Story on Delayed Test Results Illustrates Everything Wrong with Testing

July 29, 2019

Our local paper, the Valley News, reprinted an article by Lola Duffort titled “School Test Score Data Nine Months Overdue“. This is unsurprising given the ambitious scope of the State’s new Annual Snapshot “dashboard” and the fact that the current State Department of Education is woefully understaffed. And this problem of ambitious analytics combined with understaffed state departments is not limited to Vermont. This toxic combination is a systemic problem brought about by federal legislators allowing and encouraging states to include more and more data on their “report cards” on the heels of states deciding to cut back staffs following the 2008 economic collapse, often making those cuts on data collection departments where much of the work was outsourced.

In an earlier article Ms. Duffort described the new expanded “dashboard” as follows:

The Vermont Agency of Education has released its first Annual Snapshot, a new online dashboard that will allow anyone to take a look at how each of the state’s public K-12 schools are doing, using a variety of new indicators.

The Snapshot is an intentional pivot away from the standardized-testing focused era of the federal No Child Left Behind Act, which was widely criticized by educators — particularly in Vermont — for emphasizing too narrow a measure of school performance. The successor law to NCLB, the Every Student Succeeds Act, still requires testing, but it also allows states to name several new standards for appraising schools…

…the Snapshot aims to allow the public to see not just traditional measures of school performance – like test scores and graduation rates – but also information about school climate, staffing quality, spending priorities, and personalization.

As one who has written frequently about the inanity of rating schools based solely on test scores, I fully support this new direction by Vermont. But, as one who worked with state departments for 29 years and witnessed their de-staffing over that time period, I also understand that delivering on this promised expansive data will be difficult… and it will be especially so in Vermont where it appears the new commissioner is loathe to add staff:

The agency is “seriously understaffed,” said Sen. Phil Baruth, D/P-Chittenden, who chairs the Senate Education Committee.

“It’s resulted in delays and errors and a general inability to do their jobs. I’ve been trying to light a fire under Secretary French and this administration for a year now, to pick up the pace of hiring, but they seem content to continue running the agency well below full strength,” he said.

Staffing capacity at the agency worried House lawmakers enough last session that House Education chair Rep. Kate Webb, D-Shelburne, and Government Operations chair Rep. Sarah Copeland-Hanzas, D-Bradford, held a joint hearing on the subject. The agency has lost about a fourth of its staff to budget cuts since the Great Recession.

But Webb said that, as for the test scores, she was “not concerned at this time,” since students, teachers, and districts have access to their individual results.

Sorry, Ms. Webb… but the whole point of providing the Snapshot was to provide MORE information than test results and providing those results nine months after the tests were administered is, to be blunt, ridiculous and useless. If a teacher failed to return a high-stakes test to a student nine months after the test was administered they would be looking for a new career. For the Annual Snapshot to serve ANY valid educational purpose it needs to be in the hands of teachers, administrators, and Board members within weeks— not nine months later. Moreover, between October 2018 and August 2019 it is likely that 1/4 of the school board members and a similar percentage of principals and teachers will change, especially in the small rural schools that constitute much of Vermont. Complicating matters even more, there are several new Boards in place now as a result of Act 46, making the late delivery of data even more problematic.

The solution, as always, is more resources— in this case for State Departments of Education. But finding support to pay for “bureaucrats” whose primary purpose is enforcement of regulations adopted by the legislature and State Board and the delivery of reports on a wide array of issues is not easy. It’s far easier to outsource data gathering, skimp on regulatory enforcement, and complain about the inefficiency of the State Department of Education…. because, well, “government is the problem”.

%d bloggers like this: