Genuine Accountability for Our Schools

 

Bill Breisch, Director of Instruction

Monona Grove School District

 

"The trouble with most folks isn't so much their ignorance,

as knowing so many things that ain't so."

Josh Billings, 1815-1885, American humorist

In my previous column .Measuring Temperature with a Tablespoon,. I referenced James Popham, one of

the nation.s foremost authorities on educational testing. I described how our state and national use of

standardized achievement tests to measure the instructional quality of our schools is not appropriate, in

essence like .measuring temperature with a tablespoon.. In addition, Popham probably would agree

with the above quotation by American humorist Josh Billings when Popham observes, .Is all of this some

kind of conspiracy? No, I don.t think educational policymakers established high-states testing programs

to harm children---or to .get. teachers.. Rather, policymakers. actions reflect their ignorance of the

reality of educational testing. Even worse, they don.t know that they don.t know..

Here are three characteristics of a strong, appropriate accountability system needed by our schools:

(1) Prioritized State Academic Content Standards

Wisconsin is like most other states. We have literally HUNDREDS of academic content standards. We

need to develop state tests for a few high-priority, .truly praiseworthy. standards that can be successfully

taught and accurately assessed in a timely manner. This is not an attempt to water down what we are

teaching our students! It is a call for identifying with clarity what academic standards Popham describes

to be as .SIGNIFICANT, clear, testable, and teachable as possible..

We have a multitude of skills that we are attempting to test, so it might appear that we have a rigorous set

of state standards. Popham captures the essence of this problem when he observes, .It.s impossible to test

properly all the good things we want kids to learn. From both an assessment and an instructional

perspective, too many curricular targets turn out to be no targets at all.. As a result, we essentially have

no instructional focus without prioritizing our myriad of state academic content standards.

 

(2) Unambiguously Described Content Standards

Mystery and guessing are not allowed here! Our high-priority state content standards must be absolutely

clear and completely described. The component knowledge and skills that students must demonstrate and

that teachers need to teach should be evident to all.

Popham observes that, .The test developer then must decide whether a typical teacher, using any sort of

reasonable teaching approach, could provide students with the instruction they.ll need to master this set of

enabling knowledge and subskills. (that make up the components of the prioritized state standards).

Teachers are not lock-stepped into one particular way to teach this body of knowledge and skills. Popham

concludes, .Experience indicates that for most curricular outcomes, there are many roads to instructional

Mecca..

 

(3) Standard-by-Standard Reporting

In standard-by-standard reporting, student scores are matched with specific standards. Standardized tests

do not provide this critical information. Instead, standardized test scores are indicators of broad areas of

knowledge that provide no specific focus for instruction. There would be no need to guess which student

performance scores match which specific standards in state assessment that has standard-by-standard

reporting. Students, teachers, parents and the community would know the high quality, rigorous

standards and the corresponding student performance scores on those standards.

We Can Do It!

 

The good news is that the Wisconsin Student Assessment System (WSAS) is beginning to develop an

appropriate accountability system, moving in the direction of Prioritized State Academic Content

Standards, Unambiguously Described Content Standards, and Standard-by-Standard Reporting . For the

first time this year, fourth and eighth grade students took a .customized. writing assessment as part of the

Wisconsin Knowledge and Concepts Examinations (WKCE); tenth grade students taking this writing

assessment as well beginning next school year. Students had to plan, write and edit a composition on a

specific topic (prompt) within a specified time frame. The writing prompts included the following

purposes: expressive writing (narrative or descriptive), informative or expository writing, and persuasive

writing. Each student.s paper will be scored based on purpose and focus, organization and coherence,

development of content, sentence fluency and word choice, and conventions (spelling, grammar, usage,

capitalization and punctuation).

This new state customized writing assessment costs more to develop than the assessments that accompany

most national standardized tests, yet we now have a test aligned with the specific knowledge and skills in

Wisconsin.s English language arts standards. This writing standard is significant, clear, testable and

teachable. In addition, the writing prompts have been developed, reviewed and field-tested in Wisconsin.

In Conclusion

 

Popham nicely summarizes the goal: .It is possible to put together a state-wide high-stakes testing

program that can simultaneously supply evidence about the quality of the state.s schools and help

teachers promote students. mastery of truly worthwhile skills and knowledge. The trick, of course, is to

employ educational tests that can fulfill an accountability function while also supplying teachers with

suitable instructional targets..

Standardized tests cannot fulfill this accountability function. Rather, they focus on comparisons (.score

spread.) among test-takers, and they are re-normed to maintain score spread---not to facilitate or

determine the effectiveness of instruction. As a result, standardized tests should not be used as a

measurement device for accountability for our schools.

The governor, state legislature and the Wisconsin Department of Public Instruction need to work together

to fully fund and develop a genuine accountability system in cooperation with Wisconsin.s schools. We

can do it!