Recent Data Coaching Session

 Do you know about different scores?

This week I visited a school to speak with lead teachers and the administrators about their interim test data. There are several data sources in the report that include I-Ready scores, DIBELS scores, and state non-standardized test scores. All of this data is collected three times per school year and put into one file.

When I prepare data in the data system, I generally convert percentile rank and percent correct scores into normal curve equivalent (NCE) scores.  As I discussed the data with the group, I began to sense that they did not know what NCE scores were and then as I questioned further, some were not clear about the difference between percentile rank scores and percent correct. 

The interpretation of scores is a critical understanding necessary for all teachers who use data to measure the learning performance of students and to identify students who are at-risk. We examined some students who were at the 45 NCE on the first test and then scored at the 30th NCE on the second interim test. While some students did better on the second test and the majority scored within a few NCE points on both tests. The decline of the 15 NCE point difference was substantial and significant at a practical level.  

Readers may wish to review this information located on this website: 

    Learn about scores and the normal curve distribution of scores

   

 

What Do Teachers Need to Know About Data?

 The question is "What do teachers need to know about data?"

Schools administer many tests and create many school reports. The administrators think this practice will help improve student performance and increase accountability test scores. This practice does not improve student performance. It is an "after the fact" activity that by the time the results are presented, the instructional train has departed the station and is now heading for the next destination. So, the question is What do teachers need to know about these tests and assessments for instruction?

Understanding Assessments

• Content validity
• Reliability
• Item analysis
• Error analysis
• Score interpretation
• Predictive value of the assessment

 Curriculum Analysis

• Intended versus enacted curriculum
• Test item weighting alignment
• Pacing guides 

Informal Assessment

• Curriculum-based assessment
• Daily direct data collection
• Reporting performance information to students

Do Teachers Need Data Skills?

 Over the past 5 years, I have trained administrators at the district and school level to understand and use student performance data (assessment  and test scores) to improve district and school performance. What i have experienced is that the information I provide to the administrators RARELY trickles down to the school lead teachers and the classroom teachers. 

Also, I have had conversations with these administrators about what professional development the district provides on the topic of data use for teachers. Unfortunately, there is very little school districts do to help teachers understand and use data and assessment strategies to improve student learning and performance. 

This blog is dedicated to the mission of informing teachers directly about how to understand and use data to make a significant positive impact on student learning. 

Welcome to my Blog,

Lewis R. Johnson, Ed.D.

  Retired Director of Accountability, Testing and Research

  Retired professor of assessment and special education

  CEO of Data Smart LLC

     Data-Smart.net