To submit your questions ahead of time by Friday , May 13th, please click here.
Target Audience: District data team including LEA principals, Assessment Coordinators, Special Ed Supervisors, Special Education Data Managers and PIMS Administrators
Times: 9:00 a.m. - 12:00 p.m.
Arrival and Check in 8:45 a.m. – 8:55 a.m.
PSSA and Keystone Exam Data Forensics - Dr. Ross Blust; Consultant, Data Forensics and Course Data
Please note, this session was presented at the 2015 Data Summit.
The Pennsylvania Department of Education selected individuals to conduct Data Forensics analyses of the PSSA and Keystone Exam data. Specifically, the PSSA and Keystone Exam student data were analyzed looking for outliers. Outliers were those schools and/or students with scores not considered statistically likely to occur. Having an outlier score, facilitated the review of the data from thousands of schools and hundreds of thousands of students. The analyses included an examination of the wrong to right (WR) answer changes. Overall, students were found to make few to no changes in their answers for PSSA and the Keystone Exam. Hence, it was possible to detect when many students with many WR changes in answers were present in a specific school, grade, and subject. The Data Forensics work examined the change in student performance across years at the school, grade, and subject level. Both cohort and non-cohort data were considered for the PSSA and Keystone Exam. Student performance was based on the scaled scores and the four performance levels. The student performance data were summarized at the levels noted. An outlier score was calculated to assist with reviewing the data for thousands of schools. The approach employed was rather conservative statistically. It was an effort to avoid false positives (Type I Error). The conservative approach was evident in the calculation of the outlier scores. Recognition and thanks needs to be offered to two other state government agencies supporting the Data Forensics effort. Both the Office of the Inspector General and the Office of the Attorney General worked with the Data Forensics staff. The support provided included working on investigations and with criminal prosecutions. As a result of the work over three years, the student scores appeared to be closer to true and accurate scores. Student scores have become more consistent at the school, grade and subject level. Few outlier scores were found to be statistically significant
Special Education July Collection - Exiting, Discipline and Staff - Jodi Rissinger and Dan Ficca
Review of reporting guidance for the PIMS Special Education Exit Collection and PennData year-end reporting. (Discipline and Staff reporting)