Abstract

Locally-developed measures represent great tools for institutions to use in assessing student outcomes. Such measures can be easy to administer, can be cost-effective, and can provide meaningful data for improving student learning. However, many institutions struggle with questions surrounding the quality of their locally-developed assessments. Are their instruments reliable? Are their instruments valid? Can the data generated from these instruments be trusted to drive change and improvement? The good news for faculty, staff, and assessment professionals is that there are steps they can take to address these concerns and help to ensure the validity and reliability of their processes. This article describes the development and testing of a novel research instrument of students’ attitudes and abilities relating to critical thinking, metacognition, and intellectual humility. Using a $1,000 assessment grant from Sam Houston State University (SHSU), Dr. Glenn Sanford and Dr. David Wright devised the early drafts of the instruments, collaborated with colleagues, and joined with Mr. Jeff Roberts, Director of Assessment at SHSU, to develop and to test this new instrument. What follows is a description of the development of the resulting research instrument, results from the factor analysis and reliability testing of that instrument, and an overview of how those results have been used to make further instrument improvements.