About this episode

Top Episode Takeaways: 📈 Test maintenance involves regularly monitoring test and item performance statistics to ensure content remains current and secure, and should be conducted annually at minimum or as frequently as monthly for large programs. 🔍 The more frequently a test is administered, the more often maintenance should be performed, including reviewing key test-level statistics, item-level metrics, and qualitative candidate feedback to proactively identify issues. 🛠️ Typical maintenance steps include analyzing test passing rates, reliability, item difficulty, discrimination, and distractor performance, investigating qualitative trends, and engaging subject matter experts to replace problematic items following standard development procedures. Bonus Question: Can you list 3 key flags or indicators that would alert you to a problem with the maintenance of a test? Find the answer here: ⁠https://www.testcommunity.network/podcast-it-depends⁠ Connect with us:⁠⁠⁠ Amanda Dainis, PhD, MPA⁠⁠⁠ ⁠⁠⁠ https://www.linkedin.com/in/amanda-dainis-phd-mpa-012b94119/⁠⁠⁠⁠⁠⁠ Tim Burnett⁠⁠⁠ ⁠⁠⁠https://www.linkedin.com/in/tburnett/⁠⁠⁠ Ask a question: ⁠⁠ https://www.testcommunity.network/podcast-it-depends

Comments

Rate this episode

Episode Details

Author
It Depends: Understanding Psychometrics for Testing + Assessment
Show Type
full
Audio Format
audio/mpeg

We use analytics

We use Umami, a privacy-friendly analytics tool, to understand how visitors use this site. No personal data is collected and no data leaves our EU servers. You can accept or decline below. Privacy Policy