Blog

A little compilation since I get many questions about these.

ICAR (International Cognitive Ability Resource), cognitive items. Public domain but not open

This is probably the largest project of open cognitive ability/intelligence items. ICAR, cognitive items. Public domain (not copyrighted) but hidden away. Some key publications:

• Condon, D. M., & Revelle, W. (2014). The International Cognitive Ability Resource: Development and initial validation of a public-domain measure. Intelligence, 43, 52-64.
  • Initial validation of 60 items.
• Condon, D. M., & Revelle, W. (2016). Selected ICAR data from the SAPA-Project: Development and initial validation of a public-domain measure. Journal of Open Psychology Data, 4(1).
  • Data release paper from SAPA project.
• Young, S. R., Keith, T. Z., & Bond, M. A. (2019). Age and sex invariance of the International Cognitive Ability Resource (ICAR). Intelligence, 77, 101399.
  • Invariance testing
• Dworak, E. M., Revelle, W., Doebler, P., & Condon, D. M. (2020). Using the International Cognitive Ability Resource as an open source tool to explore individual differences in cognitive ability. Personality and Individual Differences, 109906.
  • Perspectives. It’s annoying that the authors pretend to be ‘open source’, when actually it is closed access. The items are NOT public!
  • Variant paper of above: Revelle, W., Dworak, E., & Condon, D. Cognitive ability in everyday life: the utility of open source measures.

To get the items, one has to go to icar-project.com register, and then get approved. Although this doesn’t cost any money, it is a barrier.

Their website also hosts a very long list of other PDFs, mainly slides from conferences and unpublished papers. As of writing, Google finds 813 PDFs on the site.

Other cognitive items

Some papers:

• Weller, J. A., Dieckmann, N. F., Tusler, M., Mertz, C. K., Burns, W. J., & Peters, E. (2013). Development and testing of an abbreviated numeracy scale: A Rasch analysis approach. Journal of Behavioral Decision Making, 26(2), 198-212.
  • Copyright status unclear, but items are open.
• Chierchia, G., Fuhrmann, D., Knoll, L. J., Pi-Sunyer, B. P., Sakhardande, A. L., & Blakemore, S. J. (2019). The matrix reasoning item bank (MaRs-IB): novel, open-access abstract reasoning items for adolescents and adults. Royal Society Open Science, 6(10), 190232.
  • Raven’s replacement
• Loe, B. S., Sun, L., Simonfy, F., & Doebler, P. (2018). Evaluating an Automated Number Series Item Generator Using Linear Logistic Test Models. Journal of Intelligence, 6(2), 20.
  • Automatic item generation
• Openpsychometrics.org: ” This website provides a collection of interactive personality tests with detailed results that can be taken for personal entertainment or to learn more about personality assessment. These tests range from very serious and widely used scientific instruments popular psychology to self produced quizzes. A special focus is given to the strengths, weaknesses and validity of the various systems. ”
  • Public data too. I am not sure about the copyright status of their items.
• Our own science knowledge questions database
  • As of writing, 260 items, some of which have been validated. Work in progress.

Non-cognitive items

Some papers:

• Pozzebon, J. A., Visser, B. A., Ashton, M. C., Lee, K., & Goldberg, L. R. (2010). Psychometric characteristics of a public-domain self-report measure of vocational interests: The oregon vocational interest scales. Journal of Personality Assessment, 92(2), 168-174.
• Condon, D., & Revelle, W. (2015). Selected personality data from the SAPA-Project: On the structure of phrased self-report items. Journal of Open Psychology Data, 3(1).
  • Data release paper from SAPA, based on IPIP items.
  • More on the same: Condon, D. M., Roney, E., & Revelle, W. (2017). A sapa project update: On the structure of phrased self-report personality items. Journal of Open Psychology Data, 5(1).
• IPIP website: “This is the official website for the International Personality Item Pool (IPIP). The site includes over 3,000 items and over 250 scales that have been constructed from the items. New items and scales are developed on an irregular basis. The items and scales are in the public domain, which means that one can copy, edit, translate, or use them for any purpose without asking permission and without paying a fee. However, the grant that supported the creation of this website has expired, so if you find the IPIP website useful, we ask you to consider making a donation through the link below.”

Worth mentioning

• Pahor, A., Stavropoulos, T., Jaeggi, S. M., & Seitz, A. R. (2019). Validation of a matrix reasoning task for mobile devices. Behavior research methods, 51(5), 2256-2267.
  • Not open