{"id":8476,"date":"2020-03-29T22:06:04","date_gmt":"2020-03-29T21:06:04","guid":{"rendered":"http:\/\/emilkirkegaard.dk\/en\/?p=8476"},"modified":"2020-04-02T09:46:54","modified_gmt":"2020-04-02T08:46:54","slug":"intelligence-and-pisa-timss-etc-at-the-individual-level","status":"publish","type":"post","link":"https:\/\/emilkirkegaard.dk\/en\/2020\/03\/intelligence-and-pisa-timss-etc-at-the-individual-level\/","title":{"rendered":"Intelligence and PISA\/TIMSS etc. at the individual level"},"content":{"rendered":"<p>There&#8217;s a large number of papers about the relationship between national intelligence and national scholastic scores, and to which degree the latter indexes the former. Some typical papers:<\/p>\r\n<ul>\r\n<li>\r\n<div class=\"gs_citr\" tabindex=\"0\">Rindermann, H. (2007). <a href=\"https:\/\/onlinelibrary.wiley.com\/doi\/abs\/10.1002\/per.634\">The g\u2010factor of international cognitive ability comparisons: The homogeneity of results in PISA, TIMSS, PIRLS and IQ\u2010tests across nations<\/a>. <i>European Journal of Personality: Published for the European Association of Personality Psychology<\/i>, <i>21<\/i>(5), 667-706.<\/div>\r\n<\/li>\r\n<li>\r\n<div class=\"gs_citr\" tabindex=\"0\">Lynn, R., &amp; Mikk, J. (2009). <a href=\"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0160289609000063\">National IQs predict educational attainment in math, reading and science across 56 nations.<\/a> <i>Intelligence<\/i>, <i>37<\/i>(3), 305-310.<\/div>\r\n<\/li>\r\n<li>\r\n<div class=\"gs_citr\" tabindex=\"0\">Meisenberg, G., &amp; Woodley, M. A. (2013). <a href=\"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0160289613000305\">Are cognitive differences between countries diminishing? Evidence from TIMSS and PISA<\/a>. <i>Intelligence<\/i>, <i>41<\/i>(6), 808-816.<\/div>\r\n<\/li>\r\n<li>\r\n<div class=\"gs_citr\" tabindex=\"0\">Jones, G., &amp; Potrafke, N. (2014). <a href=\"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S016028961400083X\">Human capital and national institutional quality: Are TIMSS, PISA, and national average IQ robust predictors?<\/a>. <i>Intelligence<\/i>, <i>46<\/i>, 148-155.<\/div>\r\n<\/li>\r\n<\/ul>\r\n<p>Because of papers like this, of which there&#8217;s 100s, it is actually quite difficult to find studies that relate scholastic tests to intelligence at the individual level since there&#8217;s no simple way to remove the national-level results from <a href=\"https:\/\/scholar.google.dk\/scholar?hl=en&amp;as_sdt=0%2C5&amp;q=national+IQ+intelligence+pisa\">the search results<\/a> (as far as I can work out!). However, John Fuerst was able to find two:<\/p>\r\n<ul>\r\n<li>\r\n<div class=\"gs_citr\" tabindex=\"0\">Sa\u00df, S., Kampa, N., &amp; K\u00f6ller, O. (2017). <a href=\"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0160289616302914\">The interplay of g and mathematical abilities in large-scale assessments across grades<\/a>. <i>Intelligence<\/i>, <i>63<\/i>, 33-44.<\/div>\r\n<\/li>\r\n<li>\r\n<div class=\"gs_citr\" tabindex=\"0\">Flores-Mendoza, C., Ardila, R., Rosas, R., Lucio, M. E., Gallegos, M., &amp; Colareta, N. R. (2018). <a href=\"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-319-89975-6.pdf\">Intelligence Measurement and School Performance in Latin America<\/a>.<\/div>\r\n<\/li>\r\n<\/ul>\r\n<p>The first reports several latent correlations, finding \u03b2 = .70 or so. The second reports some correlations between Raven&#8217;s SPM and PISA, at r = .56 or so. So the first is already adjusted for measurement error because it&#8217;s SEM based. However, the intelligence tests were pretty short, so there is some construct invalidity (i.e., it&#8217;s not measuring a broad enough <em>g<\/em>). In the second case, one has to adjust for measurement error and construct invalidity. Probably in both cases, doing these adjustments would bring up the estimated true correlation to about .80 or so. This is the typical value seen for other achievement tests and intelligence batteries in SEM. E.g.:<\/p>\r\n<ul>\r\n<li>\r\n<div class=\"gs_citr\" tabindex=\"0\">Deary, I. J., Strand, S., Smith, P., &amp; Fernandes, C. (2007). <a href=\"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0160289606000171\">Intelligence and educational achievement<\/a>. <i>Intelligence<\/i>, <i>35<\/i>(1), 13-21.<\/div>\r\n<\/li>\r\n<li>\r\n<div class=\"gs_citr\" tabindex=\"0\">Kaufman, S. B., Reynolds, M. R., Liu, X., Kaufman, A. S., &amp; McGrew, K. S. (2012). <a href=\"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0160289612000104\">Are cognitive g and academic achievement g one and the same g? An exploration on the Woodcock\u2013Johnson and Kaufman tests<\/a>. <i>Intelligence<\/i>, <i>40<\/i>(2), 123-138.<\/div>\r\n<\/li>\r\n<li>\r\n<div class=\"gs_citr\" tabindex=\"0\">Zaboski II, B. A., Kranzler, J. H., &amp; Gage, N. A. (2018). <a href=\"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0022440518301031\">Meta-analysis of the relationship between academic achievement and broad abilities of the Cattell-Horn-Carroll theory<\/a>. <i>Journal of school psychology<\/i>, <i>71<\/i>, 42-56.<\/div>\r\n<\/li>\r\n<\/ul>\r\n<p>These studies generally find r = .70 to .80, towards the latter when stronger methods are used to estimate the latent relationship instead of the observed.<\/p>\r\n<p>As a die-hard Jensenist, I will of course note that Jensen wrote <a href=\"http:\/\/The  Stanford-Binet  and  similar  intelligence tests  predict  various  measures  of  scholastic  achievement  with  an  average  validity coefficient  of  about  .5  to  .6,  and  in  longitudinal  data  comprising  intelligence7 test  and achievement  measures on  the  same  children  over a  number of years,  the multiple  correlation between  intelligence  and  scholastic  achievement  is  almost  as high as the reliability of the measures will permi\">back in 1969<\/a>:<\/p>\r\n<blockquote>\r\n<p>The Stanford-Binet and similar intelligence tests predict various measures of scholastic achievement with an average validity coefficient of about .5 to .6, and in longitudinal data comprising intelligence test and achievement measures on the same children over a number of years, the multiple correlation between intelligence and scholastic achievement is almost as high as the reliability of the measures will permit.<\/p>\r\n<\/blockquote>\r\n<p>For the reader who wants a lot more, there is a 100+ page book chapter on it from 1993:<\/p>\r\n<ul>\r\n<li>Jensen, A. R. (1993). \u201c<a href=\"http:\/\/arthurjensen.net\/wp-content\/uploads\/2014\/06\/Psychometric-g-and-Achievement-1993-by-Arthur-Robert-Jensen.pdf\">Psychometric <em>g<\/em> and achievement<\/a>\u201c. In B. R. Gifford (Ed.), <em>Policy perspectives on educational testing<\/em>. Norwell, MA: Kluwer Academic Publishers. Pp. 117-227.<\/li>\r\n<\/ul>\r\n\r\n\r\n\r\n<h3>Honorable mentions<\/h3>\r\n<p>Longitudinal studies:<\/p>\r\n<ul>\r\n<li>\r\n<div class=\"gs_citr\" tabindex=\"0\">Alb\u00e6k, K. (2017). <a href=\"http:\/\/folk.ntnu.no\/mariahar\/Workshop\/2017\/Papers\/albaek.pdf\">Skill-persistence and the impact of post-compulsory education on skills\u2013evidence from a linked PISA-PIAAC data set<\/a>.<\/div>\r\n<\/li>\r\n<li>\r\n<div class=\"gs_citr\" tabindex=\"0\">Barth, E., Keute, A. L., Sch\u00f8ne, P., von Simson, K., &amp; Steffensen, K. (2019). <a href=\"https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/00313831.2019.1659403\">NEET Status and Early Versus Later Skills Among Young Adults: Evidence From Linked Register-PIAAC Data<\/a>. <i>Scandinavian Journal of Educational Research<\/i>, 1-13.<\/div>\r\n<\/li>\r\n<\/ul>\r\n","protected":false},"excerpt":{"rendered":"<p>There&#8217;s a large number of papers about the relationship between national intelligence and national scholastic scores, and to which degree the latter indexes the former. Some typical papers: Rindermann, H. (2007). The g\u2010factor of international cognitive ability comparisons: The homogeneity of results in PISA, TIMSS, PIRLS and IQ\u2010tests across nations. European Journal of Personality: Published [&hellip;]<\/p>\n","protected":false},"author":17,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2591],"tags":[2026,2805,2804],"class_list":["post-8476","post","type-post","status-publish","format-standard","hentry","category-intelligence-iq-cognitive-ability","tag-pisa","tag-scholastic-ability","tag-timss","entry"],"_links":{"self":[{"href":"https:\/\/emilkirkegaard.dk\/en\/wp-json\/wp\/v2\/posts\/8476","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/emilkirkegaard.dk\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/emilkirkegaard.dk\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/emilkirkegaard.dk\/en\/wp-json\/wp\/v2\/users\/17"}],"replies":[{"embeddable":true,"href":"https:\/\/emilkirkegaard.dk\/en\/wp-json\/wp\/v2\/comments?post=8476"}],"version-history":[{"count":3,"href":"https:\/\/emilkirkegaard.dk\/en\/wp-json\/wp\/v2\/posts\/8476\/revisions"}],"predecessor-version":[{"id":8494,"href":"https:\/\/emilkirkegaard.dk\/en\/wp-json\/wp\/v2\/posts\/8476\/revisions\/8494"}],"wp:attachment":[{"href":"https:\/\/emilkirkegaard.dk\/en\/wp-json\/wp\/v2\/media?parent=8476"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/emilkirkegaard.dk\/en\/wp-json\/wp\/v2\/categories?post=8476"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/emilkirkegaard.dk\/en\/wp-json\/wp\/v2\/tags?post=8476"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}