{"id":6732,"date":"2017-05-25T14:50:04","date_gmt":"2017-05-25T13:50:04","guid":{"rendered":"http:\/\/emilkirkegaard.dk\/en\/?p=6732"},"modified":"2017-05-25T14:50:04","modified_gmt":"2017-05-25T13:50:04","slug":"the-sampling-problem-with-meta-analyses-of-jensens-method-findings","status":"publish","type":"post","link":"https:\/\/emilkirkegaard.dk\/en\/2017\/05\/the-sampling-problem-with-meta-analyses-of-jensens-method-findings\/","title":{"rendered":"The sampling problem with meta-analyses of Jensen&#8217;s method findings"},"content":{"rendered":"<p>I have been complaining to colleagues about this one for several months. Of the various criticisms of this method, I don&#8217;t recall one pointing out this problem. I don&#8217;t have time to do some simulations right now, but I did some quick illustrations.<\/p>\n<p>The same problem holds for the item-level analyses (these are done <a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0160289616303233\">using the wrong method as well<\/a>, <a href=\"http:\/\/rpubs.com\/EmilOWK\/230077\">but there&#8217;s an easy fix<\/a>). Fortunately, the <em>Vietnam Experience Study<\/em> dataset &#8212; forthcoming Kirkegaard, Nyborg et al collaboration, <a href=\"http:\/\/rpubs.com\/EmilOWK\/VES_dataset_paper\">some output here <\/a>&#8212;\u00a0 allows one to study the matter at test and item level using a mixed selection of about 20 tests (some are from WAIS, others from ASVAB, others ad hoc), as well as item level data (&gt;100 items).<\/p>\n<p><a href=\"http:\/\/emilkirkegaard.dk\/en\/wp-content\/uploads\/The-problem-with-meta-analyses-of-Jensens-method-findings-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-large wp-image-6733\" src=\"http:\/\/emilkirkegaard.dk\/en\/wp-content\/uploads\/The-problem-with-meta-analyses-of-Jensens-method-findings-1-1024x768.png\" alt=\"\" width=\"720\" height=\"540\" \/><\/a> <a href=\"http:\/\/emilkirkegaard.dk\/en\/wp-content\/uploads\/The-problem-with-meta-analyses-of-Jensens-method-findings-2.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-large wp-image-6734\" src=\"http:\/\/emilkirkegaard.dk\/en\/wp-content\/uploads\/The-problem-with-meta-analyses-of-Jensens-method-findings-2-1024x821.png\" alt=\"\" width=\"720\" height=\"577\" \/><\/a> <a href=\"http:\/\/emilkirkegaard.dk\/en\/wp-content\/uploads\/The-problem-with-meta-analyses-of-Jensens-method-findings-3.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-large wp-image-6735\" src=\"http:\/\/emilkirkegaard.dk\/en\/wp-content\/uploads\/The-problem-with-meta-analyses-of-Jensens-method-findings-3-1024x759.png\" alt=\"\" width=\"720\" height=\"534\" \/><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>I have been complaining to colleagues about this one for several months. Of the various criticisms of this method, I don&#8217;t recall one pointing out this problem. I don&#8217;t have time to do some simulations right now, but I did some quick illustrations. The same problem holds for the item-level analyses (these are done using [&hellip;]<\/p>\n","protected":false},"author":17,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1839],"tags":[2253,1755,2036],"class_list":["post-6732","post","type-post","status-publish","format-standard","hentry","category-psychometics","tag-jensens-method","tag-meta-analysis","tag-method-of-correlated-vectors","entry"],"_links":{"self":[{"href":"https:\/\/emilkirkegaard.dk\/en\/wp-json\/wp\/v2\/posts\/6732","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/emilkirkegaard.dk\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/emilkirkegaard.dk\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/emilkirkegaard.dk\/en\/wp-json\/wp\/v2\/users\/17"}],"replies":[{"embeddable":true,"href":"https:\/\/emilkirkegaard.dk\/en\/wp-json\/wp\/v2\/comments?post=6732"}],"version-history":[{"count":1,"href":"https:\/\/emilkirkegaard.dk\/en\/wp-json\/wp\/v2\/posts\/6732\/revisions"}],"predecessor-version":[{"id":6736,"href":"https:\/\/emilkirkegaard.dk\/en\/wp-json\/wp\/v2\/posts\/6732\/revisions\/6736"}],"wp:attachment":[{"href":"https:\/\/emilkirkegaard.dk\/en\/wp-json\/wp\/v2\/media?parent=6732"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/emilkirkegaard.dk\/en\/wp-json\/wp\/v2\/categories?post=6732"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/emilkirkegaard.dk\/en\/wp-json\/wp\/v2\/tags?post=6732"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}