Scraping IMDB user ratings

There are some sites that have scraped the average movie ratings at various sites such as IMDB, Rotten Tomatos and Allmovies. Here is one particularly good (and still online) job. Still, this is all aggregate data. Perhaps we are more interesting in how people rate movies. One does have the option to make one’s profile…

Continue Reading

Personal freedom and cognitive ability: OKCupid dataset replication

Noah Carl has been investigating the relationship between cognitive ability and political opinions aside from the usual confused 1-axis left-right model. Specifically, looking at the economic freedom and personal freedom axes (á la this test). He did this in two datasets so far, covering the UK and the US: Verbal intelligence is correlated with socially…

Continue Reading

Aarhus University’s reply to SJW letter

In the fallout of the OKCupid dataset release, some people wrote a complaint letter to Aarhus University. I haven’t read the letter, but Aarhus University has now replied to it: Reply to Oliver Keyes et al Basically, the letter affirms everything I’ve already said, namely: University was not involved, so: Their ethics rules do not…

Continue Reading

Testing colorism using genomic data without phenotypic data

Normally, testing colorism or other causal models of why human racial traits have nonzero relationships to socioeconomic outcomes requires that one has the following data: Measure of racial ancestry Measures of racial appearance Measures of socioeconomic outcomes such as income or educational attainment Path model wise, one can think of it this way: Discrimination models…

Continue Reading

OKCupid paper

OSF has now suspended the entire repository, not just deleted the user datafile. Not sure why this is the case. The paper (PDF) is available here. Edited to add: The repository is closed due to a DMCA request sent by OKCupid which is currently being investigated. Edited to add2: For those wondering what information was in…

Continue Reading

Crime/violence, gender, sexual orientation, cognitive ability

In a recent paper, Beaver et al looked at the relationships between crime, gender and sexual orientation: This study examined the association between sexual orientation and nonviolent and violent delinquency across the life course. We analyzed self-reported nonviolent and violent delinquency in a sample of heterosexual males (N=5220–7023) and females (N=5984–7875), bisexuals (N=34–73),gay males (N=145–189),…

Continue Reading