World University Rankings – Information or Noise

Messing around with some of the results available from the Times Higher Education World University Rankings website, it’s interesting to note that near the top of the ranking over the years, things stay relatively stable, and further down there’s quite a bit of variation. In an ideal world, all the datasets would be available for download and easily manipulable (transparency!) but this is not yet the case. Anyway, doing some work for work, here’s a selection of a few institutions with their ranks plotted from the last THE-QS ranking in 2009-2010, to the most recent THE(-TR) ranking for 2013-2013.

There’s quite a bit of change from 2009-2010 to 2010-2011, when THE split from QS (or vice versa). This split resulted in a change in methodology and weightings, but things have not yet settled down, because weightings have either continued to change (though they have stayed the same since 2011 and 2012 it seems), but as Andrejs Rauhvargers notes (pdf), “the scores of all indicators, except those for the Academic Reputation Survey [...] have been calucalted differently.” As well as this, in a recent journal article (“Where Are the Global Rankings Leading Us? An Analysis of Recent Methodological Changes and New Developments”), Rauhvargers notes that the THE doesn’t/won’t publish the scores of its 13 indicators. Transparency! Anyway, for what its worth, here are some pretty pictures that illustrate the noisiness of the rankings. Just fooling around with the data to see if I will return to this with the data for the full top 200 over the past 5 years.

New Picture New Picture (4)

About these ads

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s