Three Cheers for the Rankings!

The US News and World Report Rankings came out earlier this week. Last year I wrote “The Rankings, Meh…” This year I’m taking a different approach and cheering! I encourage you to try it out… here are a few examples of ways to use cheers in your conversations about rankings.

1 – Scoreboard! Scoreboard! I love this one. It’s like the “talk to the hand” of cheers. One of my biggest issues with rankings is their heavy reliance on surveys. #what?! Yep. Nearly a quarter of the rankings methodology is comprised of peer reviews of Academic Reputation. “The academic peer assessment survey allows top academics — presidents, provosts, deans of admissions- to account for intangibles at peer institutions, such as faculty dedication to teaching.”

To be honest, you should stop reading at the word “survey.” A survey! Think about it: do you fill out surveys? Exactly. Neither do most people. Two words: human nature. Sure, these people may have a bigger title than you but the behavior does not vary–and that’s why they call them statistics. Typical response rates are in the 20-40% range, so we know these are heavily limited from the outset. And as master delegators, you have to wonder are these presidents, provosts, and deans actually completing them personally (no disrespect to them)? And when they do, are they answering all questions, or only those they’re most familiar with? If they’re not responding, who is? And even when they do respond, how much can they truly know about all of these other places, given how frenetic their schedules are taking care of their own institution? Oh…so many questions.

At best these peer reviews are incomplete and overvalued, and at worst, myopic and nepotistic. Yet they account for 22.5% (the largest factor) of the methodology. So when you’re completing applications this fall and a friend or a parent questions your decision to apply to a school because of its spot in the rankings, simply reply, “Scoreboard!” Or better yet “Surveys!” Talk to the hand, my friend. I am discounting everything you are saying right now.

2 – Overrated! Dah, dah, dadada! 20% of the rankings methodology is based on Faculty Resources. “How do faculty salaries and the number of students in the classroom compare to other universities nationally?” So a school sees they’re penalized on this measure and ultimately determines they can move the dial by increasing their average faculty salary by $2,000 annually ($8/day), and they launch a capital campaign to address this metric. Meanwhile, they address student class size averages by hiring more adjuncts to teach courses. Their rankings rise as a result. But did those dollars actually change the student experience? Did they make the faculty more invested in their teaching or research? Knowing these types of efforts are underway nationwide, would a school being 10 or 20 spots different from another impact your decision to visit or apply? “Overrated! Dah, dah, Adadada!”

3 – Not our rival! This is one of my favorites because it’s brilliant in its dismissiveness. It’s like rolling “your momma” “whatever” and “pssht” into a single three word phrase. Student Selectivity makes up 12% of the methodology. Call me a whistle-blower, call me a cynic, but this measure is severely flawed.

First, let’s be clear: not all schools count applications the same. Some schools arguably suppress their application total (and subsequently their admit rate) by only counting fully completed files, while others count glorified inquiries (snap apps or quick apps) in their total, or bolster counts even if a student does not submit all documents or follow up to complete all parts of the application (i.e. supplements, etc.). Some schools even count visitors to campus as applicants (actually, this one is an exaggeration… at least they haven’t been busted for it yet).

Second, we know in order to increase applications many schools are buying names and mailing materials to literally hundreds of thousands of prospects, even when their class goal is less than 1000 and the composition in geography, ethnicity, gender, and curriculum is not changing over time in a significant manner.

So you don’t think I’m simply casting stones, let’s take Georgia Tech as an example. In 2017 our freshman application total was 31,500 and the admit rate was 23%. Two years earlier we received 27,250 applications and admitted 32%, nearly a 10 percentage point difference. It moved us from being among about 100 schools below 35% admit rate to about 50 schools below 25% admit rate. But I can say with certainty this measure is not reflective of the quality of education our students receive. Our student profile is essentially the same. We have not radically changed our faculty, curriculum, study abroad programs, or internship opportunities in those two years. And yet our student selectivity is what some would define as “vastly” different.

If you are reading this blog, I have no doubt this spring you’ll be sitting on multiple offers from colleges. You’re in. You’ve visited. You’ve compared the costs and trolled the deep recesses of their social media outlets. Decision time. Don’t let the admit rate and perceived selectivity be a factor in your choice. You can’t fully trust it, and other than some idle conversation in your first semester it has exactly zero bearing on your actual college experience. “Not our rival!” Or loosely translated, irrelevant.

Keep it in Perspective

We have now accounted for over half of the methodology. I’m happy to poke holes in the rest of the factors, but some of them are too easy.  What? Are you swayed by Alumni Giving? Me neither.

So what am I saying? Burn the magazine. Try Bob Morse before Congress. Both are reasonable. But I’m thinking more about changes in the micro:  I’m asking you to keep it all in perspective. If you are being told you should only apply to schools with an admit rate of 30% or less, I’m telling you to cite the Georgia Tech rule. If a friend is convinced the “Number 25” college is legitimately “better than” a school ranked 10 or even 25 spots below, remember those adjuncts, and remember the applications and admit rates are not always apples to apples. If you get into two schools and one is ranked higher, but the other gives you more aid and is by all counts a better fit for you, remember those surveys and the incredibly low response rates.

Anyone who has played a sport at a reasonably high level knows the other team is going to talk smack. They’re going to yell at you across the line. They’re going to bump and pull and jeer. So inevitably when you are applying or deciding on a college choice, someone is going to invoke the rankings this year. And when they do, you’ll be ready.

Na Na/ Na Na Na Na/ Hey Hey/ Goodbye.