<p>Of course many smaller, less well-known colleges will get on the bandwagon because joining the boycott at this juncture will indeed act as yet another sort of a badge of distinction. Don't think there is anything cynical about it at all since much of the jockeying to get off, sit on or straddle the fence has to do with marketing and enrollment management strategies as in Moore's "The rising tide: "branding" and the academic marketplace".</p>
<p>More interesting comments on the inside higher ed site. include one from Joseph Soares. I completely agree with Carolyn that "Colleges can do better". Let's hope they will.</p>
<p>There's also some very thoughtful discussion on the threads that have been linked from the insidehighered article. (No offense to CC posters ;)</p>
<p>Maybe the most fascinating is a rating scheme for graduate programs that I'd never seen. It allows the user to assign their own importance to various factors and have an algorithm produce a rating based on their own fit-profile. Kind of like the sleep-number bed. Fun, ingenious, and at least a step in the right direction:</p>
<p><a href="http://graduate-school.phds.org/%5B/url%5D">http://graduate-school.phds.org/</a></p>
<p>The battle for the hearts and minds of John Q. Consumer heats up </p>
<p>Washington Post article by Valerie Strauss in the Washington Post "Some Colleges Want to Curb Flow of Data to Magazine":</p>
<p>and Business Week dishes out some interesting new tidbits with "More Opposition to U.S. News Rankings: The number of college presidents coming out against the annual list has doubled as a new survey using new methods is bandied about"</p>
<p>FWI, The American Association of Colleges and Universities site is a rich repository for resources on trends and key debates in undergraduate liberal education. In particular, an article in the Peer Review, Winter/Spring 2002 "Looking Where the Light Is Better: A Review of the Literature on Assessing Higher Education Quality" addresses head on many of the topics bandied about on this thread.</p>
<p>Also of interest when it comes to the national conversation on assessment and ranking alternatives is the Hechinger Institute on Education and the Media at Columbia Univeristy which "exists to equip journalists with the knowledge and skills they need to produce fair, accurate and insightful reporting". </p>
<p>Special free report in the Chronicle of Higher Education "Playing the Rankings Game: Many college officials are asking hard questions about the methodology and effect of the 'U.S. News' rankings. One complaint: The survey overwhelmingly favors private institutions." by Elizabeth Farrell and Martin van de Werf. Article does address the pesky question "who really cares what the rankings say".</p>
<p>other articles in the special report:</p>
<p>Rankings Methodology Hurts Public Institutions</p>
<p>What the Rankings Do for 'U.S. News'</p>
<p>fast facts: U.S. News Rankings Through the Years
<a href="http://chronicle.com/stats/usnews/%5B/url%5D">http://chronicle.com/stats/usnews/</a></p>
<p>and for those Monopoly fans out there: "How to win the game"</p>
<p>Thanks for all the links.</p>
<p>Robert Morse, the research guy for the college rankings, has started a blog dedicated to defending the rankings:</p>
<p>The first two entries are not very dramatic, one on the CDS and another on NSSE (with a link to USNews's useful site of NSSE surveys from colleges that have made them public).</p>
<p>Good update from Bloomberg news - the number of college president signatures is now 60 and include Holy Cross, Lafayette, and Trinity College, CT. According to the article, at this time Williams College is still "pondering" whether or not to sign the boycott letter - not a surprise since the college derives a tremendous benefit from the US News line-up. Apparently, however, the college does plan to downplay the rankings game no matter how it is played- and in future will not mention survey results in its sports information or admissions brochures. Wellesley College has not signed on but will continue to sit out on the peer review as it has done for over a decade. Last month Barnard College opted out - Barnard's president Judith Schapiro agrees with the gist of the boycott letter but at this point she finds it prudent to play the waiting game a while longer. Swarthmore is "actively reviewing" its position and future participation in the peer review.</p>
<p>Good point made about the publicity angle of all of this touched on a few posts back on this thread:</p>
<p>
[quote]
Other schools, including Davidson College in North Carolina, may continue cooperating with U.S. News. Davidson is tied for 10th in liberal arts with Wesleyan University in Middletown, Connecticut.</p>
<p><code>A college like Davidson is looking for national exposure,'' said spokesman Bill Giduz. Thomas Ross, the incoming president of Davidson,</code>recognizes there are flaws in the system,'' Giduz said, ``but it's kind of the only game in town.''
[/quote]
</p>
<p>Of course, for the many schools that have joined Lloyd Thacker, any publicity is better than none at all. Haven't the schools discovered that making a statement about joining the "movement" might be the only way to garner a bit of national exposure. </p>
<p>Others such as Reed have made a career of broacasting their resistance to the mighty USNews. </p>
<p>On the other hand, I was floored to read that "Wellesley College has not signed on but will continue to sit out on the peer review as it has done for over a decade." Since I routinely included Wellesley in my lists of PA abusers (geographical and gender cronyism) I'll have to change my tune. From now on, I'll assume that Wellesley receives praise better than it doles it out. Could it possible that the leftovers of the "Seven" Sisters might review their scores in 2008? Tits for tats?</p>
<p>
[quote]
Others such as Reed have made a career of broacasting their resistance to the mighty USNews.
[/quote]
And the results are positive, if indeed linked. Far from committing the predicted suicide, Reed has thrived since first taking the public stand in 1995. Perhaps some schools now see that resisting one-size-fits-all rankings is not dangerous.</p>
<p>Great for Reed; </p>
<p>But it could have been different had USNews merely granted Reed's wish of NOT being listed. A wish I also wish USNEWs would honor, and in the same vein, give the boot to all the manipulators and complainers. </p>
<p>Were USNews to provide a mere listing of the unrankables, it would make the yearly editions so much fun to read. Especially, reading how colleges would scramble to get out of that list would be worth the 15 bucks.</p>
<p>Fun to read indeed and at this point in the game, I won't be at all surprised if USNWR sales soar when the college edition hits the newsstands next month. After all, it is not just the colleges that are making hay when it comes to free publicity. While some college presidents are playing the waiting game to see what the alternative will be, parents and student consumers are also waiting, and at this point, either disengaged and/or not just a little confused by all of this. We can only hope that clear points will be made with the proposed alternatives that aim to eschew rankings and honor accountability and transparency as we await the appearance of the rankings alternatives that are in the works - such as U-CAN, announced to be ready to launch in Sept. All in all, USNWR is holding up quite well in this national rankings/nonrankings conversation. Case in point, a recent article in the Philly Inquirer online which neatly features a direct link to USN webpage.</p>
<p>Interesting piece by an Amherst alum in the Am'herst hits on some provacative points:</p>
<p>
[quote]
...Lloyd Thacker head of the Education Conservancy is hoping for schools like Williams and Amherst to join.</p>
<pre><code>Yeah, I would like a big-name person to step up to the plate, Thacker said. Im waiting for that.
</code></pre>
<p>But that statement suggests an odd situation and a bad bargaining position for Thacker and the 61 presidents: the schools supporting the boycott need the support of the very schools they imply are inaccurately ranked.</p>
<p>While its fair to criticize the US News rankings for being arbitrary and its fair to criticize Amherst (and alumni, like me, who think Tony Marx should take a pocket veto on this one) of being disinterested due to the fact Amherst is ranked second, its also fair to ask the presidents of the boycotting colleges what their alternative ranking system would entail and what the order of the schools would look like under it. In the world of higher education, it is poor form to openly suggest that you should be ranked higher than Liberal Arts College B; the cynic in me thinks that attacking the methodology of the US News rankings gives the 61 presidents a more polite way to suggest those very same thoughts.
[/quote]
</p>
<p>A few new tidbits in this story, which is being discussed in the Wesleyan forum:</p>
<p>Maybe the most interesting is a quote from a U. S. News spokesperson: " if certain schools aren't ranked [via the peer assessment] by enough other institutions, they'll be moved to a separate unranked category, the magazine says." That represents a change in the party line, which used to be along the lines of "we'll just get the PA from guidance counselors, or some group other than college administrators if the PA response rate falls too low."</p>
<p>It's hard to know whether to read that statement as an admission that the boycott could actually have a significant effect on next year's rankings or whether it implies exactly the opposite, essentially a challenge: "if you second tier LACs want to pull out, you take a chance that the free advertising you get from being among our top 100 may go away."</p>
<p>In the AACU article cited above, one methodology used to assess the quality of higher education was a direct assessment of student learning. Awk! Does that mean standardized testing??? Oh no!!!!</p>
<p>Joking aside, in my undergrad days all students in our CivilEng departmentwere expected to take the Engineering in Training examination administered by the Ohio State Board of Professional Engineers. Department records indicated that we had a 100% pass rate four strait years and I think my class aced the exam as well.</p>
<p>I have always thought that was a good measure of the quality of education which I received.</p>
<p>
[quote]
Maybe the most interesting is a quote from a U. S. News spokesperson: " if certain schools aren't ranked [via the peer assessment] by enough other institutions, they'll be moved to a separate unranked category, the magazine says." That represents a change in the party line, which used to be along the lines of "we'll just get the PA from guidance counselors, or some group other than college administrators if the PA response rate falls too low."
[/quote]
</p>
<p>Too bad that does not read </p>
<p>"if certain schools continue to play ranking games with USNews, they'll be moved to a separate unranked category, the magazine says."</p>
<p>Too bad. Just too bad!</p>
<p>On the eve of the great unveiling of the 2008 edition of the US News rankings I just can't help posting this little blast from the past - 1998- when Barnard President Judith Shapiro compared the ranking service "to the proverbial drunk who looks for his car keys under the lamppost, not because he has lost them there, but because that is where the light is good."</p>
<p>
[quote]
Often, U.S. News refines and changes its methodology. While this is intended as an expression of responsiveness to critics and seriousness of purpose, the upshot can, in fact, be wild and bizarre swings from one year to the next in an institution's ranking. This may leave the public with an impression that an institution has undergone a fundamental change, when such a change could not possibly have taken place over the period in question. Over the past four years, Barnard has ranked anywhere from 23rd to 32nd in the listing of best national liberal arts colleges; this year we ranked 27th. Johns Hopkins University, to take another example, went from being the 22nd- best national university three years ago, to 10th-best two years ago, to the 15th-best last year. Such a ranking system certainly does more harm than good in terms of educating the public.</p>
<p>Of course, U.S. News isn't in the public service business--it's in the business of selling magazines. Since 1984, when it began rating more than 1,200 accredited four-year colleges, including 400 national universities and liberal arts colleges, its guide has become the national best-seller (I think of it as the equivalent of Sports Illustrated's swimsuit issue). During this time, U.S. News has done an excellent job of capitalizing on America's penchant for ratings and being number one, and also on the high anxiety that surrounds the process of applying to college. So, while those responsible for the survey are always stating that they want to be receptive to comments from colleges and universities about ways to make their study better, they are never going to abandon their rating system, regardless of how many educational institutions urge them to do so....
[/quote]
</p>
<p>and from the USN blog:"How We Check the Rankings Data"</p>
<p>FWIW, according to the barrage of articles blitzing the media this past week, the number of colleges signed on to boycott is up to 62.</p>
<p>One thing is for sure in all of this - a lot of folks will be checking out the new edition no matter what side of the fence they may be standing or sitting on.</p>
<p>Good overview article in Inside Higher Ed "Refusing to Rank"</p>
<p>
[quote]
Robert Morse... said that...he felt confident that enough people were still participating to make the survey valid. He declined, however, to say what level was necessary to sustain the surveys reliability...
[/quote]
</p>
<p>Transcript of recent PBS Online NewsHour debate on college rankings with LT of the EC and BK of USNWR.</p>
<p><a href=“http://www.pbs.org/newshour/bb/education/july-dec07/rankings_08-20.html[/url]”>http://www.pbs.org/newshour/bb/education/july-dec07/rankings_08-20.html</a></p>
<p>
</p>
<p>highly subjective peer assessment and questinable weighting of a questionable set of factors is not journalism…well, Maybe it might be yellow journalism.</p>