Harvard's Fitzsimmons on transcripts: "what you see is often not what you get"

<p>Interesting article on the College Board's attempt to regulate use of the "AP" label on high school transcripts: </p>

<p><a href="http://www.nytimes.com/2007/07/18/education/18ap.html%5B/url%5D"&gt;http://www.nytimes.com/2007/07/18/education/18ap.html&lt;/a> </p>

<p>
[quote]
And even in legitimate College Board AP courses, it’s hard to know what was taught until one sees the exam results.

[/quote]
</p>

<p>Just more proof of how bogus the Newsweek high school rankings are.</p>

<p>the Newsweek rankings are based on the number of AP courses a school offers?</p>

<p>"And even in legitimate College Board AP courses, it’s hard to know what was taught until one sees the exam results."</p>

<p>-does that mean that colleges put at least some weight on AP scores?</p>

<p>Well, they do if you are so inclined to send your scores to them. It's hard not to acknowledge a string of 4's and 5's on AP exams. But again, the reason why APs are not a universal requirement is because not all schools offer them, and there are great disparities in the number and type of APs offered at each school. I know that one of my friends here at Harvard had no APs because nobody ever went to college. I know that another friend took a great number of APs because his school offered them. They really do put it into context.</p>

<p>
[quote]
the Newsweek rankings are based on the number of AP courses a school offers?

[/quote]
</p>

<p>The Newsweek rankings are based exclusively on number of AP/IB exams taken divided by number of seniors graduated. It's kind of absurd.</p>

<p>
[quote]
The Newsweek rankings are based exclusively on number of AP/IB exams taken divided by number of seniors graduated. It's kind of absurd.

[/quote]
</p>

<p>That is an absurd system for rating high schools, and all the more so because until recently it systematically excluded magnet schools for gifted students. And yet the school rated highest by that method in my state is, by all local accounts, a very good high school, and definitely a school that is on the radar screen of the Harvard admission office, as graduates of that school go to Harvard pretty nearly every year.</p>

<p>I remember reading something on this forum that even the founder of the ranking system, Jay Mathews, said that he created this ranking system to create meaningful discussion about these so-called ranking systems (the most notable obviously being the U.S. News Rankings).</p>

<p>Interpret that as you will.</p>

<p>Funny comment, xjayz. Yes, I'm not sure that Jay Mathews really has a lot of his own credibility invested in the high school rankings, but they do get people talking.</p>

<p>
[quote]
The Newsweek rankings are based exclusively on number of AP/IB exams taken divided by number of seniors graduated. It's kind of absurd.

[/quote]
</p>

<p>It's not bad as a one-number summary. Like any other simple measurement, it has a decent correlation with the "quality" (whatever that is) of the school, some obvious defects, and some room for manipulation.</p>

<p>Actually, it is an absurd method for "ranking", since it credits the school for the students taking AP exams, not for the students learning anything. </p>

<p>If every student in the school took 4 AP exams every year, and every student failed every exam, the school would be at the top of the ranking. </p>

<p>There are obvious ways to take into account the scores students get on the exams, and the board actually does this. The Matthews index is simply a shill to promote taking the tests. </p>

<p>It is truly meaningless.</p>

<p>My high school went up in the rankings this past year. It doesn't seem to matter that the average AP student score at my high school is below 3!</p>

<p>In fact the fastest way for a school to go up in the rankings is for it to encourage students to take AP exams, whether or not they have taken AP courses. Get your freshmen in remedial math to take the BC calculus exam and your school score will go up.</p>

<p>That's why I think xjayz's reply has it about right: Jay Mathews came up with a fairly easily manipulated rating scheme, but perhaps he doesn't care much to refine it greatly, because his real point is that other rating schemes are also subject to manipulation.</p>

<p>I hope you are right, but I have seen him hawking this as if it meant something.</p>

<p>the Times article does raise an important point about students and families perhaps being told they are getting a college level course when they are not.</p>

<p>I love the way this blog post deals with the Newsweek formula:</p>

<p>
[quote]
...let’s consider a hypothetical school, Monkey High, where all of the students are monkeys. As principal of Monkey High, I require my students to take at least one AP test. (Attendance is enforced by zookeepers.) The monkeys do terribly on the test, but Newsweek gives them credit for showing up anyway. My monkey students don’t learn enough to earn a high school diploma — not to mention their behavioral problems — so I flunk them all out. Monkey High gets an infinite score on the Newsweek formula: many AP tests taken, divided by zero graduates. It’s the best high school in the universe!

[/quote]
</p>

<p>(from here</a>)</p>

<p>The post also quotes Jay Matthews attempting to argue that there is inherent value in simply taking the AP tests, regardless of scores, and that it is laudable that some districts pay for and mandate the tests, because "*t gives students a necessary taste of college trauma." ...sure.</p>

<p>
[quote]
Actually, it is an absurd method for "ranking" ...
If every student in the school took 4 AP exams every year, and every student failed every exam, the school would be at the top of the ranking.

[/quote]
</p>

<p>I think the point is that this is a number that's:
- very easy to gather by calling schools or looking at their web sites,
- no worse than other criteria such as spending per pupil or student-teacher ratio
- based directly on an academic parameter (AP tests) not a financial one</p>

<p>The more correct measurements, such as AP points per student or per capita number of high scores, are harder to obtain. High schools may not have the data or legal restrictions might prevent them from providing it.</p>

<p>The College Board has all that data, and uses it to publish a report on percent of students scoring 3 or better by state. It also identifies schools with the highest proportion of students scoring this high among all students (not just those who took the test). So the information is available, which makes this Matthews ranking all the more pointless.</p>

<p>I would like to see a report like the one afan mentions. It happens that the school in my state that ranks highest on the Mathews list is a school I was in just yesterday to do some math coaching for middle-school-level pupils, and I know enough involved parents at that school to have seen the AP reports for the various science tests offered there. Not all of the scores are 5s, by far, but apparently the school's general tendency to encourage students to take AP courses rather than easier courses pays off when those students go to college--they sometimes find their college work rather easy, depending on where they go. The highly competitive atmosphere at that high school results in a fair amount of "fratricide" among the students there, as a student who, in overall statewide terms, would be considered a fine student discovers his class rank is only in the middle of the class. Harvard's admission office has LOTS of experience reading transcripts and counselor statements from that school, and knows well how to identify the stars there. But a lot of solid, middle-of-the-pack students there have iffy times getting into schools that admit "by the numbers," if class rank plays too large a role in the admission formula.</p>

<p><a href="http://www.collegeboard.com/press/releases/152694.html%5B/url%5D"&gt;http://www.collegeboard.com/press/releases/152694.html&lt;/a&gt;&lt;/p>

<p>full report cited in the press release, or found (html) at <a href="http://pdfdownload.bofd.net/pdf2html.php?url=http%3A%2F%2Fwww.collegeboard.com%2Fprod_downloads%2Fabout%2Fnews_info%2Fap%2F2007%2F2007_ap-report-nation.pdf%5B/url%5D"&gt;http://pdfdownload.bofd.net/pdf2html.php?url=http%3A%2F%2Fwww.collegeboard.com%2Fprod_downloads%2Fabout%2Fnews_info%2Fap%2F2007%2F2007_ap-report-nation.pdf&lt;/a&gt;&lt;/p>

<p>but better to follow the link to the pdf</p>

<p>Thanks for the link, afan. </p>

<p><a href="http://www.collegeboard.com/prod_downloads/about/news_info/ap/2007/2007_ap-report-nation.pdf%5B/url%5D"&gt;http://www.collegeboard.com/prod_downloads/about/news_info/ap/2007/2007_ap-report-nation.pdf&lt;/a&gt;&lt;/p>