<p>That sounds nice, red sox 7327, but it is a little naive. Should a blind person have to take the test without the benefit of Braille or a reader? </p>
<p>Unfortunately, red sox 7327, although the Sox are a great baseball team, I think you are fundamentally wrong. The point of standardized tests is to measure one or more underlying variable or factor and they are designed to measure that factor or factors. If someone is blind, you don’t get a measure of the factor unless you give them the test in Braille or read it to them. If you don’t, the results are not standardized and are thus not useful. They used to give IQ tests in English to non-English speaking immigrants and then conclude that the whole group of immigrants was stupid. The primary stupidity was that of the person making an assessment of IQ using an English language test for non-English speakers.</p>
<p>Similarly, if you gave John Bardeen your version of a standardized test without extra time, he’d do badly. (See my post above). This would not provide an good estimate of the underlying factor the schools actually want to measure (or at least the test designer was seeking to measure). </p>
<p>If you want to administer a test that for a substantial fraction of the population that provides a biased estimate of the underlying factor it is trying to measure, you are not doing much that is useful. If all you want is some kind of screening device that doesn’t measure much that is useful, OK. But, if you are really trying to assess problem-solving ability or analytical capability, it doesn’t make a whole lot of sense to rule out people who are strong on those factors because you have given the test in such a way that it provides biased estimates. </p>
<p>Why do you want the screening mechanism for college admission to be one that will keep out John Bardeen and others like him just because he needs extra time to get the truly deep analytical thoughts out? There haven’t been a whole lot of Nobel prize winners in physics. There have been an extremely small number who have one two and I think only one who won one prize for an invention (the transistor) and the other for theory (superconductivity). He’s an extreme case, but there are a reasonable number of people with very high IQ’s or otherwise significant talent for whom taking the test under the normal conditions does not provide a measure of their problem-solving or analytical ability. Why would you want a mechanism that rules them out? </p>
<p>If your primary aim is to select people who can work fast rather than people who work well, then not providing accommodations to kids with processing speed-related learning disabilities or language related learning disabilities, your approach works just fine. For a significant part of the population, speed and a certain kind of academic talent are reasonably correlated. But, there are a bunch of other folks who are really bright and talented but cannot produce the results quickly. If you want to actually learn something about this, take a look at a book called Proust and The Brain written a Maryanne Wolf, a Tufts professor who studies the neuroscience of the reading brain. I have heard her argue that in general, dyslexics (who do a lot more processing in their right hemisphere) have tended to be our leaders and generals. Their strength is in pattern recognition, which is, I think, a large component of IQ. Many of these folks learn to read, but do so slowly because they are using the right hemisphere rather than the left hemisphere for some of the phonological processing. While this is inefficient for reading and thus they read slowly and would be penalized relative to IQ if they don’t get accommodations, their overdeveloped pattern recognition skills cause them to be extremely good at solving problems. But, your approach will likely screen out a portion of the very brightest, most able kids. Can you explain why you think that is a good idea?</p>
<p>I think our elite schools strive to identify and educate those kids who are going to lead, do important things, play important roles in society. I don’t think you identify them by screening on their the ability to answer questions quickly or without Braille or in a non-native language. </p>
<p>I have hired a number of kids from schools like Princeton, Harvard, and MIT and I’d rather hire a kid who thinks well than a kid who thinks fast. Interestingly, the best person I’ve ever hired came was a Math/Econ major UMass Amherst. He had learned to teach himself and to learn on his own and never stopped. He was not the quickest and he was certainly not the most glib. No knock on the other kids we hired, most of whom were very good. In that business, speed was important but quality of thought was much more so. I (and I think our society) would rather have the best kid rather than the quickest kid. If that is true, we ought to be designing our tests to measure the best and not systematically underestimate the capabilities of a significant subset.</p>
<p>amb3r, I think you raise a good point. There are clearly jobs in which one needs to work rapidly and for which some disabilities would handicap performance. The business I was describing above was a hedge fund that traded in real time, and I’d definitely have taken the smartest kid over the quickest one. Law is an example of a profession that is much harder for someone who reads and writes slowly, although David Boies is a famous lawyer who is dyslexic and I worked with the General Counsel of a major British corporation who had worked his way up from lowly beginnings in Australia despite severe dyslexia. I think they may be the exception rather than the rule. However, I think that you may be overestimating the number of jobs in which the need to do rapid reading/writing is critical. Post-medical school, I don’t see doctors doing extensive amounts of reading and writing. Effective salespeople need to be effective, but they do not necessarily need to be quick. I think that there are jobs, law among them, for which the ability to do academic-like tasks quickly enables you to rise, maybe to the top. Getting extra time in school may give you an unrealistic sense of your ability to succeed at such jobs. But whether it is biotechnology or hedge fund management or management, I’d rather have the system select for depth and capability rather than speed.</p>