<p>Jlauer, its best to go to the research article that I linked to for the theory/explanation as to the easy/hard dichotomy. The hypothesis is explained there in depth and I only skimmed it, so I probably won't do justice to it. But the basic idea is that it has to do with language and linguistic complexity. Easy questions tend to use common, high-frequency words, but the most common words in a language also tend to take on multiple meanings - so there is more room for misunderstanding based on cultural differences. The author cited words like "horse" but I have an easy example from my own life. As a young lawyer I was confused once when interviewing witnesses for a case who told me that an event happened in the "evening" -- but other witnesses said it happened in the "afternoon". I realized that to me, "evening" refers to the time after dusk, but to my black witnesses the "evening" meant the same as "afternoon". (I don't know if this was a black thing or a southern regional thing - but the point is that we were using a common word but attached very different meanings to it.)</p>
<p>Also, from the article:
[quote]
The extensive work of Diaz-Guerrero and Szalay (1991) illustrates the different implications of common vocabulary use. They report on the different associations of African Americans, Whites, Mexicans, Puerto Ricans, Colombians, mainland Chinese, and Hong Kong Chinese for a wide array of commonly used words, such as "friend," "love," "sex," "religion," "education," and "money," as well as an array of less commonly used words, such as "communism" and "capitalism." .... For example, the African American and White groups disagreed strongly in their responses to frequently used words such as "goals," "desires," "valuable," "justice," "progress," "society," and "class." On the other hand, African Americans and Whites agreed strongly on other terms, which happened to be words with low frequency of occurrence, such as "capitalism" and "communism."
[/quote]
You can see from those particular words how connotations may be associated with cultural experience.</p>
<p>They go on to explain that lower frequency words tend to have more specialized meanings -- less room for misunderstanding or disagreement.</p>
<p>The study also reports that the score gap between blacks/whites is lessened for written essays when the topics are harder -- that is, whites do better on easy topics, blacks better with more difficult topics. But I am less clear on why this would be -- and I wonder whether that may reflect inherent bias of the grader/reader rather than the actual quality of the writing. On an easier topic the writing might tend to be less formal, so stylistically the grader might favor the writing that fallowed a more "white" speech pattern; maybe tougher essays also produce a more technical, formal style and the graders are more likely to focus on factual content than on the tone. Anyway, that's my theory. </p>
<p>Some of the changes to the "new" SAT were actually done with these studies in mind -- for example, that's why they eliminated the analogies section, which would have a strong cultural bias if certain words have very different connotations to different groups. But I don't think there has been enough experience with the test yet to have hard data on this issue.</p>
<p>You wrote:
[quote]
We often disagree with their opinions on what is easy or hard.
[/quote]
I think that can reflect a language/cultural thing too. Sometimes what we think is "easy" is based on some common cultural reference or assumption -- but that may not be the underlying assumption the reader is working with. </p>
<p>Here are some other articles about cultural bias in testing:
<a href="http://academics.hamilton.edu/government/home/government_375/sp97/Race&Testing/rt4.html%5B/url%5D">http://academics.hamilton.edu/government/home/government_375/sp97/Race&Testing/rt4.html</a></p>
<p><a href="http://www.wilderdom.com/personality/intelligenceCulturalBias.html%5B/url%5D">http://www.wilderdom.com/personality/intelligenceCulturalBias.html</a></p>