College Board Error on June 6, 2015 SAT?

^ and that is a problem. If some people will get a better score than they should have how can it be an accurate score? I’m not talking about the general kids who take it. But what about those kids that will be using those scores to seek scholarships? Now they are competing with an unfair advantage… I think there will be some people who will look on this June test differently and question did they really get that score or is in only because they threw out those 2 sections? and what about National Merit ? Already the kids are taking a different PSAT … word was that they could use the old SAT for their verifying score… Not sure if that will be the case now.

@Aleksandr7 First of all, just as a point of manners, you have no right to DEMAND answers from me - you should at least pretend to be asking politely. Secondly, I honestly don’t give a crap whether you find my reasoning convincing or not, nor do I care whether you “acquiesce.”

However, I am in an especially big hearted and generous mood today, so I will address the points you made, but I am not going to enter into a extended debate about it. In the big picture, neither your nor my opinion really matters at all. CB and the colleges have the final say and that’s really the end of it.

  1. You paid for a test and CB determines how that test is scored. Full stop. You don’t have any right to detailed scoring of a section that they determined to be invalid. Even if you could see the raw Right/Wrong numbers from those sections, you don’t have the curve and other adjustments used, so that information is not truly useful in any event.

  2. I conceded this point above in my previous post. I am certain that the SEM on this test will be somewhat larger than on a standard sitting. However, I am pretty confident that the decrease in accuracy is small enough that CB (and their client colleges) have determined that it is unlikely to impact more than a very small number of test takers significantly. No, I do not know this for sure, but I find it very hard to believe that if this was not the case, the CB would risk damaging its reputation in this way.

  3. “True score” - you, and I think many other of the people complaining on this thread, do not really fully understand what this actually means. On a typical SAT component (ie, one scored on all 3 sections), the score you get it is only accurate within +/- 60 points at 95% confidence. There are all kinds of ways to illustrate the implications of this, many of which I suspect would startle the average person. Here are a couple:

Your 700 score on a SAT component might indicate you are actually better than taking that test than your neighbor who scored a 670, but the probability that those scores represent an actual accurate distinguishable difference in ability is probably significantly lower than you would guess if I asked you to estimate it.

Roughly 1 out of 200 test takers will get a score more than 90 points higher than their true level of ability (and the same number will get a score 90 points lower or worse.)

And on and on, I could go, more specific numbers could be given, etc…the point is that the regular SAT is not as accurate as the layman presumes AND the reduction in accuracy on the June 6 scoring is very likely to be, although real, rather insignificant taken in that context. Again, if it were not, I don’t think CB would have made the decision they did end up taking. Maybe I am hopelessly naive, but that’s not usually how people who know me describe me. grin

Your last paragraph again refers to “real scores” - I covered this above, but the point is that THERE ARE NO REAL SCORES for the impacted sections. Obviously, CB sampled that data and saw a significant statistical impact across students in test facilities that handled the screw up differently, and determined that scoring on the impacted sections would be biased. So there is no curve for those sections, there is no score. Your raw right/wrong answers obviously do exist, but without context, they are essentially worthless - they are not a “score.”

I am pretty certain that this isn’t going to change your mind or the mind of most of the other people who are so upset. So be it, and I am moving on and I suggest that you should as well. What happened was unfortunate, and it should not have happened, but I think CB is making the best out of a bad situation. If that’s not good enough for you, cancel your scores, call and complain and get your money back, retake the test in October, whatever you want. You aren’t going to get your affected section scores and you aren’t going to get a summer time retest.

I smell a pessimist

“3) “True score” - you, and I think many other of the people complaining on this thread, do not really fully understand what this actually means. On a typical SAT component (ie, one scored on all 3 sections), the score you get it is only accurate within +/- 60 points at 95% confidence.”

^
THIS.

This is what has confused me while reading replies in this thread. A lot of you keep asking for CB to release the actual scores but it was confirmed by the Washington Post that the normal SAT results aren’t exact either way. I think most of you need to just deal with it at this point. CB is not going to change their minds and acting hysterical isn’t helping.

MODERATOR’S NOTE
@NickFlynn @Aleksandr7 At this point, if one is not going to agree with the other, then the best we can hope for is that you agree to disagree. Let’s leave it at that, please.

Check out the latest update on the SAT timing/scoring fiasco at the Washington Post “Answer Sheet” blog http://www.washingtonpost.com/blogs/answer-sheet/wp/2015/06/14/college-board-dumping-two-sections-of-june-6-sat-not-one-because-of-printing-error/ – we hope this post clarifies some of the confusion caused by inaccurate and misleading information previous provided by the College Board and others

The changing time stamp is hilarious. I have seen students both in HS and in college who dropped or withdrew from a class late and they used the computer people to change the “post date” to be the last day to drop or withdraw.

Rather common IMHO.


[QUOTE=""]
@xiggi that doesn't make any sense...how would my own message apply to myself? I'm not the one calling the situation a hysteria, nor am I bashing anyone here for worrying.<<<

[/QUOTE]

The part that applied to you was about the need to educate yourself. You are entitled to your Chicken Little position but not to your facts. You simply do NOT understand the issues and are demonstrating that ignorance with each additional post.

You want a valid and timely score? You WILL receive just that. Next!

I think it would be interesting to have them take last 5(or so) test dates and do what they are doing for this test. Score them and let’s see if the scores really stay about the same.

They have the data. They have the tools. And they have the best experts in the business.

Perhaps, they just did what you suggested before considering the remaining sections as sufficient data for their algorithms. In the end, it is only a matter to revise the weight of penalties for errors and omissions.

My hope is they did this analysis and found that the data are similar and that’s one reason why they are solving the issue the way they are. The issue is that while there may not be statistically significant differences for the groups as a whole, there could be differences for specific individuals. I’m sure this is always the case, but in the June 6 instance, the college board error is a possible explanation for the difference.

Has this SAT error happened before?

“We do not yet know how admissions offices will view results from the June SAT. The first step toward restoring any credibility is for the College Board to make available to independent experts, including FairTest, evidence that not scoring two sections produces equivalent results to scores based on the full test. If the College Board refuses this basic transparency, June 6, 2015 SAT scores will forever be questioned.”

So basically Bob Schaeff’s link to the Washington Post article confirmed that there is a possibility that admissions offices will view the scores of this SAT in a different light than all the other SATs.

^^ FairTest is neither independent nor an expert. Except for providing a source for lazy journalists looking for a quick quote, the organization does not employ anyone with a professional understanding of the SAT. They have never published a single peer-reviewed research paper and are simply pushing an agenda for pretty clear monetary rewards. Consider them a media, PR, or advocacy group, but the organization is surely not an expert on standardized tests.

Just like everyone else, Bob Schaeffer is entitled to his own opinion, but he, just like everyone else outside the ETS and TCB organization, engaging in pure and unadulterated idle … speculation.

There have been times that this speculation addressed very valid questions about the SAT – such as the mostly ignored rampant cheating in Asia. The organization is correct to demand more transparency (we all could benefit from it) but are mostly wrong about the integrity of the test and its value in admissions. They have never considered how the test provides a great equalizer for underserved students. The crusade to abolish standardized test is only the tool for the real raison d’etre of FairTest. And THAT reason is dollars and cents.

Thank you for posting the link @bobschaeff. Along with other posters, I mentioned in posts #140 and #288 that CB’s initial statements were ambiguous, and in post #299 on 6/9 that CB’s date stamp was innaccurate and misleading.

Along with ACT, CB has a monopoly on a key factor of the college admissions process. As such, they have a particular responsibility to their 500,000+ customers to provide accurate, authoritative information. Whether their now abbreviated 6/6 test proves to be “reliable” or not, they have not provided their customers with the error free testing situation that they paid for, and expected.

This is what was on the College Board Website at 11:00 AM this morning:
Information Regarding the Saturday, June 6, SAT Administration

Last updated June 8, 2015 at 5:30 p.m. EDT

On Saturday, June 6, Educational Testing Service (ETS) informed the College Board that there was a printing error in the standard test books ETS provided to students taking the SAT that day in the United States.

We apologize for this error.

After a comprehensive review and statistical analysis, the College Board and ETS have determined that the affected sections will not be scored and we will still be able to provide reliable scores for all students who took the SAT on June 6. We expect to deliver scores within the usual timeframe.

To accommodate the wide range of incidents that can impact a testing experience, the SAT is designed to collect enough information to provide valid and reliable scores even with an additional unscored section. From fire drills and power outages to mistiming and disruptive behavior, school-based test administrations can be fragile, so our assessments are not.

We take our responsibility to students very seriously, and we regret the confusion some students experienced. For more information, we encourage students and their families to check back here for the latest updates.
Frequently Asked Questions for Students

Q: What happened during the June 6 administration of the SAT?

Shortly before noon Eastern time on Saturday, June 6, Educational Testing Service (ETS) informed the College Board that there was a printing error in the standard test books ETS provided to students taking the SAT® on June 6 in the United States. The time allotted for the last reading section was incorrect in the student test books but correct in the script and manual provided to test center supervisors. The copy in the student test books indicated “25 minutes” while the manual and script indicated the correct time limit of “20 minutes.” Because of the way the SAT is administered, while the misprint appeared in the last reading section, students may have been taking the last math section in the same room at the same time, and also would be affected.

As soon as ETS became aware of the error during the administration of the test, it worked to provide accurate guidance to supervisors and administrators.
Q: Will my scores be available and still be delivered to colleges and universities?

After a comprehensive review and statistical analysis, the College Board and ETS have determined that the last reading and last math sections will not be scored, and that we will still be able to provide reliable scores for all students who took the SAT on June 6. We expect to deliver scores within the usual time frame.

Colleges and universities will know these scores are valid.
Q: How is it possible to not score two sections and still have valid scores?

The SAT consists of three Tests: Reading, Writing, and Math – with each test having multiple sections. To accommodate the wide range of incidents that can impact a testing experience, the SAT is designed to collect enough information to provide valid and reliable scores even with an additional unscored section within a test. From fire drills and power outages to mistiming and disruptive behavior, school-based test administrations can be fragile, so our assessments are not.

We have deliberately constructed each test to include three equal sections with roughly the same level of difficulty. If one of the three sections is jeopardized, the correlation among sections is sufficient to be able to deliver reliable scores.
Q: When will I get my scores?

We expect to deliver scores to students within the usual time frame.
Q: Who does this affect?

All students who took the SAT on June 6 in the United States are affected. This does not affect students who took the SAT on Sunday, June 7, or any SAT Subject Test offered that day.
Q: Where can I go for additional information?

To address any additional questions from students and families, our customer service professionals are available at sat@info.collegeboard.org.

College Board updated its statement this afternoon:

Information Regarding the Saturday, June 6, SAT Administration

Last updated June 15, 2015 at 2:30 p.m. EDT

On Saturday, June 6, Educational Testing Service (ETS) informed the College Board that there was a printing error in the standard test books ETS provided to students taking the SAT that day in the United States.

We apologize for this error.

After a comprehensive review and statistical analysis, the College Board and ETS have determined that the affected sections will not be scored and we will still be able to provide reliable scores for all students who took the SAT on June 6. We expect to deliver scores within the usual timeframe.

To accommodate the wide range of incidents that can impact a testing experience, the SAT’s Critical Reading, Writing, and Math tests each are designed to collect enough information to provide valid and reliable scores even with an unscored section. From fire drills and power outages to mistiming and disruptive behavior, school-based test administrations can be fragile, so our assessments are not.

We take our responsibility to students very seriously, and we regret the confusion some students experienced. For more information, we encourage students and their families to check back here for the latest updates.
Frequently Asked Questions for Students

Q: What happened during the June 6 administration of the SAT?

Shortly before noon Eastern time on Saturday, June 6, Educational Testing Service (ETS) informed the College Board that there was a printing error in the standard test books ETS provided to students taking the SAT® on June 6 in the United States. The time allotted for the last reading section was incorrect in the student test books but correct in the script and manual provided to test center supervisors. The copy in the student test books indicated “25 minutes” while the manual and script indicated the correct time limit of “20 minutes.” Because of the way the SAT is administered, while the misprint appeared in the last reading section, students may have been taking the last math section in the same room at the same time, and also would be affected.

As soon as ETS became aware of the error during the administration of the test, it worked to provide accurate guidance to supervisors and administrators.
Q: Will my scores be available and still be delivered to colleges and universities?

After a comprehensive review and statistical analysis, the College Board and ETS have determined that the last reading and last math sections will not be scored, and that we will still be able to provide reliable scores for all students who took the SAT on June 6. We expect to deliver scores within the usual time frame.

Colleges and universities will know these scores are valid.
Q: How is it possible to not score two sections and still have valid scores?

The SAT consists of three Tests: Reading, Writing, and Math – with each test having multiple sections. To accommodate the wide range of incidents that can impact a testing experience, the SAT is designed to collect enough information to provide valid and reliable scores even with an additional unscored section within a test. From fire drills and power outages to mistiming and disruptive behavior, school-based test administrations can be fragile, so our assessments are not.

We have deliberately constructed each test to include three equal sections with roughly the same level of difficulty. If one of the three sections is jeopardized, the correlation among sections is sufficient to be able to deliver reliable scores.
Q: When will I get my scores?

We expect to deliver scores to students within the usual time frame.
Q: Who does this affect?

All students who took the SAT on June 6 in the United States are affected. This does not affect students who took the SAT on Sunday, June 7, or any SAT Subject Test offered that day.
Q: Where can I go for additional information?

To address any additional questions from students and families, our customer service professionals are available at sat@info.collegeboard.org.

?? I didn’t notice any difference. What was it?

As of June 15, 2015 at 9:00 p.m. EDT:

Q: Is there an opportunity for a retest?

We remain confident in the reliability of scores from the June 6 administration of the SAT and don’t want to cause undue anxiety for students by making them believe they need to sit for the test again. However, we have waived the fee for the October SAT administration for students who let us know that their testing experience was negatively affected by the printing error and we will continue to do so.

I think most of the students, who were affected, want to hear that. Also it was obviously that something like this will come out.