|
![]() | |||||
![]() | |||||
![]() | Can you paint a picture of the situation in terms of black/white test performance in the country today and how it's been for a while? | ||||
There is a reliable test score gap between white and black Americans. On IQ
tests, it's about what people call one standard deviation, about 15 points on
an IQ test. I think on the SAT exam, which is another exam people are commonly
familiar with, it's about maybe 100 points on each of the subtests, the verbal
and the quantitative sections of the SAT. Those are sizable differences, enough
to affect a person's opportunities when tests are used to base admissions
decisions (on). So the gap is a serious one, and it has been around for a long
time. And people have been and are still struggling to get ahold of all the
things that determine it, that go into it. Some hypotheses about where that gap
comes from are some of the most controversial parts of psychology.
There is a range of hypotheses about where this gap comes from. I suppose
the most severe one is the one that gets the most attention. The Bell Curve,
for example, at least alludes to the idea that genetic differences between the
groups to some degree account for the difference. That's on one pole. On
another pole are many more environmental factors that reflect differences in
the experience, in particular the schooling experience that white and black
Americans have as the source of this gap. Access to schooling, differences in
treatment within schooling, differences in socio-economic status that go along
with racial status in the United States. All these things, by affecting the
kind of access to schooling and cognitive skill-building, can affect
standardized test performance and it can be at the root of the differences.
Most social scientists put a great deal more weight on that than for example
the genetic difference.
I think they are. I think it's difficult to quantify the extent to which a
difference is cultural or socioeconomic in a given sample, or differences in
the way in which students are treated in schools and so forth. That's what's
hard. And it's hard to definitively assign a degree of causality to one of
those causes or another. And that is what makes the debate go on and on with a
lot of attention focused on the different causes of this gap.
It's interesting. I don't think I was prompted by trying to explain the
black/white test score gap. Our work emerged more from an interest in trying to
understand the nature of race and how race might affect academic performance in
general; the student's relationship to schooling and to school achievement.
It's out of that general interest that we began to uncover some things that we
didn't expect really that seemed to be new candidates for explanations of where
this gap in test performance is coming from.
Well, I think the novel approach begins with just a somewhat different idea
about a set of factors that could affect test performance, in particular test
performance of African Americans although we've also looked at test performance
among women in mathematics. And the general term for the set of processes that
we identified is stereotype threat. Should I go on and explain that because
that could take a bit of time? By the term "stereotype threat" what we have in mind is simply being in a situation where a negative stereotype about your group could apply. As soon as that's the case, you know that you could be judged in terms of that stereotype or treated in terms of it or you might inadvertently do something that would confirm the stereotype. And if you care very much about doing well in that situation, the prospect of being treated stereotypically there is going to be upsetting and disturbing to you. And if you're a member of a group whose intellectual abilities are negatively stereotyped, this threat might occur. That negative stereotype will be applicable to you right in the middle of an important standardized test. And our general reasoning was that this threat, this prospect of confirming a stereotype or of being seen that way would be distracting enough, upsetting enough, to undermine a person's performance right there in the middle of a test. It's important to stress that everybody experiences stereotype threat in some way or another because we're all members of one group or another that is negatively stereotyped in society. And whenever we're in a situation where those stereotypes apply, we too can experience this threat. From Methodists to white males. You could imagine a group of males talking to women for example about pay equity. The men might experience a sense of being threatened by the male stereotype, that they could be judged in terms of that stereotype or what they say could be interpreted that way. And in particular, for those who care about being seen equitably, that's going to be upsetting and disturbing. It might cause them to avoid that kind of situation or maybe to make slips of the tongue that would be embarrassing in that situation. That's an example of how it can affect, and does affect, everybody. The point that we're looking at in our research is stereotypes about groups for whom the stereotypes impugns their abilities. Could this kind of threat, this kind of distraction come to bear on their test performance, their standardized test performance? That's the heart of it. What were we observing given two different sets of instructions? What results are you finding from that? What you're seeing there is us trying to manipulate, as the term is often used, whether a person is taking this test under stereotype threat or not under stereotype threat. So in the case of African American students taking a difficult test that is diagnostic of ability, that is presented to them as being diagnostic of ability, they're under stereotype threat. That's all it takes. Because the stereotype about African Americans impugns their ability, their intellectual ability. So all you have to do to make the stereotype relevant to their performance is to present the test as a test of ability. Then they know that they're at risk of being seen through the lens of that stereotype. So we give them, what you saw this afternoon is people taking a particularly frustrating test. It's a very difficult test taken from a section of the Graduate Record Examination in literature. We know it's going to cause frustration and that is going to trigger the relevance of the stereotype. When they experience that frustration, they'll sense, oh boy, I could be seen stereotypically here. I could be confirming the stereotype. And for the students you saw who are very strong students, very committed to succeeding in school, that prospect of being seen stereotypically is disturbing. And it can undermine their performance right there. And that's generally what happens. Compared to white students in that situation, they in that situation are not subject to that kind of a stereotype. And so they may be haunted by all kinds of things with regard to performing on standardized tests, but they're not haunted by the prospect of confirming this stereotype. So you get two groups of students, white, black, who are equally prepared. Equal skills, everything. You give them this very difficult test that is presented as diagnostic of ability. The black student has this extra pressure on performance. And that is in our research invariably reflected in lower performance.
Then you shift conditions just with the touch of a change of the
instructions, you present the same test as a test that is something we use to
study problem solving in the laboratory and is not diagnostic of ability. That
turns the stereotype off for the black student. Now as the black student
experiences frustration on this test, it has nothing to do with the prospect of
confirming a stereotype or being seen from the standpoint of the stereotype.
And if that pressure of being seen stereotypically is enough to depress their
performance, then taking off that pressure should increase their performance.
And that's what happens in this research. Presenting the same test as
non-diagnostic of ability, black students perform just as well as equally
prepared white students in that situation.
That set of instructions is trying to do the same thing we do with the
non-diagnostically instructions for a big word. What he's doing there is
essentially telling the black students that the stereotype about your abilities
is not relevant to your performance on this test. This is a racially fair test;
a racially neutral test. You are not at risk when you get frustrated on this
test of confirming anything racial or allowing people to see you in some way
racially. This is a racially neutral test. That turns the stereotype spotlight
off, so to speak. And when that happens, their performance again goes up. So
really in our research through a variety of treatments like that with a number
of groups, we've been able to establish the same kind of thing. When you turn
off the stereotype that could threaten them with the prospect of being seen
stereotypically or confirming it, when you turn that off just with an
instruction, up goes their performance. And that indicates that under normal
circumstances, that weight and that pressure is on their performance. It is to
some degree probably depressing their performance and is contributing to this
black/white test score gap that we started the conversation with.
A 12 would be the score that white students or black students who are not
under stereotype threat get. This is a 25-item test; they get 12 correct. Under
stereotype threat, they get about 7 or 8 correct. So that's a very substantial
difference. And that's just in a 25-minute section of the Graduate Record
Examination. If you played that out over the six sections that usually comprise
that exam, that could cause a substantial difference in score. There are many implications because stereotype threat is not something that happens just on standardized test performance. It happens whenever these students are in the domain where the stereotype is applicable. So [with] any kind of intellectual performance or interacting with professors or teaching assistants or other students in a classroom, this stereotype is relevant and constitutes a pressure on those behaviors. As I say, we've looked at the same kind of thing with regard to women and mathematics. For that group, it's particularly rife with stereotype as they get into advance mathematics work in college. Then, fewer and fewer women are present. The world of mathematics and science becomes a more male world. And the threat of the sort we're describing here for women gets more intense.
So, the first implication is that this is probably something more general
than something that affects standardized test performance, as important as that
is. It's something that's a pervasive element of experience in society in
general. Also I think it's important to realize what it says about interpreting
standardized test scores for different groups. We tend to think of standardized
test scores, almost the term, standardized test, gives the image that this is a
test that is standardized. It's fair for everybody. It is a fair and impartial
measure of school potential, potential to succeed in school. And this research
raises at least one source of concern about that, that different groups in the
midst of those tests may be under different degrees of pressure, and their
performance is likely to reflect that. And the gaps that we see are
interpretable in those terms as opposed to differences of preparation or
differences of ability.
That is the thing our research has revealed to us, something that we really
didn't think of when we went into this. It has become vividly clear to us and
other people who do this research that the effects of the stereotype are
poignantly most powerful for the students who are the strongest and the most
motivated. For them, functioning at the frontier of their skills with this
prospect of being seen, stereotypically, [to be] over their heads, they're the
ones who experience a disruption and so forth. Students who are less identified
with that kind of success in school for whom it isn't so important. Let's take
for example a woman who is performing math but really isn't identified with
math. If you give her a very difficult math test, she'll start to do it, she'll
do her best, as soon as she gets frustrated though she'll probably start to
say, "Well, this is not me. This is not important to me. So I'll sort of
withdraw effort," so to speak. It doesn't make any difference whether she's at
risk of being seen stereotypically or not. With regard to the whole domain,
it's not something that's important to her. So, poignantly, the problem and the
stereotype threat that we're talking about, it hits the women math students who
do want to do well in math and who are very identified and for whom doing well
is very important to them. It's for that kind of student that, again, operating
at the frontier of their skills, having a great deal invested in this domain,
the prospect of being stereotyped in it, of doing something that would increase
the likelihood of them being stereotyped in that domain, is disturbing. In some
of our research we find it elevates blood pressure for example. For those
people, it's disturbing, distracting, and likely to interfere with their test
performance and with their other interactions in the domain, their other
behaviors in the domain.
Yes, that is a term that we've sort of started to use to capture this part
of the phenomena, that it's the most invested students who feel it the most.
That it's the academic vanguard of the group as opposed to the rear guard of
the group that is experiencing the threat we're talking about. And experiencing
that threat can be thought of as having to pay a sort of pioneer tax: the woman
who is really advanced in math, the black student who is really doing well and
is sort of in a top flight, high pressure college or graduate program or
professional program or something. That person, because they're having to deal
with this threat and the prospect of it is paying a certain tax to be there
that other students are not having to pay. This is not to make the journey of
other students seem trivial or light because it isn't. It's just to argue that
in addition, for students who are negatively stereotyped in this domain,
there's this other tax to pay.
Yes, I think one of the reactions we sometimes get to our research on the
part of women who are good in math or blacks who are good in academics for
example is, "That's very interesting Claude, but look, can't they just bear
down and beat the stereotype? Isn't this stereotype something that should just
stand as a call to greater effort in the domain rather than something that
should be as troubling as you're describing it?" And the African American
community is strongly committed-handling this kind of pressure is something
that is very familiar to them and they're very experienced at exercising [it].
So when they hear this kind of argument, that can be a reaction. What we have
found out is that it is the attempt to overcome the stereotype, to struggle
past it under this added pressure that is in some sense causing the under
performance. It's causing them to, for example in our research, they're
re-reading the items, re-checking their answers, going back and forth,
double-guessing. And on standardized tests, that's not the most effective way
to take them. You're supposed to kind of move through them in as relaxed a way
as you can. Keep paying attention, but be relaxed. And the attempt to be extra
careful, to not make a mistake, is in part what's undermining their
performance. It' s also associated with elevated blood pressure in that same
situation. So there's a good deal of arousal. These things tell us that these
kids are not in these situations giving up. They're in these situations trying
hard. Maybe they're trying too hard and it's out of that trying too hard that
the under performance and the stress is coming. John Henry-ism is a term that a colleague of mine, Sherman James at the University of Michigan, has used to describe a syndrome of high blood pressure among American blacks. He uses a sample of blacks in North Carolina who he has given this name to. And you remember John Henry-ism is an old fable in which John Henry is a steel driving man and he competes with the steam-driven pile driver to see who can drive the most stakes in this railroad construction. And they go at it, the steam-driven machine and John Henry in another track. And they go at it for days and days and days and finally, John Henry wins. He drives one more stake before this machine sputters to a stop. But as he drives that stake he drops dead.
Part of being black is having to deal with an extra burden. Part of the
heroism of African Americans is struggling against that extra burden. But
there's a price to pay. There's often a price to pay. And I think that's what
that term captures. To function in a society where you have to contend with the
prospects of being stereotyped and negatively treated in very important domains
of life, that's an extra burden and there is going to be--you can and should
struggle as valiantly as you can against it--a price to pay and it certainly
isn't to say that that's fair.
Disidentification refers to a reaction that can happen as a person has to
deal with the stereotype threat for a long time for example. It would be essentially divesting oneself from the domain. That is, making it less a basis of one's self esteem and self regard. By caring less about it and seeing it as something that my own self regard is less accountable to, then I stop worrying so much about what goes on in that domain. I described a little earlier a woman who might not care so much about mathematics. Another way of putting that she isn't as identified with mathematics and so her performance isn't as important to her self-esteem as it would be for someone who does care a great deal about mathematics.
I often use the example of having disidentified with the baritone horn in
the 8th grade when my band instructor told me, as we went into the concert that
night that, "I could hold the horn but I didn't have to play." So I kind of
came to the decision that the baritone horn is not really for me. Well, that's
an act of disidentification in a sense. It's, "I'm going to find some other
domain to take on as a personal identity to hold myself accountable to. Maybe
it will be sports, maybe it will be academics where I will really care to the
degree that if I don't do well at it, I'll feel not so good and if I do do well
at it, I'll feel really proud of myself." When you have those kind of
contingent feelings about a domain or an activity, you're identified with it.
Anybody can think of activities that they just don't care about that they know
are important to other people but for them, their own feelings about themselves
are not tied to that. Well, that's not being identified with something. And the
sort of tragedy that we're pointing to in our research is that in reaction to a
very systematic pressure in society like stereotype threat in a school domain,
it can cause some groups to disidentify with very important domains of life
like school achievement or to identify less with those domains because of this
added threat in the domain. Well, that's very interesting, that word imbibe that you used because we might have had that view initially; that's a classic view in the social sciences throughout much of the 20th century beginning with the work of Mead that there's a set of stereotypes out there and when you're a member of a negatively stereotyped group, you eventually inevitably imbibe those stereotypes. And then when you're in situations where the stereotype is relevant, for example you kind of fulfill them in a self-fulfilling prophesy kind of way or you're fulfilling self-expectations, lower expectations; it's a standard view. And what we're finding isn't quite... that isn't right in the sense that remember, this effect we talk about happens for the students that have the very strongest identification with the domain. They're students who at the beginning of these tests and so on tell us that they have a great deal of confidence in their ability. And they've long had a lot of success in the domain. So the understanding that this is revealing to us is that this is like a situational pressure. You can take a person who is very confident and put them under a certain pressure and disrupt their performance. So it is their confidence that is luring them into the domain and having them identify with the domain and put themselves in situations where they are taking these tests. This is the poignancy of it, that it's this group that is then experiencing a situational pressure of stereotype threat. So it isn't so much of an internalized thing.
Another piece of research that really deals with this directly: Can you
produce these effects in groups who are not subject to any negative stereotypes
about something? We came up--Josh Arenson, Steve Spencer, Joseph Brown, a
number of students and I--came up with a study that looks at stereotypes in
white males on math performance. Now here's a group that is not going around in
society negatively stereotyped. So there's no stereotype to internalize.
However, if you take white males who are very invested in math again, graduate
engineering students as we did in one case, or undergraduate honor students in
math, these are very good math students. You sit them down just as you saw
today in these experiments and tell them just before you take the test that,
"Gee, this is a test on which Asians tend to do better than whites." Now,
they're under the comparative stereotype threat. Their group is not negatively
stereotyped about math, but relative to Asians, there may be some possibility
of a difference. So, they're in a negative light because of the positive
stereotype about Asians in that situation. And lo and behold, those students
under-perform there. Evidence like that and the evidence I just described
earlier, makes it clearer to us that this is not something that is coming from
imbibing a self-believing and a self-fulfilling of negative stereotype; it's
coming from an intense situational pressure that happens to people who really
care about doing well in the domain.
Yes, that's interesting. That's a good way to put it, that what we're
finding is poor performance among people who almost want it too much, or not
want it too much, that's the wrong word, but are trying too hard. In an effort
to succeed [they] are almost trying too hard because they're dealing with this
extra pressure. That's the important thing to recognize. However, we wouldn't
go so far as to say that this process is the cause of all of the
under-performance or explains all of the black/white test score gap. Other
factors play a significant role too. And those other factors I think are
factors that people are more familiar with: disadvantages connected to race.
For example you can imagine the experience of a black student going through
school. They're much more likely to be assigned in lower school or to
educateably retarded tracks. They're much more likely to go to school in
schools that are less well funded. They're much more likely to have teachers
that are not as well trained. They're much less likely to have access to
coaching classes, the kind of thing you're looking at in this program. And the
list goes on. They're much more likely to have their work be undervalued and
the like. Well, that is a day-to-day, cumulative kind of experience that is
going to be manifest on test score performance and on grade performance in
general. Those factors are the larger backdrop to the problem. Our research
enters the picture when you ask the following question: suppose a kid survives
all that and gets to Stanford and is a really good, highly motivated student
and you put that student in a high pressure situation where they're operating
at the frontier of their skills, then this phenomena of stereotype threat
emerges. This is not to say that it doesn't emerge earlier, because it does.
Even in the 5th grade, you have very strong students who are operating at the
frontier of their skills and they're very dedicated students and they too will
experience stereotype threat. So, I don't want to say it's something that
happens just on elite campuses; it happens to the vanguard of the group at
every level of schooling.
There are lots of ways of making a student feel secure from being
stereotyped, or relatively secure from being stereotyped. I don't think any
single thing is going to wipe society clean of these stereotypes at this point.
This is part of the American landscape; it's the legacy of our history. And to
hope that they would be wiped away is too much in an instant. Maybe in some
years they will be. So, the aim has been to create learning situations,
schooling situations, where people can feel secure. And there I would start
enumerating a variety of strategies. One I think is institutional
leadership. Let's say you bring a black kid and a white kid onto a college campus. The American presumption is that if you treat them the same, they'll be okay. The complication with that though is that the black kid has this racial stereotype to deal with [and] doesn't really know how he or she is going to be perceived in that situation. [He or she] doesn't really know whether the feedback they're getting is coming from that stereotype and may be racial prejudice or whether it's just plain constructive feedback that they should pay attention to. They're in what Jennifer Crocker and Brenda Major, two social psychologists, call an attributional ambiguity. It's hard to know. The white student isn't quite in that situation. They can take feedback at face value. For a black student that's more complicated. And you can imagine how this plays out in daily life. Almost every interaction can have that ambiguity to it and the threat to it, the threat that perhaps I'm being treated through that stereotype, so that students, even though they're standing there on the same campus, in the same room with the same teacher, they're really in very different environments. And that's what's been difficult for American educators to appreciate, the difference in those environments. And what we mean by wise schooling and the thrust of the research to examine wise schooling has been how can you level this playing field for this student? What do universities, what do schools have to do to allow that black student to feel comfortable in that situation? And there are some very hopeful things. If you challenge that student, then you are sending that student a signal that we have high expectations for you and we're not viewing you through the lens of the stereotype but we really do value your ability. That's a very important signal. If the leadership of the university expresses a value in diversity, that people from different backgrounds bring things to campuses that are of value to everybody here, that sends a clear message that the things about my group that are distinctive about my group will not result in negative judgments but will be valued in this environment. And that helps people feel more comfortable there. Sometimes diversity is just seen as an empty piece of rhetoric. But it can send a very important signal to people who are otherwise under the threat of stereotypes in a situation. I think relationships are very important. Jim Comer, who is someone who has done a lot of research of this sort at the elementary school level puts a lot of weight on positive relationships because if we have a relationship, I will almost by definition trust that you're not going to see me stereotypically. So when college students come in and they have a variety of relationships with people in their environment, then they become confident, relaxed that in this environment, although I know those stereotypes exist in society in general, in this environment I'm kind of not affected by them, they're not a problem to me. You can contrast that with coming onto a campus and having a very segregated social existence. In that situation, I'm more likely to see things in racial terms because it makes sense. Here's my group, there's that group, and it puts up a boundary that enhances the tendency to see things racially and think then that I'm seen racially.
So these are examples. There are others that we have worked on. Jeff Cohen,
a student of mine, and Lee Ross, a colleague, and I have done some work that
I'm particularly excited about with regard to how to give feedback. How do you
give feedback across the racial divide so to speak? How does a white teacher or
professor give critical feedback to a black student? Jeff came up with some
very intriguing hypotheses about this, about how to do this. And certain
standard things that most of us tend to do are not the right things to do.
Some people think you should just give the feedback unalloyed, don't soften
it. That doesn't work. Black students are in this ambiguous situation where
they can't trust that. It has the alternative hypothesis for them that that
negative feedback is coming from a stereotype and is not really true about
their research or their work. And they have to consider that. A rational person
has to consider that. So down goes their trust in the feedback and the utility
of the feedback to them. It's intriguing how race in that way creates a bubble
that can isolate a person from feedback. Does it help to give a positive
bromide first? "Well, I really like you a lot, but here's the negative
feedback." No. Everybody can read that for what it is and that isn't very
effective. What Jeff found was that when the person had actually looked at the
work and said, "Look, we're using high standards in evaluating this work. But,
I have looked at your work, and I think you can meet those standards." That
combination of things, high standards plus affirmation of that person's
potential to meet those standards just deeply inspired the students. Black
students were more motivated in that situation than white students were. And
this is a rare thing if one looks at the educational literature to find black
students more motivated academically than other groups. But with that kind of
feedback, that's what happened. So you can see finding the key, the solution,
the secrets of wise schooling, is we think a research process. But they do come
to light. And there are a lot of talented practitioners out there who have a
great intuition about how to do this. There's no shortage of demonstrational
programs that show tremendous gains on the part of black students under
otherwise very competitive circumstances. They have great insights. We're
trying to take their insights and to systematize them into a kind of theory of
how to do it.
The classic phrase is that these tests measure what they test. And the SAT
is no exception to that. The way items get on that test is the way items get on
most tests of mental ability which is that they are items that correlate with
performance in school. So an item that you would give to a norming sample that
doesn't correlate very well with school success gets dropped off the test.
Items that do correlate get put on the test. That's how tests get made up.
They're just empirical creations, creations of American and European
pragmatism. If you want to find out what actual mental capacity they measure
you have to work backwards. You have to use statistical techniques to classify
the kinds of performances that they're measuring and work backwards to "Well,
if it measures this cluster of performances, maybe it measures this kind of
capacity." And then there have developed big arguments about which performance
this cluster measures and what performance that cluster measures and which are
central to performance. So it's a very complicated game trying to work
backwards and figure out what these tests actually measure.
It is in a sense an IQ test. The SAT and IQ test correlate very highly.
Between tests, between the SAT and the IQ, they correlate almost as much as the
SAT correlates with a second administration of the SAT, as much as it
correlates with itself. So they're very similar tests in content. Okay, yes. The methodology for standardized tests of the kind that we use today was developed in the 19th century by Francis Galton who was as many say, the jealous cousin of Charles Darwin. And he was trying to get a test that would test his kind of evolutionary, social Darwinist hypothesis that intelligence ran in families. Of course all kinds of other things ran in families like wealth, advantage, and so on, but that didn't bother him. He wanted a test that would discriminate between basically upper class and lower class Brits. He developed this technology of finding items and seeing how much they would correlate with other performances as a criteria for whether the item would be put on the test or not. So he had this situation in the British museum I guess where he would have people come in and perform tasks: reaction time tasks, visual acuity tasks, a whole variety of kind of physiologically rooted tasks that he thought would tap into intelligence, sort of innate, physical intelligence. His presumption was that upper class Brits would do better on these things than the lower class Brits and he would therefore have a set of items that he could give to people that were a measure of intelligence that would discriminate. People who would score high on this would be more likely to be the upper class Brits. People who scored low on this would be the lower class Brits. So, he died a failed scientist never finding a set of items that worked like that. Alfred Binet in Paris at the turn of the century, beginning of the 20th century, was given a practical task of coming up with a test that would help identify kids who were retarded and wouldn't do well in school. So he simply used Galton's technology. He said, "Well, I'll make up a bunch of items. And the items that kids who do well in school get right, I'll put on the test. And items that kids who don't do so well at school get right, I'll put those off the test because they couldn't be measuring something relevant to school success." So he gets a subset of items that kids who do well in school can perform well on, and now he's got a test that when given to people will tend to identify those who are not going to do well in school. And he can do what the Paris school board asked him to do: screen out kids who are going to have real trouble with school.
Well, as everybody knows, that became the basis of the IQ test. It was
transported into the United States, the Stanford-Binet test. That same
technology of using success in school as a criteria for whether an item gets
put on a test or taken off of a test. And that is how essentially, roughly
speaking, all standardized tests are constructed. The SAT, the GRE, the mini-IQ
test all have that inherent methodology to them.
As I say, that fact has not been wasted on me. And the area of standardized
testing and intelligence testing has always been one of the most controversial
areas of psychology for precisely that reason. It has often been used as a way
of implementing racist intent, most recently with regard to blacks. But in the
post-World War I wave of immigration it was used to screen out Southern
Europeans, Jews, and other groups who did not score well on tests at that
particular time. So it has, as a tool, a very, very racist past. I think it is an exam that can tell you something. I've used a metaphor if you can indulge that, that I think captures the basic argument I would use. If you had to select a basketball team by the number of 10 free throws that a player could hit, the first thing you'd worry about is selecting a basketball player based on how they shoot free throws and you know you'd never pick Shaquille O'Neal because he's terrible at free throws even though he's a magnificent basketball player. That's what a standardized test is, compared to the domain of real school performance. Real school performance out there--it's like having to select a basketball player based on how well they shoot free throws. That's the first problem with standardized tests. And the SAT reflects that. The predictive statistics reflect that. The SAT measures only about 18%, [an] estimate range from 7 to 25%, but of the things that it takes to do well in school. This is something that people should realize about the test. People think of it as capturing a very large proportion of things that are important to school success. The people that make these tests tell us, "No, that is not true. They don't capture a large portion of the things--about 18%." In many of the samples I've done research on, much smaller than that, sometimes 4% of the things that are predicting success in college for example. So it's not great, just like a free throw is to selecting a basketball team. And SAT is not going to get you very far with predicting who's going to do well in college. And certainly not far with regards to who is going to do well in society or contribute to society. It's just not that good a tool and that's the first thing to realize about it. The second set of problems have to do with interpreting the scores on SAT tests. And again, the free throw example is useful. If a kid comes in and he shoots 10 out of 10 or zero out of 10, you might take note of that kind of performance with regard to selecting him on the basketball team. If he hits 10 out of 10, you say, "Well, okay, he's probably pretty good and that probably reflects something about his basketball playing. I'll put him on the team. Zero out of 10, that probably reflects something about his playing, he's off the team." Same with SAT tests I think. When you get really strong scores one way or the other, even though they're not as reliable, they often can bring to light talent that would not otherwise be seen. And so I am not one who thinks they should be done away with entirely. They can be useful in that regard as long as we understand how to interpret them and how little to use them. And I think many college admissions committees are very sophisticated about this. They are closer to this issue of how predictive tests are, and they can get a feel for it. So, that's the second thing.
Middling scores on the test are very difficult to interpret because you
don't know. If the kid practiced a little bit more, maybe he would have hit 9
free throws. Maybe he hit only 4 and he's been practicing for 10 years. It's
just hard to interpret the meaning of middling scores and the same is true with
the SAT. A kid who gets anywhere from 10 to 1200, maybe he got those scores
because of coaching or maybe he got those scores because he didn't have enough
coaching or maybe he got those scores because he went to Europe every summer
and got a great vocabulary about cathedrals and that happened to be on the test
that day. All kinds of things can contribute to performance and it muddies up
the diagnosticity of the test.
That's easy for me to answer and that is, absolutely not. And that is the very nub of the problem.
That's the argument that many who oppose
affirmative action come to. Look, the assumption that they're making is that we
have a perfectly interpretable, objective measure of academic potential and
contribution to society potential. That we have that in our hands, and that
affirmative action is causing us to ignore that or downplay that or make
exceptions to that. And the first point that that side has to recognize is that
we don't have that kind of measure in our hands. We don't have that. The SAT
and no standardized test is that kind [of] measure, can bear the burden of
fairly assessing academic potential for all groups in society or all people for
that matter in society. We just don't have that. Yes. I certainly hope there is some way that we can stop the resegregation of America's foremost universities. My first appeal [is] based on our research and here I'm speaking I suppose more as a person than as a scientist. As a scientist, you try to let the data reveal to you what they reveal to you. But based on what our data has revealed to us over the years, I feel that these prescriptions against the use of race and gender in especially college admissions are going to be potentially very damaging to society unless we figure other ways of leveling the playing field. I've always been disappointed that many opponents of affirmative action, while opposing the use of racial preferences at that particular moment of admissions to college, have not been very interested in the racial preferences that precede that moment in K through 12 education for example throughout the United States. Where is the commitment there? Because the people who study that--the role of race in education at that level--come to understand that there are tremendous racial preferences against certain groups that just happen on a day-to-day basis and have a cumulative effect over the course of an individual's experience in life and are huge in terms of the... and racially coded. Not just class-coded, but racially coded. So at the point of college admissions, to get very pure about getting rid of racial preferences when nothing has been done to address the reverse racial preferences leading up to that point, that's not the American way. I almost hope that Americans will just see the unfairness of this at some level. As an American you have to have faith to some degree in the intelligence and good spirit of one's citizens. And I think I'd like to believe that if people begin to see the full scope of this issue, that they'll have a more sensible view of things, not to take this kind of narrow, hyper logical view, decontextualized view of the college admissions decision as the only place where we're supposed to be concerned about racial preferences. NOTE: The following are peer review articles documenting Claude Steele's findings. They include over a dozen replications of the basic effect of stereotype threat depressing test performance. Aronson, J., Lustina, M.J., Good, C., Keough, K., Steele, C.M., & Brown, J. (1999). When white men can't do math: Necessary and sufficient factors in stereotype threat. Journal of Experimental and Social Psychology, 35, 29-46. Croizet. J.C., & Claire, T. (1998). Extending the concept of stereotype threat to social class: The intellectual underperformance of students from low socioeconomic backgrounds. Personality and Social Psychology Bulletin, 24, 588-594. Shih, M., Pittinsky, T.L., Ambady, N. (1999). Stereotype susceptibility: Identity salience and shifts in quantitative performance. Psychological Science, 10, 80-83. Spencer, S.J., Steele, C.M. & Quinn, D.M. (1999). Stereotype threat and women's math performance. Journal of Experimental and Social Psychology, 35, 4-28. Steele, C.M. (1997). A threat in the air: How stereotypes shape intellectual identity and performance. American Psychologist, 52, 613-629. Steele, C.M. & Aronson, J. (1995). Stereotype threat and the
intellectual test performance of African Americans. Journal of Personality and Social Psychology, 69, 797-811.
the screening process | test score gap | getting in to berkeley | bibliography | links | video excerpt tapes & transcripts | press | synopsis FRONTLINE | pbs online | wgbh | ![]() | ||||