People of color, particularly African Americans, feel the stigma more keenly. In a race-conscious society, some don't want to be perceived as having yet another deficit.