I have been asked to move as a single traveler many times. I usually decline if the new seat is not to my liking. But it sounds to me this is what happened in this case. The person who was moved happened to be black and the seat happened to be at the back (usually the last seats taken).