Indeed, it is a shame.

On the lowest scale it's plain rude. I would never think to touch anyone's hair. A white woman asked if she could touch my hair in a coffee shop one time. I politely said no. She seemed shocked. But at least she asked.