Walking a mile in their shoes may not be such a good idea after all