Well, it's family name, too. You're just forgiven somewhat if you're outside the community and don't know which family is supposed to be given deference. Unless you're talking to a family of cops or the family that owns everything in the area, in which case you immediately agree with whatever political opinion they share (loudly).