That's one of those types of things that's not in the rules, but when it comes up we handle it on a case by case basis, taking the offended member's feelings into consideration.
The man doesn't like the idea of you threatening his family so please don't do it again.