Note how, just as with 家内 the kanji in this word correspond to traditional gender roles.
The problem is that though among friends you can use 夫, in a less casual setting there's not currently really a good alternative to ご主人 to politely refer to someone else's husband.
