In the 12 years that I was with my husband... NEVER.
Of the men that I have loved (only 3), I have never fantasized about being w/another when I was with them. THEY, however, were in my fantasies while I was with guys that I should never have gotten naked with.