I think there's a huge difference between fantasizing about other people and fantasizing about other people while you're actually having sex. The former is OK, although it's not really a comfortable topic to talk to your significant other about. The latter is not such a good thing. It might be hard but talk to your girl about it, ask her why she fantasizes about other people while you are having sex.