>I mean: go with on holiday....
Artur, if someone really wanted to make themselves clearly understood, they would be more specific in his speech, wouldn't they? And you, saying 'go with sb', would you mean just a romance, or maybe something more than just occasional kissing each other on the lips? And how about this one:
She was finally persuaded by him and agreed to go with him.
Would you ever think that the sentence had anything to do with a sexual relationship? Common sense, and above all the context, should play the main role in such situations.