Hey Warren,
I'm glad you had such a nice time with your sister and sorry those feelings went down the crapper with your boyfriend. That just sucks, especially after having such a great day, with your being recognized as a male.
Sounds to me like you need to have a heart-to-heart adult-to-adult conversation with your boyfriend (after you're both calm) about your feelings, and see how he reacts and what he says. It's painful to go through these things but we all do with our partners. After, you'll have a sense of whether or not you see yourself staying with him and no matter what, you can say to yourself that you did the right thing. I hope you take this as friendly advice from a friend, that's all it is. I may be reading the situation all wrong, which would be no surprise.
Good luck,
Emma