He's uming something about me that isn't true?

I am 20, and there is a guy around my age that I like. He likes me too, but he's been uming something about me that makes him not want to be in a relationship with me. I'm really shy, and if the topic of comes up while talking with friends, I appear uncomfortable. I'm not sure how to word this, but he told me that he and everyone else thinks that I want to be abstinent forever, and that's why he doesn't want a relationship with me. That is not true, and I had no idea that people thought that about me until he said that. One reason why I get uncomfortable when talking about is that someone once attempted to coerce me, then tried using force... and it always bothers me to think about what he tried to do. What should I say to him and my friends so that they don't keep uming this about me?