Wouldn't it be worse if you had sex with him and then broke up and you found out that was all he had been waiting for?  I'm sorry, I know that it hurts to break up but don't let that be influenced by the whole sex question.  You made a very personal choice to wait to have sex and that choice is still just as valid today as it was before.  It is still something special that you will be able to share with the guy of your dreams one day.