Well, the doctor can only know if the hymen is broken.  Most frequently this is from sex, but not always.  There are various activities that will break your hymen that don't involve sex at all.  So while it's probable, it's not 100% accurate.