Yes, people who don't follow you on Instagram can still see your videos if they are public. However, if you want to make your videos private, then only followers of the account that created the video will be able to see it.