Difficulty with enforcement?  I hate to say it but here goes: Civil Forfeiture.  Just like in drug cases, the property should be seized if it is suspected of being a vacation rental.  Let the owner prove it is not a vacation rental and the property is returned otherwise the property gets auctioned off.  Enforcement problem solved.