he knew too that many who lived in town were fisherman , but fishing off the cape had become so restricted that hardly anybody made a living off that anymore , though a few hardy souls like clem johnson and ron fernald tried .