Brown's views changed markedly during his later years in the Legislative Council. Whereas he had earlier argued against the necessity of an "opposition", he later became himself firmly opposed to the government. He became an outspoken critic of nearly every government measure, and was especially critical of Governor Robinson. For a time he was widely recognised as the Leader of the Opposition, although on at least one occasion he repudiated the title. Brown's views on responsible government also changed. He had been one of the colony's staunchest opponents of responsible government, but by 1883 he had declared himself a supporter of the proposed change. Having been elected on a policy platform of opposition to responsible government, Brown considered it inappropriate to retain his seat after changing his opinion, so in April 1883 he resigned the seat of Geraldton for the second time. A few weeks later he was elected to the new seat of Gascoyne, which he would hold until his resignation in April 1886.