Colby was elected as a Liberal-Conservative MP in the House of Commons of Canada in 1867 representing Stanstead and remained in parliament until his defeat in 1891.
In 1867, Colby was chosen to represent Stanstead in the Canadian House of Commons as a Liberal-Conservative MP and continued to serve there until he lost his seat in 1891.