The Colony House is a historic house at 104 West Street in Keene, New Hampshire. Built in 1819 and enlarged about 1900, it is a good example of Federal period architecture, and is notable for its association with Horatio Colony, a prominent local businessman and the city's first mayor. The house, now operated as a bed and breakfast inn, was listed on the N…The Colony House is a historic house at 104 West Street in Keene, New Hampshire. Built in 1819 and enlarged about 1900, it is a good example of Federal period architecture, and is notable for its association with Horatio Colony, a prominent local businessman and the city's first mayor. The house, now operated as a bed and breakfast inn, was listed on the National Register of Historic Places in 2005.