Constructed circa 1851 as the Rectory for the Church of the Atonement, an Episcopal parish located on the adjacent lot to the west. William H. Harison was the first Rector. Carpenter Gothic style. The church was razed in 1976, and may have been designed by noted American architect, Richard Upjohn of New York.