- Annals of King's Chapel from the Puritan Age of New England to the Present Day - Primary Source Edition
- The Commemoration by King's Chapel, Boston, of the Completion of Two Hundred Years Since Its Foundation, on Wednesday, December 15, 1886. Also Three Historical Sermons
- Annals of King's Chapel, Vol. 2 of 2: From the Puritan Age of New England, to the Present Day
- In Memory of Charles Sumner. Sermon Preached at King's Chapel, Sunday, March 22, 1874
- Memorial Lessons. A Sermon Preached at King's Chapel, Boston, on Sunday, May 29th, 1870, With a List of the Sons of the Church Who Entered the Service of the Country