Ebenezer Presbyterian Church is located near Keene. The first Ebenezer Church on the site was organized by Presbyterian minister Adam Rankin around 1790. The first church building, a log structure, was replaced by a stone building in 1803.