Built in 1823-6, the church became known as the “Stone Church” for its use of stone, an unusual choice in a colony where wood was the usual building material at this early phase.