In 1814 the Diocese of Virginia's Convention could list only ten towns and five counties in which the Episcopal Church showed signs of life; Culpeper County was one. The Church building was erected in 1821, on one acre of land willed by the Revolutionary patriot, Brigadier-General Edward Stevens, as a memorial to his young son. The cornerstone reads: 'James Madison, President U.S.A. 46th Year of American Independence.