The historic Gothic Revival Episcopal church (1846) offers daily worship services in person and online. The church features original stained glass, sculpted bronze doors, and a marble reredos. The churchyard (1681) includes the gravesite of Alexander Hamilton, who served as the first Secretary of the Treasury from 1789 to 1795.