The Bayou Pierre Presbyterian Church, founded in 1807, played a significant role in the early religious life of the Port Gibson area. Originally established by Presbyterian missionaries, the church was a central gathering place for settlers. In 1828, the congregation moved to Port Gibson and became the First Presbyterian Church of Port Gibson. The original Bayou Pierre site was also notable during the Civil War, where it was involved in the Battle of Port Gibson. The church building is now inactive, reflecting its deep historical roots in the region.