The story of Mt. Zion reaches back to 1842, when it was first known as Rehoboth Church. In 1844, the congregation officially dedicated itself under the name Mt. Zion. The first sanctuary was a simple log cabin, built across from the current site near the cemetery, and later replaced by a larger wooden frame building.

In 1862, Benjamin Seckinger, a descendant of the Salzburgers who settled Effingham County in 1735, deeded six acres to the church. There, a tabernacle and frame tents created a lively campground. Each summer, Mt. Zion hosted two-week revivals that drew pastors from across South Georgia. Families camped in the wooden tents while preachers rotated through the pulpit, creating a rhythm of worship and fellowship that carried on until 1925. A new chapter began in 1924, when John N. Bray donated land and funded the construction of the current church in memory of his parents. He now rests in the Mt. Zion Cemetery alongside generations of church families.

For decades, Mt. Zion was part of a circuit, sharing a pastor with several nearby congregations. Services were held only once a month until the 1950s, when Mt. Zion joined with Clyattville to form a new charge. By 1958, under Reverend Floyd S. Berger Jr., weekly worship and Wednesday Bible studies became the norm.

Today, the little church continues to hold services and stands as a testament to the determination of a rural congregation that has kept its faith alive for more than 175 years. The story of Mt. Zion is also tied to the Bray family, whose history can be traced in genealogical records.