Horeb Baptist was constituted as Folsom Creek Baptist on June 28, 1792, by Jeptha Vining and Adam Jones. At the time, the United States was only sixteen years old, George Washington was president, and Georgia itself had been a state for just four years. This was decades before the Georgia Baptist Convention (1832) and the Southern Baptist Convention (1845).

Folsom Creek’s first pastor, Jeptha Vining, also served nearby Williams Creek Baptist. By 1793, the congregation created a storehouse to collect and sell grain as a means of supporting the church—an early form of structured tithing. In 1795, Parris, a man of color, became the first Black member on record. By 1798, plans were made for a permanent meeting house, and the church adopted the name Horeb. The first building, 24 by 36 feet, was completed in 1799 on the present property.

Records reflect both daily struggles and milestones. In 1824, the congregation built the current sanctuary, and in 1858, the pastor received a fixed salary of $200. During the Civil War, the church resolved to pray each morning for the soldiers, raised funds for hymnals, and even sent their Sabbath School Testaments to the front lines. Five Confederate veterans are buried in the cemetery.

After emancipation, Horeb supported the founding of new Black congregations. In 1888, the church petitioned for a law banning liquor sales within three miles, which soon took effect. Minutes also record disciplinary cases—such as members charged for dancing or playing the fiddle.

The early 20th century brought changes: a piano in 1917, electric lights in 1920, and the purchase of nearby land for baptisms. In 1941, Horeb recorded its highest membership of 153. A year later, the church honored thirteen men serving in WWII. By the 1950s and 1960s, community decline reduced membership. At Horeb’s 200th anniversary in 1992, only six elderly members remained. Though regular services ceased, the church still hosts homecomings, including its 227th anniversary in 2020. Today, Horeb stands as a remarkable testament to faith and endurance. Maintained by a small group of trustees, this sanctuary—alive since George Washington’s presidency—remains a treasured piece of Georgia’s history.