At the time of its settlement, Bethlehem was the northern part of the Town of Woodbury. As related in the History of Ancient Woodbury (1854), by William Cothren,
Four years after the first settlement, the number of families amounted to only fourteen; yet this handful of people felt able to support a minister a part of the time, and accordingly petitioned the General Assembly at its October session, 1738, for liberty to have “winter privileges,” for five months,” in the most difficult season of the year, viz., November, December, January, February and March,” as they lived so far from church, it was impossible to attend. […] In May, 1739, they petitioned to be released from parish taxes as long as they should hire a minister, and from school taxes, on establishing a school of their own, “the school in the first society being so far off it was of no use to them.” The request was granted, and they were permitted to hire a “minister and set up a school.” At the October session of the same year, they petitioned that the “east half of the North Purchase” might be set off as a distinct ecclesiastical society.
The Society voted to build a meeting house in 1740 and, again quoting the History of Ancient Woodbury, “The clerk of the society in 1743, reported the house covered, and in May, 1744, that materials were provided for finishing the inside of the house.” This building was later replaced:
The first house in the society after a time was deemed too small for its accommodation. Accordingly on the 4th of January, 1764, when there were about one hundred within its limits that paid taxes, they voted to build a second church. On the 28th of the next month, they voted again to build the house, “and to begin and go on moderately and Little by Little.” […] By a vote of the society, October 20th, 1768, directing the society’s committee to “seat the new Meeting House,” “and dignify the Pues [sic]” therein, we learn when it was finished and ready for worship. In December, 1793, a tax of sixpence on the pound was laid to build a steeple, provided money enough to purchase a “good decent bell and a Lightning rod” for the same should be raised by subscription. Eighty pounds were soon subscribed, and the bell was obtained.
The current First Church of Bethlehem was built as the Society’s third successive meeting house in 1836. It is a Greek Revival, Doric tetrastyle, clapboard church.