St. Joseph's Roman Catholic Church was built on Livingston Avenue in East Millstone in 1865. Today this building still stands, but the church is headquartered across the Millstone River. Catholic Church services in the area date back to at least 1832, when Father Bernard McArdle, pastor of St. Peter's Roman Catholic Church in New Brunswick, said Mass for Irish canal-workers in a house near Blackwell's Mills. In 1851, Father John Rodgers, also of St. Peter's, was celebrating Mass in East Millstone homes.