The impetus for this building, its location, and name rests with the bequest of the cabinetmaker, James Tracy, who left his entire estate, including his home and land at the corner of Main and Church Streets, to the Town to erect a fireproof town hall.

By the late 1930s, there was great interest in having a community center where there would be a stage, auditorium, kitchen, dining room seating 170 people, meeting rooms, town offices, a large fireproof vault for town records, the post office and additional school classrooms.

Cobbling together monies from a modest tax increase, the Tracy bequest, and a grant from the Public Works Administration, Tracy Memorial Hall was built in 1938 and dedicated with much fanfare on June 14, 1939.