Born at Northampton, Mr Spencer studied for the boot trade at the classes held by the late Mr Swaysland at Higham Ferrers. He married Miss Emma Elson at Gold-street Wesleyan Chapel, Northampton, in 1886 (both had been Sunday School teachers at Queens-road Chapel).

They came to Rushden in 1888, though his first contact with the town had been in 1883, when for about 12 months he worked for the late Mr William Colson.