Henry Frederick Penny was born in Bristol, England but later moved to Manchester with his parents. After leaving school at age eleven he was apprenticed to an experimental bicycle maker. Penny studied at several technical and literary subjects at Manchester Polytechnic, and during his 20s he was appointed Chief Electrician at the Belsize Motor factory in Manchester. Penny emigrated to Adelaide in February 1912 with his wife Florence Elizabeth (nee Featherstone), daughter and son. There he became involved in the South Australian single tax movement lead by E J Craigie and based on the writings of Henry George. Penny was president of the Henry George League and also secretary of the New Church Society of South Australia for some time. Many of his colleagues in the Henry George League were also members of this society.