Born in Tyler Texas in August of 1952, during his formative years he moved 14 times, mostly around the northeastern United States, with his family. His father, Crawford Gilligan was a professional fund-raiser for non-profit organizations specializing in private secondary schools. He received a new assignment each July, so the Gilligan family packed up and moved. When he was 14 Duffy entered The Hill in Pottstown, PA for four years where he studied both ancient Greek and Latin.