At the age of 22 Duffy started what would become a printing and publishing company which evolved into the first 24 hour a day copy center in the country. In the spring of 1986 he sold the business and enrolled in a course of study in the real estate and mortgage service industry. In late 1987 Duffy began his career as a mortgage loan officer.

The new career has given him the freedom to build a unique collection of Eastern spiritualist art and to indulge philanthropic interests. He has designed The Barn at Valhalla, a retreat/conference center. A resource for groups, for-profit and not-for-profit, to meet in a beautifully landscaped natural setting surrounded indoors by fulfilling works of art, while having access to the latest communications technology, and a gourmet kitchen.