Robert lived with his paternal aunt, Annie Broan Aldrich, and his uncle, Dr. Addison Day Aldrich. His grandfather, John Broan, lived there as well. John Broan was born in England and was the progenitor of the Broam family in America.

Robert Broan served in World War II as Captain in USAAF as a B-26 bomber pilot and was awared the Distinguised Flying Cross and an Air Medal with 10 Oak Leaf Clusters. He participated in the D-Day invasion.