The Cassidy family, which included ’70s teen icons David Cassidy and Shaun Cassidy, as well as actor Jack Cassidy and Partridge Familystar Shirley Jones, was complicated. And, as Shaun explained in a recent interview with PEOPLE, his feelings about his tumultuous relationship with his late father Jack Cassidy, who passed away in an 1976 apartment fire when he was just 49 years old, have continued after the older Cassidy’s death. Shaun was still young when his father died and despite following in his father’s footsteps to a career in entertainment, the two didn’t always see eye to eye. In fact, Shaun went as far as to call his father a bit of a “phony.”