"It was always rumors of him retiring," Aspinall said on "The Diary Of A CEO" podcast. "He's putting stuff out in the media ...