The comments come shortly after the singer said he'd retire in five years if he makes it that far