i'm gonna say yes, but only a little?!?! sanji's appeal is in the dichotomy of his character: he's touts chivalry and pervs out constantly, he's kind but won't hesitate to kill an enemy after he's fed them, he has his loser moments and his cool moments, etc. so yeah, losing the swirl would negate some of his charm, but not all of it imo