Why should using drugs make me uglier or better looking? If you wanted to assess an appearance penalty during withdrawal, that would make perfect sense. You already have the coded symptoms, you already have the little description saying you look like you could use a hit, there's a good place to penalize appearance.
But like, why does taking lana hurt my appearance? Why do I look like shit half an hour after hitting a joint?
This was brought up with the Pheromone Enhancer nano and they were actually changed to give no appearance boost (but double charm) because it was decided that's not how they worked, they didn't change your physical appearance. I'd propose that we treat drugs the same way: no appearance modifier, double the charm bonus or penalty, optionally add an appearance penalty during withdrawal to give you more reason to scrounge the next hit, that way I can do all the candy I like without looking like a hag.