Since I'm extremely clever, that means that they'd be coming to the completely erroneous conclusion that I'm not clever.

So in the choice between people coming to a completely false, unbelievably wrong conclusion that I'm not clever or shaving off my beard...

I would shave the beard. It's an evil beard, after all, and that means I don't really need it anymore. Good guys don't need menacing facial hair.