Am I ok to remove the silencer/spark arrestor from my yamaha blaster?

I just want to know if it will sacrifice performance to remove my silencer. It's all rusty and ugly and it burns my *** since its large and i broke off my rear fenders