There could be arcing inside a switch rated for a lower voltage than you are using it for. Arcing occurs when there is enough of a voltage difference to overcome the impedance of the air separating the contacts. If that is the case, the switch contacts could eventually fuse (weld together) or...