You can. You just have to be careful not to puncture the padded plastic panel cover. The switch assembly is held in by friction with some light pressure retaining tabs. Just push a credit card under the edges and gradually work it upward until you can pull it out with your fingers.