Currently, plugins can be disabled for the running SMath session. If by chance a buggy plugin is installed, then there is no way to get rid of it except finding out where it resides and removing it manually.
Proposal: Make the "Disable" button have permanent effect and add a button "Delete"