Check the \AppData\Roaming\Smath Folder, it seems to have extensions and user setting in it. As far as I know, everything can be moved to the main install folder containing the exe. However, every you open Smath, a new folder will be created in this Roaming folder containing a setting file.
When you run the portable version, it will create this settings file in the main folder for the portable version containing the exe.