It depends on the app in question. Some load configuration from the %APPDATA% folder, others use their own folder, and others probably use completely different folders. Chances are, if you have to ask, and there's not a portable version readily available, you won't be able to do it.