It was bound to happen. Now you can get Firefox as portable software for your USB key. Its easy to use. You can easily copy your local Firefox setting to your portable version.You can post to your Wordpress install (This is a post from portable Firefox)
I actually think you can do exactly what you do with your local Firefox, allthough there are some known issues.

Remember to practise Safe Portable App-ing