No reason to keep the old versions.
About the plug-ins, you may want to read this Adobe Tech Note before you move them to CS4.
"Important: Do not move plug-ins from previous versions of Photoshop, or third party plug-ins that have not been updated, into the Photoshop CS4 > Plug-Ins folder, or set the Photoshop CS3 (or earlier) > Plug-In folder as the Additional Plug-Ins Folder in Photoshop > Preferences. If you are running the 64-bit Edition of your operating system, all third party plug-ins must be updated for 64-bit operating systems before you install them into the 64-bit version of Photoshop. "
http://www.adobe.com/go/kb404900Jerry