For the 500 error, FTP may not be necessary. First, try troubleshooting by deactivating plugins or checking your server settings. Regarding saving to USB, use an FTP client to download your website files and database. Alternatively, use a backup plugin to create a full backup, then download and verify it before transferring to a USB drive.