Yep, pretty sure it was this plugin. Everything was working just fine until I installed it, and after I got rid of it everything is alright again.
Just deleting from the FTP plugin directory didn’t work, I had to delete the changes it made to my .htaccess and some other stuff. I really don’t recommend it.