Hello, thank you for your reply.
I have already deleted the plugin folder via ftp and the problem still persists. At the moment I can get onto my page and /wp-login.php but /wp-admin.php is still in a redirect loop.
Is it possible that the problem lies in the settings I changed after activating the plugin? Because there is a manual in the plugin description what to do to make the plugin work and one of the steps is to change some addresses in general settings of WP.