Yes sorry for not replying to you. I resolved it – yoast seo plugin was creating redirects after category removal – so when I created new one or renamed it yoast created redirect to non existing category.
So now it is working just fine – I just deleted those redirects.
Have a nice day.