@mushlih The example robots.txt code you provided would block all search engines from crawling your site:
User-agent: *
Disallow: /
The User-agent: * instruction states that any following instructions apply to all crawlers.
The Disallow: / directive specifies which areas or directories of your site the search engine spider can’t access. When you specify a / for the disallow directive, it means that the entire site is disallowed.
You can also find more information on this topic in the following article: WordPress robots.txt example, as well as a comprehensive guide to the syntax of the robots.txt file here: Ultimate guide to robots.txt.
