robots.txt is blocking your whole site
What SEOPert detected
Your robots.txt tells every search engine not to crawl any page on the site.
What this means
Your robots.txt tells all search engines not to crawl any page. Unless the site is meant to be private, this keeps you out of Google.
How to fix it
- Open yourdomain.com/robots.txt and look for “Disallow: /” under “User-agent: *”.
- Remove that line (or change it to “Disallow:” with nothing after it). Re-run your audit to confirm.
On WordPress
- Go to Settings → Reading and untick “Discourage search engines from indexing this site”.
- If the block remains, edit robots.txt with the Yoast SEO or Rank Math file editor, or remove a physical robots.txt file from your hosting account.
On Shopify
- Online Store → Preferences: check the store is not password-protected. If your theme has a custom robots.txt.liquid, ask your developer to remove the global block.
On Wix
- Go to your SEO settings, open the robots.txt editor, and remove the “Disallow: /” rule.
If you are handing this to a developer
Remove the global "Disallow: /" for User-agent: * in robots.txt.
Check it worked. Open yoursite.com/robots.txt: there should be no “Disallow: /” under “User-agent: *”.