- Subscribe to RSS Feed
- Mark Thread as New
- Mark Thread as Read
- Float this Thread for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
Hi, is there the posibility to modify the file robot.txt??
Now my file is like this:
User-agent: *
Disallow: /
and i want permit all...
Thanks
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report
- Subscribe to RSS Feed
- Mark Thread as New
- Mark Thread as Read
- Float this Thread for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
Hi Tony!
I know you found the answer to your question, but just so anyone else reading is clear...
Weebly automatically creates a blank robots.txt file for your site. If you look at your robots.txt file (www.yourdomainhere.com/robots.txt), you'll see text similar to this:
User-agent: *
Disallow: /ajax/
Disallow: /apps/
The user-agent: * means that the rules in this file applies to all robots. The "Disallow: /ajax/" and "Disallow: /apps/ " lines mean that robots cannot index any files you've uploaded to your store to sell (this is a default setting, so you'll see this line even if you're not using the Weebly store features). If nothing else is listed, it means that nothing else on your site is disallowed. If there were anything being blocked, it would show up after the second "disallow" but as long as that is blank, none of your pages are blocked and search engines can find your site.
If you want to change this and block search engines from indexing your site, go to Settings > SEO and select "Hide site from search engines." Then Save and Publish.
The robots.txt file for a site that is completely hidden from search would look like this:
User-agent: *
Disallow: /
Let us know if there are any other questions!

- Subscribe to RSS Feed
- Mark Thread as New
- Mark Thread as Read
- Float this Thread for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
Those lines in your robots.txt file will only prevent indexing by that particular search bot (NerdyBot). Underneath that you should see something like:
User-agent: *
Disallow: /ajax/
Disallow: /apps/
etc
This will apply to all search engines, so only these rules will apply to Google.
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report
- Subscribe to RSS Feed
- Mark Thread as New
- Mark Thread as Read
- Float this Thread for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
How do I get to see the txt that is written, where do I see what is written in the file?
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report
- « Previous
- Next »