x

Submitted URL blocked by robots.txt

I have set the website up checked all the correct boxes but google search consul is still telling me that the majority (8 in number) are not showing on google because of the following Submitted URL blocked by robots.txt it is also telling me that the robot text is being blocked at the Weebly end.

I have submitted a ticket but so far have not had any reply.

You can see the site at https://www.globalwarming.media/

I need to clear this up soon as I have another three domains and websites I am thinking of transferring to Weebly but obviously will not do until this is cleared up.

Regards

Steve Simmonds

1,622 Views
Message 1 of 6
Report
1 Best Answer

Best Answer

Adam so many thanks for this will leave it like this, I am afraid I am a writer not a techy once again many thanks for checking it out. I did today get them to check all the different URL's on the site and requested that they be indexed.

You have a great day

Kind Regards

Steve Simmonds

View Best Answer >

1,617 Views
Message 2 of 6
Report
5 REPLIES 5
Square

Can you see a list of the specific pages that Google is giving you that message about? Sometimes Google will give that message about some frontend coding pages used for some features, but they aren't pages that you would actually want indexed since they are just code.

1,620 Views
Message 2 of 6
Report

Hi Adam many thanks for getting back to me so fast it is most appreciated I do not see Andy list but they are giving this for 8 of the pages and URL's

Sitemap: https://www.globalwarming.media/sitemap.xml

User-agent: NerdyBot
Disallow: /

User-agent: *
Disallow: /ajax/
Disallow: /apps/

Kind Regards Steve

1,619 Views
Message 2 of 6
Report
Square

Your sitemap looks totally normal to me and I can see that your site has been indexed fine by Google. Sometimes Google phrases things in ways that sound like something is wrong when it isn't. For example, if all you had in your robots.txt file was blocking one page that you didn't want indexed, Google would tell you that but in a way that makes it sound like something is wrong (even though all you've done is tell them not to index that page).

1,618 Views
Message 2 of 6
Report

Best Answer

Adam so many thanks for this will leave it like this, I am afraid I am a writer not a techy once again many thanks for checking it out. I did today get them to check all the different URL's on the site and requested that they be indexed.

You have a great day

Kind Regards

Steve Simmonds

1,618 Views
Message 2 of 6
Report
Square

Not a problem! It's never a bad idea to check and make sure. If you have other questions feel free to post again. Smiley Happy

1,615 Views
Message 2 of 6
Report
This thread has been archived and locked. Please start a new thread if you would like to continue the conversation.