Ajax membership code showing on pages without password

[GreatGrit]

Hi,

Ajax code for membership pages (password protected pages) is showing on all my site pages, even though they are not password protected.

This is causing google crawl issues, so I want to remove that code.

Any idea how?

Thanks!

[Adam7]

I just replied to your other post about store code, @GreatGrit - how is this code causing issues with Google crawling your sites?

[GreatGrit]

Hi Adam,

Same for both - Membership and Mini Cart : the default Weebly robot.txt blocks Ajax 

Disallow: /ajax 

 As a result the content is not crawled. 

My main issue here is why do I have Ajax code (for Membership and Mini Cart) on pages that do not use those features?

Thanks!

[Adam7]

That code exists for a site to use even if the feature isn't actually being used, so we just have those rules added to every robots.txt file by default. It doesn't hurt anything to have them there and has zero impact on any other part of a site, though.

[GreatGrit]

Hi Adam,

Google Webmaster shows them as blocked ressources. But I guess there's no workround and it's a partial block. 

Thanks!

[Adam7 · Accepted solution]

Right, since they are blocked; I guess what I'm not communicating very well is that it won't hurt anything else with your site to have those blocked since it's just site resources and not content you've added.

[GreatGrit]

ok, got it, thanks!

[kdoner]

I'm confused about this because Google seems not to like it very much. I get error messages and requestes to delete that line in the bot code. All together Google tallys your cooperativeness and this is a thorn in its side, so it lowers the site rankings. 

Is it possible to remove the ajax line of the code?

[Adam7]

It isn't possible to remove that, but it won't hurt indexing of the rest of your site anyway. Google phrases things in the way they do because they can't know whether you want something indexed or not, and they err on the side that you want everything indexed.

[mindyblock]

I have embedded dynamic content data coming in from another server.  I can allow for AJAX on that server, but not sure about Weebly.  The weebly robots.txt for my site says it dissallows ajax .

Help,

Thanks, Mindy ...

[Bernadette3]

Hi Mindy. It should cause any type of error. Are you running into an issue on Google's end?