Images, Scripts, and Robots.txt - OH MY!

[gregbuk]

I have been messing with this for far to long and have had two to many calls to Weebly with unexperienced techs on the other end who haven't been able to help me.  

My latest Google Fetch within GWT is telling me that I have a bunch of images and scripts that are all non-indexable by Google.  I presume that this is because they are in the AJAX or APPS folders.  One of the images I can deal with and know how to change...it is an image on my homepage that I have stored as an Asset and then html embedded.  No worries - I can fix this.  

From an SEO stand point, the ones that I am really worried about are all of the Google Map embeds that I have on my site.  I have embedded "My Maps" and also location specific maps for the companies different locations.  I NEED Google to crawl these links, as this will help with my on-page SEO and general relevancy of the local business in the Google Map listings...BUT Weebly does not seem to allow this.

Please tell me this isn't so!  Is there something that I am missing?  Also, if you need additional or more specific details, let me know.

Thanks in advance!

[Adam7]

Hey @gregbuk! Can you give me the URL of one of your pages with a map that isn't being indexed? I'd like to see how it's included on the page.

[gregbuk]

www.swmissouriplumbing.com

[Adam7]

Thanks for the link.  Google won't index the maps because they're included with iframes.  Essentially you'd be asking Google to index content from a complete different site (in this case Google itself) in with your own.  They don't allow this because there'd be nothing to prevent someone from loading any site they want in an iframe and indexing it with their own site.

[gregbuk]

So, to clarify, I understand that Google will not index the map as a part of my map.  I was under the understanding that they would crawl thru my site to the external links (which these maps would qualify as external links).  Is this not the case?

[gregbuk]

*Correction - as a part of my site...not map.

[Adam7]

An iframe isn't like a link, so Google will treat it different.  If you've got the address that you're using with the map on your site along with appropriate text, that should all get indexed for people looking for where to find it.

[SusanLee]

Hi, all this stuff is so over my head but I noticed you said you know how to fix the ajax, etc.  I did a Mobile SEO chekc and it says "Google can not understand this page fully because some page resources are blocked by robots.txt"

How do I fix that? [I'm totally new at all of this stuff, I use goggle webmaster and I assume under crawl I do something?]

Sitemap: http://www.atlantakidsdentist.com/sitemap.xml

User-agent: NerdyBot
Disallow: /

User-agent: *
Disallow: /ajax/
Disallow: /apps/

[gregbuk]

Hey there @SusanLee!  Regarding the AJAX folder, this is a resource folder that Weebly's robots.txt file blocks from the crawlers.  Having a warning pop up in your Google Webmaster Tools regarding the AJAX or APIS folders will not effect your ranking.  Additionally, you can not do anything that will change this.  In other words, no hacking the robots.txt file...

I am taking on dental clients right now, and would be happy to send you a free screencast evaluation of your site and online presence.  If you would like that, let me know what email is the best to reach you at.  If you wish to not post it publicly, you can email me at ninjabombseo@gmail.com.

Blessings,

Greg Bukovatz

316-218-2139

Ninja Bomb Marketing