Camen Design Forum

Sub-forums / Sub-folders ignored by Google Search

append delete steve421

I have noticed that if I have the forum installed to

example.com

if there is a subforum and someone posts in it for example.

example.com/subforum/post

Google fails to index that post and complete subfolder. Any ideas on what could be causing this?

Reply RSS

Replies

append delete #1. Kroc

There was a bug in the generation of the sitemap.xml that was fixed last-minute for v26; which has [finally] been released. Have you upgraded, perhaps this might fix it?

append delete #2. tmyusuf

There are tons of XML sitemap generation tools like AuditMyPC, XML-Sitemaps, or the Google Sitemap Generator that will help you to create your sitemap, however many of these tools will not take the following into consideration.

URL Duplicates: Make sure that you don’t include multiple versions of a URL. For example, if you have domain.com/services and domain.com/services/ make sure you remove one of the URLs so you don’t have any canonical issues.
Robots.txt: Many of the sitemap generators will look at your robots.txt file and not include the directories or urls that you have already omitted. Just make sure that those directories are not being included in your sitemap.
Error Pages: If you notice you have some 404 Error pages in your sitemap, you should either fix those pages so you can include them or remove them from the sitemap.
Images: There is no need to include a list of all of your images in your XML sitemap. Google will come by and index the images when they index the page, so I wouldn’t try and have Google focus on your images.
Invalid Links: Some sitemap generators will have this option, but ignoring invalid relative links will help you with submitting only valid links to the search engines.

Source(stayonsearch)

Reply

(Leave this as-is, it’s a trap!)

There is no need to “register”, just enter the same name + password of your choice every time.

Pro tip: Use markup to add links, quotes and more.

Your friendly neighbourhood moderators: Kroc, Impressed, Martijn