Jump to content


Photo
- - - - -

Getting my inner pages spidered


  • Please log in to reply
6 replies to this topic

#1 Thrik

Thrik

    Young Padawan

  • Members
  • Pip
  • 6 posts
  • Location:England

Posted 26 November 2005 - 08:47 PM

This whole post concerns http://www.teamkilled.net/

Recently I've invested a little time into getting my website as search engine friendly as possible, and for the most part things seems to be going reasonably well. The problem is, Google doesn't seem to want to index certain inner pages that I'd really like it to.

Basically, I'm posting multiple items of news per day. Each news' headline goes to a permalink version, which is basically a carbon copy of the news item as it appears on the front page. The problem is, Google isn't returning these permalinked versions in the results (example), instead just using the front page and quoting the part of the page in question.

The issue is that after a few days, the news in question will have been knocked off of the front page. This will naturally confuse visitors who click the link after seeing an appropriate summary in the search engine blurb and then discover that the news item is nowhere to be found. Sure, a few seconds with the search utility would find it, but most people aren't willing to indulge that length of interest.

So, does anyone have any specific hints for how I could get Google to return permalinks? I've checked out the pagerank of quite a few of my permalink pages and even ones which are over a month old are returning a pagerank of n/a, indicating that they're not getting spidered at all. However, I'm always getting the various search bots scouring my site.

Thanks! :P

PS: Any generic tips which anyone can spot that might help my traffic in general would be nice. I've been reading numerious articles on these forums concerning it, but I may have missed some things.

Edited by Thrik, 26 November 2005 - 08:50 PM.


#2 Cheyne

Cheyne

    Young Padawan

  • Members
  • Pip
  • 44 posts

Posted 28 November 2005 - 11:16 AM

Create a sitemap for your website, alot of people I have worked with always do this for this reason. Also, if you use Google adsense put them on your inner pages and they will be spidered pretty quickly.

Hope it helps

#3 Thrik

Thrik

    Young Padawan

  • Members
  • Pip
  • 6 posts
  • Location:England

Posted 28 November 2005 - 05:34 PM

Okay, thanks -- done the former. I'll see how that goes for a bit. ^_^

#4 SKETCHi

SKETCHi

    Young Padawan

  • Members
  • Pip
  • 117 posts
  • Location:Southern California

Posted 03 December 2005 - 09:27 PM

I'm pretty sure the AdSense bot has absolutely nothing to do with the Google Search Bot. I think it even says it when you sign-up for Google AdSense, that or it's in their FAQ.

Anyway, a sitemap should help. Also, you need to direct the spiders where to go. The spiders browse the front page, they look at whichever links appear first and then go to those pages in that order. If you want it to index other pages more often, put them at the top of your website menu.

As for increasing traffic, contests have worked for me. Just be willing to invest a little money into it. Posting a link to your website in forum signatures helps too.

#5 Cheyne

Cheyne

    Young Padawan

  • Members
  • Pip
  • 44 posts

Posted 04 December 2005 - 03:29 AM

The only reason I thought that Adsense would get your site crawled faster it because Adsense needs to know your site keywords and I assumes that data came from GoogleBot. Is this not correct?

#6 SKETCHi

SKETCHi

    Young Padawan

  • Members
  • Pip
  • 117 posts
  • Location:Southern California

Posted 04 December 2005 - 02:01 PM

I don't think so. AdSense uses a different bot to crawl the pages you have advertisements on. This bot has nothing to do with Google Search, atleast that's what Google says. If you're an AdSense publisher, check their FAQ. I'm just going off of what I remember from a couple years ago. I'm sure they will have something like that listed in the FAQ.

#7 Cheyne

Cheyne

    Young Padawan

  • Members
  • Pip
  • 44 posts

Posted 05 December 2005 - 10:56 PM

Thanks for the info :)




0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users