Christian Robottom Reis wrote:

On Tue, Nov 04, 2003 at 12:14:30PM -0800, John Finlay wrote:


John, why doesn't google like http://www.moeraki.com/pygtkreference/ ?
Do you have a robots.txt file keeping it off? Would adding meta
description and meta keywords help, perhaps?



I have a robot.txt file keeping the search engines from indexing the whole tutorial and reference but the top level should appear. My simple


Okay, the next question is "why?" and the other one is "is this negotiable?" <wink>



test indicates that "pygtkreference" and "pygtk reference" in Google both find it though not necessarily first. What's your experience been? I find that having references from other pages (like James site) helps raise the visibility.



Yeah, it comes up pretty low on the front page (8th or 9th hit IIRC). Yes, linking more to it would definitely be a good attractor, but having a free search and index mechanism are guaranteed to make it blow off the roof -- the content is great, and we should really make it easier for people to find it.



My experience has been that the search engines crawl the whole site every day but it doesn't seem to make much difference to the ranking at a fairly high cost in bandwidth. I found with the tutorial that the site was rated higher when other sites made links to it. After adding the robots.txt file to restrict the search to the top level I didn't see any difference in ranking. AFAICT the ranking algorithms used by the search engine folks are a closely guarded secret so it's guesswork to figure out what makes a site rank higher. I suspect a link on James site would do a lot more good than having bots search the site. I figure that the link in the FAQ has been a big win.

I'll open up the reference to the bots to see if that helps as an experiment.

John

_______________________________________________
pygtk mailing list   [EMAIL PROTECTED]
http://www.daa.com.au/mailman/listinfo/pygtk
Read the PyGTK FAQ: http://www.async.com.br/faq/pygtk/

Reply via email to