Re: simple spider in python
> I'm trying to do a simple spider in python which:
>
> 1) ask google a query
> 2) parse the data
While you could use urllib2.urlopen() as Frederick mentioned, there is
actually a Python module built JUST for getting info from Google
queries! So check out PyGoogle: http://pygoogle.sourceforge.net/
After you install and import it like a normal Python module, you can
do things like:
doGoogleSearch("thing to query") and get results! Very easy to use.
One thing that might throw you at first: You need to get an API key
from Google, and use that when you setup the classes. The link I
pasted above has all the details.
Good luck!
-Sam
--
http://mail.python.org/mailman/listinfo/python-list
Re: simple spider in python
> Somewhere in the middle between the two suggestions you've already > received is http://www.unixreview.com/documents/s=10133/ur0706e/>. I followed that link, and got an error page... As to the Google API key issue, I was unaware of that. Very annoying of them to stop that service. PyGoogle will basically be useless. The next best thing might be getting an API key for the AJAX API, and using a browser based implementation... -- http://mail.python.org/mailman/listinfo/python-list
Re: simple spider in python
On Aug 23, 4:49 pm, [EMAIL PROTECTED] wrote: > well, i think that they deserve people moving toward yahoo's API... > check this out:http://pysearch.sourceforge.net/ > it's basically the same thing as pygoogle BUT working with google's > competitor. it seems like internet has its own built-in antibodyes! > ^__^ > > cheers! Had not seen this project before. Looks helpful, thanks! (If only Yahoo! Search did not suck in comparison to Google's..., but better than nothing:-) -- http://mail.python.org/mailman/listinfo/python-list
