On 01/22/2009 11:37 PM, Johnathan Nightingale:
I would love a way to query the data directly, do you know of such a front end, particularly for SQLite?
I know very little about sqlite really.
If not, if you know of a generic DB-browsing front end for something like MySQL, I can look at porting a copy of the database over.
There are many Goo Ees for MySQL. Also maybe a web based search tool could be also interesting. That would need more resources on your side, but could be done with Phyton and Sqlite too (not sure about the speed however).
Even with indices, querying the database can take tens of seconds, if not minutes, so it won't exactly be speedy; but it would be more accessible that way.
I guess not. Searching 250,000 entries and getting the results should be a matter milliseconds, but obviously depending on the data which is returned it might take a while to (down)load.
Anyway, it's an interesting effort and if we can reach more sites, we could refine it and build some monthly statistics (and not depend on Netcraft anymore ;-) )
I also wanted to ask, how much resources did it suck up? Wasn't the Toronto line bogged down because of your robot (are you in Canada at all?). It could be just a co-incident...which happened recently.
-- Regards Signer: Eddy Nigg, StartCom Ltd. Jabber: start...@startcom.org Blog: https://blog.startcom.org -- dev-tech-crypto mailing list dev-tech-crypto@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-tech-crypto
