I've got a Solr instance which crawls roughly 3,500 seed pages, depth of 1, at 240 institutions, all but 1 of which I don't control. I recrawl once a month or so. Naturally if one of the sites I crawl changes, then I need to know to update my seed URLs. I've been checking this by hand, which was tenable when my site was smaller, but is now completely unreasonable.
Is there a way to test my index without actually having to run a lot of manual searches? Perhaps an output I could skim? Any suggestions would be helpful. Thanks, Chip
