Dear everyone
I did a crawler using scrapy , and it's cool. However there is a
problem, how can I change the spider's name? My crawler can crawl a list of
similar website , so I want to run it in a distributed environment and feed
them in some different times. Because of that , I want to distinguish them
use the spider's name , but it is in the same spider.py . I ask a question
in the stackoverflow and there is the url :
https://stackoverflow.com/questions/44202110/is-there-any-way-to-change-scrapy-spiders-name-by-script
.
Thanks in advance.
Wang Haomao
--
You received this message because you are subscribed to the Google Groups
"scrapy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/scrapy-users.
For more options, visit https://groups.google.com/d/optout.
