Run Scrapy command from crontab

Getting below error while running scrapy command from cron job

UserWarning: Cannot import scrapy settings module myspider.settings
  warnings.warn("Cannot import scrapy settings module %s" % scrapy_module)
.....
raise KeyError("Spider not found: %s" % spider_name)
KeyError: 'Spider not found:

scrapy spider crontab

asked Sep 13 '12 at 09:50

mutant
1

edited Sep 13 '12 at 16:30

seanf ♦♦
5629●1●2●20

We need more information to be able to assist with this. Can you please post the line from your crontab that is running this, and let us know where you have scrapy installed?

If you'd rather not post that in the forum, please feel free to open a support ticket.

(Sep 13 '12 at 16:32) seanf ♦♦

Be the first one to answer this question!

If you have an answer to the above question, then use the form below. Otherwise, use the appropriate 'add new comment' button above to post your feedback.

toggle preview

community wiki

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Tags:

crontab ×37
scrapy ×1
spider ×1

Asked: Sep 13 '12 at 09:50

Seen: 416 times

Last updated: Sep 13 '12 at 16:32

Run Scrapy command from crontab

Follow this question

Got questions? We have answers!

Related questions