NAME
scrapy-ws - Python Scrapy web service control script
SYNOPSIS
scrapy-ws [-P|-H] action ...
DESCRIPTION
Example script to control and monitor Scrapy using its web service. It only provides a reduced functionality as its main purpose is to illustrate how to write a web service client. Feel free to improve or write you own.
OPTIONS
- -H
-
Scrapy host to connect to. (default: localhost)
- -P
-
Scrapy port to connect to. (default: 6080)
- help
-
List of available commands
- run <spider_name>
-
Schedule spider for running
- stop <spider>
-
Stop a running spider
- list-running
-
List running spiders
- list-available
-
List name of available spiders
- list-resources
-
List available web service resources
- list-extensions
-
List enabled extensions
- get-spider-stats <spider>
-
Get stats of a running spider
- get-global-stats
-
Get global stats
AUTHOR
Scrapy-ws was written by the Scrapy Developers <[email protected]>.
This manual page was written by Ignace Mouzannar <[email protected]>, for the Debian project (but may be used by others).