以 下廚房 為例 :
pip3 install scrapyd(服務(wù))
pip3 install scrapyd-client(打包)
scrapyd-deploy -p xiachufang --version 1.0
需要安裝curl
sudo apt-get install curl
調(diào)度爬蟲(chóng)開(kāi)始運(yùn)行
curl http://localhost:6800/schedule.json -d project=xiachufang -d spider=xcfCrawlSpider
關(guān)閉爬蟲(chóng)
curl http://localhost:6800/cancel.json -d project=xiachufang -d job=f9b3db46130a11e98490bca8a6e07fd6 (jobid)
獲取部署的項(xiàng)目列表
curl http://localhost:6800/listprojects.jsoncurl http://localhost:6800/listversions.json?
project=xiachufang
獲取項(xiàng)目的版本號(hào)
curl http://localhost:6800/listversions.json?
project=xiachufang
獲取項(xiàng)目下的爬蟲(chóng)文件
curl http://localhost:6800/listspiders.json?project=myproject
獲取爬蟲(chóng)的運(yùn)行狀態(tài)
curl http://localhost:6800/listjobs.json?project=myproject
刪除對(duì)應(yīng)版本的項(xiàng)目
curl http://localhost:6800/delversion.json -d project=myproject -d version=r99
直接刪除項(xiàng)目
curl http://localhost:6800/delproject.json -d project=myproject
僅為個(gè)人學(xué)習(xí)小結(jié),若有錯(cuò)處,歡迎指正~