pip install scrapy -i http://pypi.douban.com/simple
pip install fake-useragent -i http://pypi.douban.com/simple
pip install Faker
pip install cos-python-sdk-v5 -i http://pypi.douban.com/simple
pip install selenium -i http://pypi.douban.com/simple
pip install twisted -i http://pypi.douban.com/simple
pip install requests -i http://pypi.douban.com/simple
pip install datetime -i http://pypi.douban.com/simple
pip install scrapy==1.8.0 //linux上python2.7則必須裝這個(gè)版本
pip install scrapy-fake-useragent
pip install scrapy-user-agents
安裝phantomjs https://bitbucket.org/ariya/phantomjs/downloads/ 找官網(wǎng)下載
放環(huán)境變量 sudo ln -sf /usr/local/app/.local/lib/python2.7/site-packages/phantomjs /usr/local/bin/phantomjs
或者(executable_path="/usr/local/app/.local/lib/python2.7/site-packages/phantomjs")
執(zhí)行phantomjs -v
yum install bitmap-fonts bitmap-fonts-cjk

mac安裝phantomjs
brew update && brew install phantomjs
phantomjs -v