安装Scarpy踩过的坑
安装Scarpy踩过的坑
Scrapy是python下一个著名的爬虫,目前最新版为0.24。
这是他的帮助文档->Scrapy 0.24 文档
其中选择器篇需要好好研究!
帮助文档里的安装指南写得很宽泛,所以安装出错是在正常不过的事了。(再者说,安装出错确实不是Scrapy的错嘛)
So here is the doc to help you with installing Scrapy.
First of all, before installing, please make sure U have already installed these libs or apps below:
- python version >= 2.7
- python-devel package
- libs:
- xml2-dev
- xslt-dev
- ffi-dev
- openssl-dev
If not, commands below may help:
on Redhat/Centos:
yum install python-devel libxml2-devel libxslt-devel libffi-devel openssl-devel bzip2-devel
on Debian/Ubuntu:
apt-get install python-dev libxml2-dev libxslt1-dev libffi-dev libssl-dev libbz2-dev
If your python version is less than 2.7, this article -> upgrade python may help U in upgrading python.
I have summarized some errors when installing scrapy and hope they can be used as a reference for you.
CompressionError: bz2 module is not available
This usually happens when you have compiled python and use pip install Scrapy
command.
The reason is you don't have bzip2 lib installed:
on Redhat/Centos:
yum install bzip2-devel
on Debian/Ubuntu:
apt-get install libbz2-dev
After you have installed the bzip2 package,you have to compile python again to make bzip module work.
Finally,use pip install --upgrade scrapy
to finish the installation.
Setup script exited with error: command 'gcc' failed with exit status 1
The cause is u didn't install python-dev
on Redhat/Centos:
yum install python-devel
on Debian/Ubuntu:
apt-get install python-dev
Finally,use pip install scrapy
or easy_install scrapy
to finish the installation.
error: Not a recognized archive type: /tmp/easy_install-dayrGH/Twisted-14.0.0.tar.bz2
Haha,that's because you already have installed the package!
UserWarning: You do not have the service_identity module installed.
sudo pip install service_identity
That's all for now.Thank u for viewing.
相关文章
- 佛萨奇2.0波场链/币安链/马蹄链DAPP智能合约系统开发成功案例及源码交付
- BetterScroll2.0在Vue中的基本使用
- 封装格式化日期工具函数
- 封装获取URL中params的值
- Vue非父子组件传值之事件总线(eventbus)的使用方式
- Neuron 2.3.0 发布:更轻松地接入和管理海量工业设备
- Vue中websocket的使用方法
- IE中 时间对象方法getTime返回NaN
- 解决WebGl使用OrbitControls控件监听鼠标操作时报错
- ES6新内置对象Reflect和Proxy的基本使用
- Mac电脑照片编辑修图软件精选 每一款各有千秋!
- Vue双向绑定实现原理
- M1/M2 芯片的Mac电脑上虚拟机安装 Windows 11 图文教程
- ES6内置对象Proxy代理数据demo
- React初识 Hello React
- ES6展开语法Spread syntax(...)
- 高德地图使用插件报错AMap.Xxx is not constructor
- React脚手架配置代理解决跨域问题
- React路由传递params、search、state参数的相关处理
- React中组件通信方式