艰难安装pyspider
环境：WIN10，python3.6.
这个pyspider搞了我两天终于安装好了。
1.首先把安装好的库全部删除
```python
pip freeze > allpackages.txt
pip uninstall -r allpackages.txt -y
## 功能快捷键
```python
Microsoft Windows [版本 10.0.18362.1256]
(c) 2019 Microsoft Corporation。保留所有权利。
C:\WINDOWS\system32>pip freeze > allpackages.txt
C:\WINDOWS\system32>pip uninstall -r allpackages.txt -y
Found existing installation: certifi 2021.10.8
Uninstalling certifi-2021.10.8:
Successfully uninstalled certifi-2021.10.8
Found existing installation: chardet 4.0.0
Uninstalling chardet-4.0.0:
Successfully uninstalled chardet-4.0.0
Found existing installation: charset-normalizer 2.0.7
Uninstalling charset-normalizer-2.0.7:
Successfully uninstalled charset-normalizer-2.0.7
Found existing installation: click 8.0.3
Uninstalling click-8.0.3:
Successfully uninstalled click-8.0.3
Found existing installation: colorama 0.4.4
Uninstalling colorama-0.4.4:
Successfully uninstalled colorama-0.4.4
Found existing installation: cssselect 1.1.0
Uninstalling cssselect-1.1.0:
Successfully uninstalled cssselect-1.1.0
Found existing installation: dataclasses 0.8
Uninstalling dataclasses-0.8:
Successfully uninstalled dataclasses-0.8
Found existing installation: defusedxml 0.7.1
Uninstalling defusedxml-0.7.1:
Successfully uninstalled defusedxml-0.7.1
Found existing installation: Flask 1.1.1
Uninstalling Flask-1.1.1:
Successfully uninstalled Flask-1.1.1
Found existing installation: Flask-Login 0.5.0
Uninstalling Flask-Login-0.5.0:
Successfully uninstalled Flask-Login-0.5.0
Found existing installation: idna 3.3
Uninstalling idna-3.3:
Successfully uninstalled idna-3.3
Found existing installation: importlib-metadata 4.8.2
Uninstalling importlib-metadata-4.8.2:
Successfully uninstalled importlib-metadata-4.8.2
Found existing installation: itsdangerous 2.0.1
Uninstalling itsdangerous-2.0.1:
Successfully uninstalled itsdangerous-2.0.1
Found existing installation: Jinja2 3.0.3
Uninstalling Jinja2-3.0.3:
Successfully uninstalled Jinja2-3.0.3
Found existing installation: json5 0.9.6
Uninstalling json5-0.9.6:
Successfully uninstalled json5-0.9.6
Found existing installation: lxml 4.6.4
Uninstalling lxml-4.6.4:
Successfully uninstalled lxml-4.6.4
Found existing installation: MarkupSafe 2.0.1
Uninstalling MarkupSafe-2.0.1:
Successfully uninstalled MarkupSafe-2.0.1
Found existing installation: pycurl 7.43.0.5
Uninstalling pycurl-7.43.0.5:
Successfully uninstalled pycurl-7.43.0.5
Found existing installation: pyquery 1.4.3
Uninstalling pyquery-1.4.3:
Successfully uninstalled pyquery-1.4.3
Found existing installation: pyspider 0.3.10
Uninstalling pyspider-0.3.10:
Successfully uninstalled pyspider-0.3.10
Found existing installation: PyYAML 6.0
Uninstalling PyYAML-6.0:
Successfully uninstalled PyYAML-6.0
Found existing installation: requests 2.26.0
Uninstalling requests-2.26.0:
Successfully uninstalled requests-2.26.0
Found existing installation: six 1.16.0
Uninstalling six-1.16.0:
Successfully uninstalled six-1.16.0
Found existing installation: tblib 1.7.0
Uninstalling tblib-1.7.0:
Successfully uninstalled tblib-1.7.0
Found existing installation: tornado 4.5.3
Uninstalling tornado-4.5.3:
Successfully uninstalled tornado-4.5.3
Found existing installation: typing-extensions 3.10.0.2
Uninstalling typing-extensions-3.10.0.2:
Successfully uninstalled typing-extensions-3.10.0.2
Found existing installation: u-msgpack-python 2.7.1
Uninstalling u-msgpack-python-2.7.1:
Successfully uninstalled u-msgpack-python-2.7.1
Found existing installation: urllib3 1.26.7
Uninstalling urllib3-1.26.7:
Successfully uninstalled urllib3-1.26.7
Found existing installation: Werkzeug 0.16.0
Uninstalling Werkzeug-0.16.0:
Successfully uninstalled Werkzeug-0.16.0
Found existing installation: WsgiDAV 3.1.1
Uninstalling WsgiDAV-3.1.1:
Successfully uninstalled WsgiDAV-3.1.1
Found existing installation: zipp 3.6.0
Uninstalling zipp-3.6.0:
Successfully uninstalled zipp-3.6.0
C:\WINDOWS\system32>pip list
Package Version
---------- -------
pip 21.3.1
setuptools 39.0.1
C:\WINDOWS\system32>pip install redis
Collecting redis
Using cached redis-3.5.3-py2.py3-none-any.whl (72 kB)
Installing collected packages: redis
Successfully installed redis-3.5.3
C:\WINDOWS\system32>pip install pyspider
Collecting pyspider
Using cached pyspider-0.3.10.tar.gz (110 kB)
Preparing metadata (setup.py) ... done
Collecting Flask>=0.10
Using cached Flask-2.0.2-py3-none-any.whl (95 kB)
Collecting Jinja2>=2.7
Using cached Jinja2-3.0.3-py3-none-any.whl (133 kB)
Collecting chardet>=2.2
Using cached chardet-4.0.0-py2.py3-none-any.whl (178 kB)
Collecting cssselect>=0.9
Using cached cssselect-1.1.0-py2.py3-none-any.whl (16 kB)
Collecting lxml
Using cached lxml-4.6.4-cp36-cp36m-win_amd64.whl (3.5 MB)
Collecting pycurl
Using cached pycurl-7.44.1.tar.gz (227 kB)
Preparing metadata (setup.py) ... error
ERROR: Command errored out with exit status 10:
command: 'c:\python36\python.exe' -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\pip-install-od5xf9pg\\pycurl_74ff19b3fc4a46a698100a7ab5b4966b\\setup.py'"'"'; __file__='"'"'C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\pip-install-od5xf9pg\\pycurl_74ff19b3fc4a46a698100a7ab5b4966b\\setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base 'C:\Users\ADMINI~1\AppData\Local\Temp\pip-pip-egg-info-o5q4ji9k'
cwd: C:\Users\ADMINI~1\AppData\Local\Temp\pip-install-od5xf9pg\pycurl_74ff19b3fc4a46a698100a7ab5b4966b\
Complete output (1 lines):
Please specify --curl-dir=/path/to/built/libcurl
----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/47/f9/c41d6830f7bd4e70d5726d26f8564538d08ca3a7ac3db98b325f94cdcb7f/pycurl-7.44.1.tar.gz#sha256=5bcef4d988b74b99653602101e17d8401338d596b9234d263c728a0c3df003e8 (from https://pypi.org/simple/pycurl/) (requires-python:>=3.5). Command errored out with exit status 10: python setup.py egg_info Check the logs for full command output.
Using cached pycurl-7.44.0.tar.gz (227 kB)
Preparing metadata (setup.py) ... error
ERROR: Command errored out with exit status 10:
command: 'c:\python36\python.exe' -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\pip-install-od5xf9pg\\pycurl_6ef43aa1f0ee4b939b0510b3ceedd4c7\\setup.py'"'"'; __file__='"'"'C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\pip-install-od5xf9pg\\pycurl_6ef43aa1f0ee4b939b0510b3ceedd4c7\\setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base 'C:\Users\ADMINI~1\AppData\Local\Temp\pip-pip-egg-info-lsay5eyz'
cwd: C:\Users\ADMINI~1\AppData\Local\Temp\pip-install-od5xf9pg\pycurl_6ef43aa1f0ee4b939b0510b3ceedd4c7\
Complete output (1 lines):
Please specify --curl-dir=/path/to/built/libcurl
----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/0f/db/856a430445d6cd631a7c97f028e3a9d947f84a1a27c42b5d47245eae920e/pycurl-7.44.0.tar.gz#sha256=2ce9905626d8ceafcbadee666e2f45397e29c7618ddcdc63fc22d85e5046c6d6 (from https://pypi.org/simple/pycurl/) (requires-python:>=3.5). Command errored out with exit status 10: python setup.py egg_info Check the logs for full command output.
Using cached pycurl-7.43.0.6.tar.gz (222 kB)
Preparing metadata (setup.py) ... error
ERROR: Command errored out with exit status 10:
command: 'c:\python36\python.exe' -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\pip-install-od5xf9pg\\pycurl_9ac24d9650f7498a8357325c3d81df21\\setup.py'"'"'; __file__='"'"'C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\pip-install-od5xf9pg\\pycurl_9ac24d9650f7498a8357325c3d81df21\\setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base 'C:\Users\ADMINI~1\AppData\Local\Temp\pip-pip-egg-info-4mmvcati'
cwd: C:\Users\ADMINI~1\AppData\Local\Temp\pip-install-od5xf9pg\pycurl_9ac24d9650f7498a8357325c3d81df21\
Complete output (1 lines):
Please specify --curl-dir=/path/to/built/libcurl
----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/50/1a/35b1d8b8e4e23a234f1b17a8a40299fd550940b16866c9a1f2d47a04b969/pycurl-7.43.0.6.tar.gz#sha256=8301518689daefa53726b59ded6b48f33751c383cf987b0ccfbbc4ed40281325 (from https://pypi.org/simple/pycurl/) (requires-python:>=3.5). Command errored out with exit status 10: python setup.py egg_info Check the logs for full command output.
Using cached pycurl-7.43.0.5-cp36-cp36m-win_amd64.whl (1.7 MB)
Collecting requests>=2.2
Using cached requests-2.26.0-py2.py3-none-any.whl (62 kB)
Collecting Flask-Login>=0.2.11
Using cached Flask_Login-0.5.0-py2.py3-none-any.whl (16 kB)
Collecting u-msgpack-python>=1.6
Using cached u_msgpack_python-2.7.1-py2.py3-none-any.whl (10.0 kB)
Collecting click>=3.3
Using cached click-8.0.3-py3-none-any.whl (97 kB)
Collecting six>=1.5.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting tblib>=1.3.0
Using cached tblib-1.7.0-py2.py3-none-any.whl (12 kB)
Collecting wsgidav>=2.0.0
Using cached WsgiDAV-3.1.1-py2.py3-none-any.whl (180 kB)
Collecting tornado<=4.5.3,>=3.2
Using cached tornado-4.5.3-cp36-cp36m-win_amd64.whl (423 kB)
Collecting pyquery
Using cached pyquery-1.4.3-py3-none-any.whl (22 kB)
Collecting colorama
Using cached colorama-0.4.4-py2.py3-none-any.whl (16 kB)
Collecting importlib-metadata
Using cached importlib_metadata-4.8.2-py3-none-any.whl (17 kB)
Collecting itsdangerous>=2.0
Using cached itsdangerous-2.0.1-py3-none-any.whl (18 kB)
Collecting Werkzeug>=2.0
Using cached Werkzeug-2.0.2-py3-none-any.whl (288 kB)
Collecting MarkupSafe>=2.0
Using cached MarkupSafe-2.0.1-cp36-cp36m-win_amd64.whl (14 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.7-py3-none-any.whl (38 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.7-py2.py3-none-any.whl (138 kB)
Collecting json5
Using cached json5-0.9.6-py2.py3-none-any.whl (18 kB)
Collecting defusedxml
Using cached defusedxml-0.7.1-py2.py3-none-any.whl (25 kB)
Collecting PyYAML
Using cached PyYAML-6.0-cp36-cp36m-win_amd64.whl (153 kB)
Collecting dataclasses
Using cached dataclasses-0.8-py3-none-any.whl (19 kB)
Collecting zipp>=0.5
Using cached zipp-3.6.0-py3-none-any.whl (5.3 kB)
Collecting typing-extensions>=3.6.4
Using cached typing_extensions-3.10.0.2-py3-none-any.whl (26 kB)
Using legacy 'setup.py install' for pyspider, since package 'wheel' is not installed.
Installing collected packages: zipp, typing-extensions, MarkupSafe, importlib-metadata, dataclasses, colorama, Werkzeug, Jinja2, itsdangerous, click, urllib3, six, PyYAML, lxml, json5, idna, Flask, defusedxml, cssselect, charset-normalizer, certifi, wsgidav, u-msgpack-python, tornado, tblib, requests, pyquery, pycurl, Flask-Login, chardet, pyspider
Running setup.py install for pyspider ... done
Successfully installed Flask-2.0.2 Flask-Login-0.5.0 Jinja2-3.0.3 MarkupSafe-2.0.1 PyYAML-6.0 Werkzeug-2.0.2 certifi-2021.10.8 chardet-4.0.0 charset-normalizer-2.0.7 click-8.0.3 colorama-0.4.4 cssselect-1.1.0 dataclasses-0.8 defusedxml-0.7.1 idna-3.3 importlib-metadata-4.8.2 itsdangerous-2.0.1 json5-0.9.6 lxml-4.6.4 pycurl-7.43.0.5 pyquery-1.4.3 pyspider-0.3.10 requests-2.26.0 six-1.16.0 tblib-1.7.0 tornado-4.5.3 typing-extensions-3.10.0.2 u-msgpack-python-2.7.1 urllib3-1.26.7 wsgidav-3.1.1 zipp-3.6.0
C:\WINDOWS\system32>pyspider all
c:\python36\lib\site-packages\pyspider\libs\utils.py:196: FutureWarning: timeout is not supported on your platform.
warnings.warn("timeout is not supported on your platform.", FutureWarning)
phantomjs fetcher running on port 25555
[I 211114 22:54:27 result_worker:49] result_worker starting...
[I 211114 22:54:27 processor:211] processor starting...
[I 211114 22:54:27 scheduler:647] scheduler starting...
[I 211114 22:54:27 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0
[I 211114 22:54:29 scheduler:782] scheduler.xmlrpc listening on 127.0.0.1:23333
[I 211114 22:54:29 tornado_fetcher:638] fetcher starting...
[I 211114 22:54:31 run:420] phantomjs exited.
[I 211114 22:54:31 tornado_fetcher:671] fetcher exiting...
[I 211114 22:54:31 app:84] webui exiting...
[I 211114 22:54:31 result_worker:66] result_worker exiting...
[I 211114 22:54:31 scheduler:663] scheduler exiting...
[I 211114 22:54:31 processor:229] processor exiting...
Traceback (most recent call last):
File "C:\Python36\Scripts\pyspider-script.py", line 11, in <module>
load_entry_point('pyspider==0.3.10', 'console_scripts', 'pyspider')()
File "c:\python36\lib\site-packages\pyspider\run.py", line 754, in main
cli()
File "c:\python36\lib\site-packages\click\core.py", line 1128, in __call__
return self.main(*args, **kwargs)
File "c:\python36\lib\site-packages\click\core.py", line 1053, in main
rv = self.invoke(ctx)
File "c:\python36\lib\site-packages\click\core.py", line 1659, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "c:\python36\lib\site-packages\click\core.py", line 1395, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "c:\python36\lib\site-packages\click\core.py", line 754, in invoke
return __callback(*args, **kwargs)
File "c:\python36\lib\site-packages\click\decorators.py", line 26, in new_func
return f(get_current_context(), *args, **kwargs)
File "c:\python36\lib\site-packages\pyspider\run.py", line 497, in all
ctx.invoke(webui, **webui_config)
File "c:\python36\lib\site-packages\click\core.py", line 754, in invoke
return __callback(*args, **kwargs)
File "c:\python36\lib\site-packages\click\decorators.py", line 26, in new_func
return f(get_current_context(), *args, **kwargs)
File "c:\python36\lib\site-packages\pyspider\run.py", line 384, in webui
app.run(host=host, port=port)
File "c:\python36\lib\site-packages\pyspider\webui\app.py", line 59, in run
from .webdav import dav_app
File "c:\python36\lib\site-packages\pyspider\webui\webdav.py", line 216, in <module>
dav_app = WsgiDAVApp(config)
File "c:\python36\lib\site-packages\wsgidav\wsgidav_app.py", line 133, in __init__
_check_config(config)
File "c:\python36\lib\site-packages\wsgidav\wsgidav_app.py", line 117, in _check_config
raise ValueError("Invalid configuration:\n - " + "\n - ".join(errors))
ValueError: Invalid configuration:
- Deprecated option 'domaincontroller': use 'http_authenticator.domain_controller' instead.
C:\WINDOWS\system32>pyspider all
c:\python36\lib\site-packages\pyspider\libs\utils.py:196: FutureWarning: timeout is not supported on your platform.
warnings.warn("timeout is not supported on your platform.", FutureWarning)
phantomjs fetcher running on port 25555
[I 211114 22:56:01 result_worker:49] result_worker starting...
[I 211114 22:56:01 processor:211] processor starting...
[I 211114 22:56:01 scheduler:647] scheduler starting...
[I 211114 22:56:01 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0
[I 211114 22:56:02 scheduler:782] scheduler.xmlrpc listening on 127.0.0.1:23333
[I 211114 22:56:03 tornado_fetcher:638] fetcher starting...
[I 211114 22:56:05 run:420] phantomjs exited.
[I 211114 22:56:05 app:84] webui exiting...
[I 211114 22:56:05 tornado_fetcher:671] fetcher exiting...
[I 211114 22:56:05 scheduler:663] scheduler exiting...
[I 211114 22:56:05 result_worker:66] result_worker exiting...
[I 211114 22:56:05 processor:229] processor exiting...
Traceback (most recent call last):
File "C:\Python36\Scripts\pyspider-script.py", line 11, in <module>
load_entry_point('pyspider==0.3.10', 'console_scripts', 'pyspider')()
File "c:\python36\lib\site-packages\pyspider\run.py", line 754, in main
cli()
File "c:\python36\lib\site-packages\click\core.py", line 1128, in __call__
return self.main(*args, **kwargs)
File "c:\python36\lib\site-packages\click\core.py", line 1053, in main
rv = self.invoke(ctx)
File "c:\python36\lib\site-packages\click\core.py", line 1659, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "c:\python36\lib\site-packages\click\core.py", line 1395, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "c:\python36\lib\site-packages\click\core.py", line 754, in invoke
return __callback(*args, **kwargs)
File "c:\python36\lib\site-packages\click\decorators.py", line 26, in new_func
return f(get_current_context(), *args, **kwargs)
File "c:\python36\lib\site-packages\pyspider\run.py", line 497, in all
ctx.invoke(webui, **webui_config)
File "c:\python36\lib\site-packages\click\core.py", line 754, in invoke
return __callback(*args, **kwargs)
File "c:\python36\lib\site-packages\click\decorators.py", line 26, in new_func
return f(get_current_context(), *args, **kwargs)
File "c:\python36\lib\site-packages\pyspider\run.py", line 384, in webui
app.run(host=host, port=port)
File "c:\python36\lib\site-packages\pyspider\webui\app.py", line 64, in run
from werkzeug.wsgi import DispatcherMiddleware
ImportError: cannot import name 'DispatcherMiddleware'
C:\WINDOWS\system32>pip list
Package Version
------------------ ---------
certifi 2021.10.8
chardet 4.0.0
charset-normalizer 2.0.7
click 8.0.3
colorama 0.4.4
cssselect 1.1.0
dataclasses 0.8
defusedxml 0.7.1
Flask 2.0.2
Flask-Login 0.5.0
idna 3.3
importlib-metadata 4.8.2
itsdangerous 2.0.1
Jinja2 3.0.3
json5 0.9.6
lxml 4.6.4
MarkupSafe 2.0.1
pip 21.3.1
pycurl 7.43.0.5
pyquery 1.4.3
pyspider 0.3.10
PyYAML 6.0
redis 3.5.3
requests 2.26.0
setuptools 39.0.1
six 1.16.0
tblib 1.7.0
tornado 4.5.3
typing-extensions 3.10.0.2
u-msgpack-python 2.7.1
urllib3 1.26.7
Werkzeug 2.0.2
WsgiDAV 3.1.1
zipp 3.6.0
C:\WINDOWS\system32>pip uninstall Flask
Found existing installation: Flask 2.0.2
Uninstalling Flask-2.0.2:
Would remove:
c:\python36\lib\site-packages\flask-2.0.2.dist-info\*
c:\python36\lib\site-packages\flask\*
c:\python36\scripts\flask.exe
Proceed (Y/n)? y
Successfully uninstalled Flask-2.0.2
C:\WINDOWS\system32>pip install Flask==1.0.1
Collecting Flask==1.0.1
Downloading Flask-1.0.1-py2.py3-none-any.whl (91 kB)
|████████████████████████████████| 91 kB 1.1 MB/s
Requirement already satisfied: itsdangerous>=0.24 in c:\python36\lib\site-packages (from Flask==1.0.1) (2.0.1)
Requirement already satisfied: Jinja2>=2.10 in c:\python36\lib\site-packages (from Flask==1.0.1) (3.0.3)
Requirement already satisfied: click>=5.1 in c:\python36\lib\site-packages (from Flask==1.0.1) (8.0.3)
Requirement already satisfied: Werkzeug>=0.14 in c:\python36\lib\site-packages (from Flask==1.0.1) (2.0.2)
Requirement already satisfied: colorama in c:\python36\lib\site-packages (from click>=5.1->Flask==1.0.1) (0.4.4)
Requirement already satisfied: importlib-metadata in c:\python36\lib\site-packages (from click>=5.1->Flask==1.0.1) (4.8.2)
Requirement already satisfied: MarkupSafe>=2.0 in c:\python36\lib\site-packages (from Jinja2>=2.10->Flask==1.0.1) (2.0.1)
Requirement already satisfied: dataclasses in c:\python36\lib\site-packages (from Werkzeug>=0.14->Flask==1.0.1) (0.8)
Requirement already satisfied: zipp>=0.5 in c:\python36\lib\site-packages (from importlib-metadata->click>=5.1->Flask==1.0.1) (3.6.0)
Requirement already satisfied: typing-extensions>=3.6.4 in c:\python36\lib\site-packages (from importlib-metadata->click>=5.1->Flask==1.0.1) (3.10.0.2)
Installing collected packages: Flask
Successfully installed Flask-1.0.1
C:\WINDOWS\system32>pyspider all
c:\python36\lib\site-packages\pyspider\libs\utils.py:196: FutureWarning: timeout is not supported on your platform.
warnings.warn("timeout is not supported on your platform.", FutureWarning)
phantomjs fetcher running on port 25555
[I 211114 22:58:12 result_worker:49] result_worker starting...
[I 211114 22:58:12 processor:211] processor starting...
[I 211114 22:58:12 scheduler:647] scheduler starting...
[I 211114 22:58:12 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0
[I 211114 22:58:14 scheduler:782] scheduler.xmlrpc listening on 127.0.0.1:23333
[I 211114 22:58:14 tornado_fetcher:638] fetcher starting...
[I 211114 22:58:16 run:420] phantomjs exited.
[I 211114 22:58:16 tornado_fetcher:671] fetcher exiting...
[I 211114 22:58:16 app:84] webui exiting...
[I 211114 22:58:16 scheduler:663] scheduler exiting...
[I 211114 22:58:16 processor:229] processor exiting...
[I 211114 22:58:17 result_worker:66] result_worker exiting...
Traceback (most recent call last):
File "C:\Python36\Scripts\pyspider-script.py", line 11, in <module>
load_entry_point('pyspider==0.3.10', 'console_scripts', 'pyspider')()
File "c:\python36\lib\site-packages\pyspider\run.py", line 754, in main
cli()
File "c:\python36\lib\site-packages\click\core.py", line 1128, in __call__
return self.main(*args, **kwargs)
File "c:\python36\lib\site-packages\click\core.py", line 1053, in main
rv = self.invoke(ctx)
File "c:\python36\lib\site-packages\click\core.py", line 1659, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "c:\python36\lib\site-packages\click\core.py", line 1395, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "c:\python36\lib\site-packages\click\core.py", line 754, in invoke
return __callback(*args, **kwargs)
File "c:\python36\lib\site-packages\click\decorators.py", line 26, in new_func
return f(get_current_context(), *args, **kwargs)
File "c:\python36\lib\site-packages\pyspider\run.py", line 497, in all
ctx.invoke(webui, **webui_config)
File "c:\python36\lib\site-packages\click\core.py", line 754, in invoke
return __callback(*args, **kwargs)
File "c:\python36\lib\site-packages\click\decorators.py", line 26, in new_func
return f(get_current_context(), *args, **kwargs)
File "c:\python36\lib\site-packages\pyspider\run.py", line 384, in webui
app.run(host=host, port=port)
File "c:\python36\lib\site-packages\pyspider\webui\app.py", line 64, in run
from werkzeug.wsgi import DispatcherMiddleware
ImportError: cannot import name 'DispatcherMiddleware'
C:\WINDOWS\system32>#卸载
'#卸载' 不是内部或外部命令，也不是可运行的程序
或批处理文件。
C:\WINDOWS\system32>python -m pip uninstall werkzeug
Found existing installation: Werkzeug 2.0.2
Uninstalling Werkzeug-2.0.2:
Would remove:
c:\python36\lib\site-packages\werkzeug-2.0.2.dist-info\*
c:\python36\lib\site-packages\werkzeug\*
Proceed (Y/n)? #安装指定版本
Your response ('#安装指定版本') was not one of the expected responses: y, n,
Proceed (Y/n)? python -m pip install werkzeug==0.16.0
Your response ('python -m pip install werkzeug==0.16.0') was not one of the expected responses: y, n,
Proceed (Y/n)? y
Successfully uninstalled Werkzeug-2.0.2
C:\WINDOWS\system32>python -m pip install werkzeug==0.16.0
Collecting werkzeug==0.16.0
Using cached Werkzeug-0.16.0-py2.py3-none-any.whl (327 kB)
Installing collected packages: werkzeug
Successfully installed werkzeug-0.16.0
C:\WINDOWS\system32>pyspider all
c:\python36\lib\site-packages\pyspider\libs\utils.py:196: FutureWarning: timeout is not supported on your platform.
warnings.warn("timeout is not supported on your platform.", FutureWarning)
phantomjs fetcher running on port 25555
[I 211114 22:59:18 result_worker:49] result_worker starting...
[I 211114 22:59:19 processor:211] processor starting...
[I 211114 22:59:19 scheduler:647] scheduler starting...
[I 211114 22:59:19 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0
[I 211114 22:59:20 scheduler:782] scheduler.xmlrpc listening on 127.0.0.1:23333
[I 211114 22:59:21 tornado_fetcher:638] fetcher starting...
[I 211114 22:59:23 app:76] webui running on 0.0.0.0:5000
[I 211114 23:00:19 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0
[I 211114 23:01:19 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0
[I 211114 23:02:19 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0
