在scrapy云上部署scrapy项目时出错

时间:2014-03-26 15:30:59

标签: python python-2.7 scrapy scrapyd

我在Python 2.7上使用scrapy 0.20。

我想在scrapy cloud

上部署我的scrapy项目
  1. 我用简单的蜘蛛开发了我的scrapy项目。
  2. 导航到我的scrapy项目文件夹。
  3. 在cmd上输入scrapy deploy scrapyd -d koooraspiderkoooraspider是我的项目名称,scrapyd是我的目标。
  4. 我收到以下错误:

    D:\Walid-Project\Tasks\koooraspider>scrapy deploy scrapyd -p koooraspider
    Packing version 1395847344
    Deploying to project "koooraspider" in http://dash.scrapinghub.com/api/scrapyd/a
    ddversion.json
    Traceback (most recent call last):
      File "C:\Python27\lib\runpy.py", line 162, in _run_module_as_main
        "__main__", fname, loader, pkg_name)
      File "C:\Python27\lib\runpy.py", line 72, in _run_code
        exec code in run_globals
      File "C:\Python27\lib\site-packages\scrapy-0.20.2-py2.7.egg\scrapy\cmdline.py"
    , line 168, in <module>
        execute()
      File "C:\Python27\lib\site-packages\scrapy-0.20.2-py2.7.egg\scrapy\cmdline.py"
    , line 143, in execute
        _run_print_help(parser, _run_command, cmd, args, opts)
      File "C:\Python27\lib\site-packages\scrapy-0.20.2-py2.7.egg\scrapy\cmdline.py"
    , line 89, in _run_print_help
        func(*a, **kw)
      File "C:\Python27\lib\site-packages\scrapy-0.20.2-py2.7.egg\scrapy\cmdline.py"
    , line 150, in _run_command
        cmd.run(args, opts)
      File "C:\Python27\lib\site-packages\scrapy-0.20.2-py2.7.egg\scrapy\commands\de
    ploy.py", line 105, in run
        if not _upload_egg(target, egg, project, version):
      File "C:\Python27\lib\site-packages\scrapy-0.20.2-py2.7.egg\scrapy\commands\de
    ploy.py", line 194, in _upload_egg
        return _http_post(req)
      File "C:\Python27\lib\site-packages\scrapy-0.20.2-py2.7.egg\scrapy\commands\de
    ploy.py", line 210, in _http_post
        f = urllib2.urlopen(request)
      File "C:\Python27\lib\urllib2.py", line 126, in urlopen
        return _opener.open(url, data, timeout)
      File "C:\Python27\lib\urllib2.py", line 391, in open
        response = self._open(req, data)
      File "C:\Python27\lib\urllib2.py", line 409, in _open
        '_open', req)
      File "C:\Python27\lib\urllib2.py", line 369, in _call_chain
        result = func(*args)
      File "C:\Python27\lib\urllib2.py", line 1173, in http_open
        return self.do_open(httplib.HTTPConnection, req)
      File "C:\Python27\lib\urllib2.py", line 1142, in do_open
        h.request(req.get_method(), req.get_selector(), req.data, headers)
      File "C:\Python27\lib\httplib.py", line 946, in request
        self._send_request(method, url, body, headers)
      File "C:\Python27\lib\httplib.py", line 987, in _send_request
        self.endheaders(body)
      File "C:\Python27\lib\httplib.py", line 940, in endheaders
        self._send_output(message_body)
      File "C:\Python27\lib\httplib.py", line 801, in _send_output
        msg += message_body
    UnicodeDecodeError: 'ascii' codec can't decode byte 0xcc in position 373: ordina
    l not in range(128)
    

    scrapy.cfg

    # Project: KoooraSpider
    [deploy:scrapyd]
    url = http://dash.scrapinghub.com/api/scrapyd/
    username = MyUserName
    password =
    project = 2431
    

    注意

    当我执行上述步骤时,已生成project.egg-info文件夹,build文件夹和setup.py脚本。

    任何帮助将不胜感激。

1 个答案:

答案 0 :(得分:0)

删除project.egg-info&amp; build个文件夹

然后尝试命令scrapy deploy scrapyd -p 2431