小白问下,用python的scrapy写了个抓网站数据的程序,如何打包成exe? - V2EX
V2EX = way to explore
V2EX 是一个关于分享和探索的地方
Sign Up Now
For Existing Member  Sign In
推荐学习书目
Learn Python the Hard Way
Python Sites
PyPI - Python Package Index
http://diveintopython.org/toc/index.html
Pocoo
值得关注的项目
PyPy
Celery
Jinja2
Read the Docs
gevent
pyenv
virtualenv
Stackless Python
Beautiful Soup
结巴中文分词
Green Unicorn
Sentry
Shovel
Pyflakes
pytest
Python 编程
pep8 Checker
Styles
PEP 8
Google Python Style Guide
Code Style from The Hitchhiker's Guide
hengz

小白问下,用python的scrapy写了个抓网站数据的程序,如何打包成exe?

  •  
  •   hengz
    hengz Oct 19, 2013 11791 views
    This topic created in 4572 days ago, the information mentioned may be changed or developed.
    我用python的scrapy包写了个抓网站数据的程序,需要在命令行写scrapy crawl xxx来执行, xxx是我自己定义的spider文件,在spiders目录下

    现在希望能把这个基于scrapy的script程序打包成一个可以独立直接执行的exe文件(执行机器无需安装scrapy等),结果就是是类似csv表格文件呈现在窗口里。我用py2exe来build这个exe,按照py2exe教程我现在只能添加单个的.py文件并将其转为exe, 而scrapy需要执行的scrapy crawl xxx命令如何添加进去呢
    13 replies    1970-01-01 08:00:00 +08:00
    C0VN
        1
    C0VN  
       Oct 19, 2013
    yelite
        2
    yelite  
       Oct 19, 2013
    argparse
    NFSwind
        3
    NFSwind  
       Oct 19, 2013
    py2exe
    yelite
        4
    yelite  
       Oct 19, 2013
    argparse好像太重了。。。
    如果你只有这样一条命令的话,可以直接import sys, 然后sys.argv
    如果是scrapy crawl xxx的话,
    sys.argv=['<path>/scrapy.py', 'crawl', 'xxx']
    hengz
        5
    hengz  
    OP
       Oct 19, 2013
    @xavierskip

    项目有这些文件,
    items.py
    pipelines.py
    settings.py
    spiders目录下有spider_us.py name为xxspider

    目前执行是scrapy crawl xxspider; 这样,pyinstaller去打包哪个py文件呢
    hengz
        6
    hengz  
    OP
       Oct 19, 2013
    @yelite 你是指重新建一个.py文件,然后里面写import sys sys.argv=['<path>/scrapy.py', 'crawl', 'xxx']
    yelite
        7
    yelite  
       Oct 19, 2013
    @hengz 你的问题应该不是打包吧?你是想让自己的程序接收命令行参数吗?
    hengz
        8
    hengz  
    OP
       Oct 19, 2013
    @yelite 因为执行这个scrapy程序是需要在命令行执行scrapy crawl xxspider
    然后我想把整个打包成exe(包括里面的配置文件什么的),这样直接执行这个exe就可以了
    yelite
        9
    yelite  
       Oct 19, 2013
    @hengz 这个包好奇怪。。。居然是这么玩的
    打包scrapy目录里面cmdline.py试试?
    C0VN
        10
    C0VN  
       Oct 19, 2013
    哦,我不清楚 scrapy这个框架。

    难道不是 import的,执行python *.py。而是另外的 scrapy crawl xxx ,我不太明白。

    反正打包的应该是执行程序的那个脚本。
    fork3rt
        11
    fork3rt  
       Oct 19, 2013 via Android
    我给我女朋友写的采集程序,用的py2exe转的。
    hengz
        12
    hengz  
    OP
       Oct 19, 2013
    @fork3rt 能简单介绍下吗
    Kabie
        13
    Kabie  
       Oct 20, 2013
    cx_freeze
    About     Help     Advertise     Blog     API     FAQ     Solana     1184 Online   Highest 6679       Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 46ms UTC 23:46 PVG 07:46 LAX 16:46 JFK 19:46
    Do have faith in what you're doing.
    ubao msn snddm index pchome yahoo rakuten mypaper meadowduck bidyahoo youbao zxmzxm asda bnvcg cvbfg dfscv mmhjk xxddc yybgb zznbn ccubao uaitu acv GXCV ET GDG YH FG BCVB FJFH CBRE CBC GDG ET54 WRWR RWER WREW WRWER RWER SDG EW SF DSFSF fbbs ubao fhd dfg ewr dg df ewwr ewwr et ruyut utut dfg fgd gdfgt etg dfgt dfgd ert4 gd fgg wr 235 wer3 we vsdf sdf gdf ert xcv sdf rwer hfd dfg cvb rwf afb dfh jgh bmn lgh rty gfds cxv xcv xcs vdas fdf fgd cv sdf tert sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf shasha9178 shasha9178 shasha9178 shasha9178 shasha9178 liflif2 liflif2 liflif2 liflif2 liflif2 liblib3 liblib3 liblib3 liblib3 liblib3 zhazha444 zhazha444 zhazha444 zhazha444 zhazha444 dende5 dende denden denden2 denden21 fenfen9 fenf619 fen619 fenfe9 fe619 sdf sdf sdf sdf sdf zhazh90 zhazh0 zhaa50 zha90 zh590 zho zhoz zhozh zhozho zhozho2 lislis lls95 lili95 lils5 liss9 sdf0ty987 sdft876 sdft9876 sdf09876 sd0t9876 sdf0ty98 sdf0976 sdf0ty986 sdf0ty96 sdf0t76 sdf0876 df0ty98 sf0t876 sd0ty76 sdy76 sdf76 sdf0t76 sdf0ty9 sdf0ty98 sdf0ty987 sdf0ty98 sdf6676 sdf876 sd876 sd876 sdf6 sdf6 sdf9876 sdf0t sdf06 sdf0ty9776 sdf0ty9776 sdf0ty76 sdf8876 sdf0t sd6 sdf06 s688876 sd688 sdf86