关于爬虫拖库的一些疑惑 - V2EX
推荐学习书目
Learn Python the Hard Way
Python Sites
PyPI - Python Package Index
http://diveintopython.org/toc/index.html
Pocoo
值得关注的项目
PyPy
Celery
Jinja2
Read the Docs
gevent
pyenv
virtualenv
Stackless Python
Beautiful Soup
结巴中文分词
Green Unicorn
Sentry
Shovel
Pyflakes
pytest
Python 编程
pep8 Checker
Styles
PEP 8
Google Python Style Guide
Code Style from The Hitchhiker's Guide
professorz

关于爬虫拖库的一些疑惑

  •  
  •   professorz Feb 7, 2015 4562 views
    This topic created in 4136 days ago, the information mentioned may be changed or developed.
    像http://epub.sipo.gov.cn/gjcx.jsp 这个网站,通过关键词检索能否遍历它数据库里面所有的项目?如果可以的话,这种网站的拖库是不是挺容易的?
    6 replies    2015-02-07 21:52:03 +08:00
    arkilis
        1
    arkilis  
       Feb 7, 2015
    但是你怎么知道这个是数据库中所有的内容呢。

    拖库就是一点不剩给拖下来。拖:音调 一声
    wdlth
        2
    wdlth  
       Feb 7, 2015
    这个只能叫抓取、采集数据,真正的拖库不只是数据,还要有关系。
    R4rvZ6agNVWr56V0
        3
    R4rvZ6agNVWr56V0  
       Feb 7, 2015
    理论上是可以获取到所有专利文档数据的,但数据库中的表结构、关系你是“拖”不出来的。
    professorz
        4
    professorz  
    OP
       Feb 7, 2015
    @arkilis 嗯,我发现了点bug,比如搜索1985年的数据,“只勾选发明公布”和“四项都勾选”两种情况下,得到的发明公布的数量不一样!奇怪~~
    professorz
        5
    professorz  
    OP
       Feb 7, 2015
    @GeekGao 感觉上这种数据库好像没什么表关系。。。甚至4张表就能包含所有数据。。
    R4rvZ6agNVWr56V0
        6
    R4rvZ6agNVWr56V0  
       Feb 7, 2015
    @professorz 你跑题了,我是说他们的数据库本身,而不是如何设计这个系统。。。
    About     Help     Advertise     Blog     API     FAQ     Solana     5573 Online   Highest 6679       Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 34ms UTC 06:34 PVG 14:34 LAX 23:34 JFK 02:34
    Do have faith in what you're doing.
    ubao msn snddm index pchome yahoo rakuten mypaper meadowduck bidyahoo youbao zxmzxm asda bnvcg cvbfg dfscv mmhjk xxddc yybgb zznbn ccubao uaitu acv GXCV ET GDG YH FG BCVB FJFH CBRE CBC GDG ET54 WRWR RWER WREW WRWER RWER SDG EW SF DSFSF fbbs ubao fhd dfg ewr dg df ewwr ewwr et ruyut utut dfg fgd gdfgt etg dfgt dfgd ert4 gd fgg wr 235 wer3 we vsdf sdf gdf ert xcv sdf rwer hfd dfg cvb rwf afb dfh jgh bmn lgh rty gfds cxv xcv xcs vdas fdf fgd cv sdf tert sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf shasha9178 shasha9178 shasha9178 shasha9178 shasha9178 liflif2 liflif2 liflif2 liflif2 liflif2 liblib3 liblib3 liblib3 liblib3 liblib3 zhazha444 zhazha444 zhazha444 zhazha444 zhazha444 dende5 dende denden denden2 denden21 fenfen9 fenf619 fen619 fenfe9 fe619 sdf sdf sdf sdf sdf zhazh90 zhazh0 zhaa50 zha90 zh590 zho zhoz zhozh zhozho zhozho2 lislis lls95 lili95 lils5 liss9 sdf0ty987 sdft876 sdft9876 sdf09876 sd0t9876 sdf0ty98 sdf0976 sdf0ty986 sdf0ty96 sdf0t76 sdf0876 df0ty98 sf0t876 sd0ty76 sdy76 sdf76 sdf0t76 sdf0ty9 sdf0ty98 sdf0ty987 sdf0ty98 sdf6676 sdf876 sd876 sd876 sdf6 sdf6 sdf9876 sdf0t sdf06 sdf0ty9776 sdf0ty9776 sdf0ty76 sdf8876 sdf0t sd6 sdf06 s688876 sd688 sdf86