V2EX = way to explore V2EX 是一个关于分享和探索的地方
Sign Up Now For Existing Member Sign In
推荐学习书目 Learn Python the Hard Way Python Sites PyPI - Python Package Index http://diveintopython.org/toc/index.html Pocoo 值得关注的项目 PyPy Celery Jinja2 Read the Docs gevent pyenv virtualenv Stackless Python Beautiful Soup 结巴中文分词 Green Unicorn Sentry Shovel Pyflakes pytest Python 编程 pep8 Checker Styles PEP 8 Google Python Style Guide Code Style from The Hitchhiker's Guide
This topic created in 3370 days ago, the information mentioned may be changed or developed.
<table class="tabledataformat" cellspacing="0" > <tr> <td style="vertical-align:top;">Copper, Cu </td> <td class="dataCell" style="vertical-align:top;"><= 0.03 %<span class="dataCondition"></span></td> <td class="dataCell" style="vertical-align:top;"><= 0.03 %<span class="dataCondition"></span></td> <td class="dataComment" style="vertical-align:top;"></td> </tr> </table> response.xpath('//table[@class="tabledataformat"]/tr').extract() 只能获取到
<tr> &l;td style="vertical-align:top;">Copper, Cu </td> <td class="dataCell" style="vertical-align:top;"></td> <td class="dataCell" style="vertical-align:top;"></td> <td class="dataComment" style="vertical-align:top;"></td> </tr> <= 0.03 % 和 消失不见，为什么呢？
 | 1 imn1 Mar 4, 2017 因为<=的写法不符合 xml 标准 |
 | 2 leavic Mar 4, 2017 这部分数据可能是 Javascript 异步请求显示的，也就是 ajax 内容， scrapy 是看不到的。 |
 | 3 dsg001 Mar 4, 2017 ''' <tr> <td style="vertical-align:top;">Copper, Cu </td> <td class="dataCell" style="vertical-align:top;"><= 0.03 %<span class="dataCondition"></span></td> <td class="dataCell" style="vertical-align:top;"><= 0.03 %<span class="dataCondition"></span></td> <td class="dataComment" style="vertical-align:top;"></td> </tr> ''' 测试 lxml 能输出， scrapy 应该也没问题，查看 html 源码吧 |
 | 4 crazypig14 Mar 7, 2017 scrapy 爬下来用 beautifulsoup 处理，我觉得方便些 |
Select Language