网站有过千万的数据,每一个页面都要相关页面的栏目,如何实现阿? - V2EX
Home
Sign Up
Sign In
推荐学习书目
Learn Python the Hard Way
Python Sites
PyPI
- Python Package Index
http://diveintopython.org/toc/index.html
Pocoo
值得关注的项目
PyPy
Celery
Jinja2
Read the Docs
gevent
pyenv
virtualenv
Stackless Python
Beautiful Soup
结巴中文分词
Green Unicorn
Sentry
Shovel
Pyflakes
pytest
Python 编程
pep8 Checker
Styles
PEP 8
Google Python Style Guide
Code Style from The Hitchhiker's Guide
V2EX
Python
网站有过千万的数据,每一个页面都要相关页面的栏目,如何实现阿?
fundchan
May 27, 2015
3074 views
This topic created in 4027 days ago, the information mentioned may be changed or developed.
页面
栏目
相关
6 replies
2015-05-27 15:40:04 +08:00
1
zencoding
May 27, 2015
过千万数据很大吗?
2
fundchan
OP
May 27, 2015
@
zencoding
主要是怎么推荐相关内容阿,又没什么现成的工具。
3
cevincheung
May 27, 2015
elasticsearch+redis
4
em70
May 27, 2015
推荐引擎可以写一本大部头了,难主要是推荐算法上,千万级数据只要加上索引,技术上没有难点.
推荐算法需要你根据业务自己设计,比如出现同样关键字的文章就算一类可以相互相关
5
fundchan
OP
May 27, 2015
@
em70
我只需要根据标题的相关性来进行推荐,有没现成的算法
6
em70
May 27, 2015
@
fundchan
标题怎么算相关?肯定是关键字吧,可以用结巴分词处理标题,提取到的每个关键字和文章ID关联写入另一个表,建好索引.这个表可能会好几亿记录,但因为结构简单而且有索引,检索速度会很快,不用担心性能.
将来用的时候,显示一个文章,在这个表里检索文章ID得到全部关键字,然后还是这个表里检索每一个关键字得到相关文章ID列表,随机选几个显示就行了.
About
Help
Advertise
Blog
API
FAQ
Solana
5611 Online
Highest 6679
Select Language
创意工作者们的社区
World is powered by solitude
VERSION: 3.9.8.5 61ms
UTC 06:35
PVG 14:35
LAX 23:35
JFK 02:35
Do have faith in what you're doing.
ubao
msn
snddm
index
pchome
yahoo
rakuten
mypaper
meadowduck
bidyahoo
youbao
zxmzxm
asda
bnvcg
cvbfg
dfscv
mmhjk
xxddc
yybgb
zznbn
ccubao
uaitu
acv
GXCV
ET
GDG
YH
FG
BCVB
FJFH
CBRE
CBC
GDG
ET54
WRWR
RWER
WREW
WRWER
RWER
SDG
EW
SF
DSFSF
fbbs
ubao
fhd
dfg
ewr
dg
df
ewwr
ewwr
et
ruyut
utut
dfg
fgd
gdfgt
etg
dfgt
dfgd
ert4
gd
fgg
wr
235
wer3
we
vsdf
sdf
gdf
ert
xcv
sdf
rwer
hfd
dfg
cvb
rwf
afb
dfh
jgh
bmn
lgh
rty
gfds
cxv
xcv
xcs
vdas
fdf
fgd
cv
sdf
tert
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
sdf
shasha9178
shasha9178
shasha9178
shasha9178
shasha9178
liflif2
liflif2
liflif2
liflif2
liflif2
liblib3
liblib3
liblib3
liblib3
liblib3
zhazha444
zhazha444
zhazha444
zhazha444
zhazha444
dende5
dende
denden
denden2
denden21
fenfen9
fenf619
fen619
fenfe9
fe619
sdf
sdf
sdf
sdf
sdf
zhazh90
zhazh0
zhaa50
zha90
zh590
zho
zhoz
zhozh
zhozho
zhozho2
lislis
lls95
lili95
lils5
liss9
sdf0ty987
sdft876
sdft9876
sdf09876
sd0t9876
sdf0ty98
sdf0976
sdf0ty986
sdf0ty96
sdf0t76
sdf0876
df0ty98
sf0t876
sd0ty76
sdy76
sdf76
sdf0t76
sdf0ty9
sdf0ty98
sdf0ty987
sdf0ty98
sdf6676
sdf876
sd876
sd876
sdf6
sdf6
sdf9876
sdf0t
sdf06
sdf0ty9776
sdf0ty9776
sdf0ty76
sdf8876
sdf0t
sd6
sdf06
s688876
sd688
sdf86