binux
4bafdf8b27
test under python2.7
2014-03-07 15:53:20 +08:00
binux
e88c42b1c1
add ci config for travis
2014-03-07 15:32:00 +08:00
binux
f5b23b3e72
add test for scheduler
2014-03-07 01:44:58 +08:00
binux
0f25a36b2b
bugfix: content can be unicode sometimes
2014-03-06 16:30:52 +08:00
binux
c3d6f72d51
update index progress-bar css
2014-03-06 01:29:28 +08:00
binux
723085f48c
first runable version,TODO: test
2014-03-06 01:24:34 +08:00
binux
256bbaf16e
add run.py
2014-03-05 01:45:03 +08:00
binux
38c091ebe6
add counter and xmlrpc for scheduler and fetcher
2014-03-04 00:17:41 +08:00
binux
f4211ce6c8
add dashborad
2014-03-02 21:46:17 +08:00
binux
21275d4fc7
fix test case
2014-03-01 23:00:53 +08:00
binux
fcda3770fd
add scheduler callback handler and rabbitmq queue adapter
2014-03-01 22:58:36 +08:00
binux
d3502a365b
add requirements.txt
2014-02-28 17:42:11 +08:00
binux
180e1bd16c
fix css in chinese
2014-02-28 17:38:58 +08:00
binux
eb4c6e4998
add save project
2014-02-28 01:03:17 +08:00
binux
2ddce50e47
html format when click tab
2014-02-27 01:26:30 +08:00
binux
c0700413a3
add logs
2014-02-26 23:33:38 +08:00
binux
e62ed258bc
add follows tab
2014-02-26 00:44:58 +08:00
binux
9a76bccbb0
add backend for debug
2014-02-25 01:45:15 +08:00
binux
bdb3b93fb9
debug main style
2014-02-23 23:49:15 +08:00
Binux
461ae16571
add webui base skeleton, add resize for debug.html
2014-02-23 02:17:28 +08:00
Binux
7b92c42a6e
add test for processor
2014-02-22 15:10:20 +08:00
Binux
3f74424375
Merge github.com:binux/pyspider
2014-02-22 03:20:00 +08:00
Binux
2c5fa526b3
update
2014-02-22 03:19:37 +08:00
足兆叉虫
2f44eee816
Initial commit
2014-02-21 11:18:47 -08:00
Binux
b3b4866ffe
add processor
2014-02-22 03:00:53 +08:00
Binux
f4b5903c3c
add sync_fetch method for fetcher
2014-02-16 15:27:11 +08:00
Binux
3114d92f71
add fetcher
2014-02-15 22:53:29 +08:00
Binux
54de75d432
scheduler base process flow
2014-02-09 21:37:03 +08:00
Binux
939030a5c6
add projectdb
2014-02-09 17:39:19 +08:00
Binux
223489dca7
add sqlite database and test
2014-02-09 00:24:57 +08:00
Binux
2ee0bbd335
first commit
...
finished:
scheduler.task_queue # task queue with priority queue, time queue and
# processing queue
scheduler.token_bucket # a token bucket based flow control
scheduler.scheduler # part
2014-02-08 00:43:04 +08:00