Commit Graph

1181 Commits

Author SHA1 Message Date
binux
4bafdf8b27 test under python2.7 2014-03-07 15:53:20 +08:00
binux
e88c42b1c1 add ci config for travis 2014-03-07 15:32:00 +08:00
binux
f5b23b3e72 add test for scheduler 2014-03-07 01:44:58 +08:00
binux
0f25a36b2b bugfix: content can be unicode sometimes 2014-03-06 16:30:52 +08:00
binux
c3d6f72d51 update index progress-bar css 2014-03-06 01:29:28 +08:00
binux
723085f48c first runable version,TODO: test 2014-03-06 01:24:34 +08:00
binux
256bbaf16e add run.py 2014-03-05 01:45:03 +08:00
binux
38c091ebe6 add counter and xmlrpc for scheduler and fetcher 2014-03-04 00:17:41 +08:00
binux
f4211ce6c8 add dashborad 2014-03-02 21:46:17 +08:00
binux
21275d4fc7 fix test case 2014-03-01 23:00:53 +08:00
binux
fcda3770fd add scheduler callback handler and rabbitmq queue adapter 2014-03-01 22:58:36 +08:00
binux
d3502a365b add requirements.txt 2014-02-28 17:42:11 +08:00
binux
180e1bd16c fix css in chinese 2014-02-28 17:38:58 +08:00
binux
eb4c6e4998 add save project 2014-02-28 01:03:17 +08:00
binux
2ddce50e47 html format when click tab 2014-02-27 01:26:30 +08:00
binux
c0700413a3 add logs 2014-02-26 23:33:38 +08:00
binux
e62ed258bc add follows tab 2014-02-26 00:44:58 +08:00
binux
9a76bccbb0 add backend for debug 2014-02-25 01:45:15 +08:00
binux
bdb3b93fb9 debug main style 2014-02-23 23:49:15 +08:00
Binux
461ae16571 add webui base skeleton, add resize for debug.html 2014-02-23 02:17:28 +08:00
Binux
7b92c42a6e add test for processor 2014-02-22 15:10:20 +08:00
Binux
3f74424375 Merge github.com:binux/pyspider 2014-02-22 03:20:00 +08:00
Binux
2c5fa526b3 update 2014-02-22 03:19:37 +08:00
足兆叉虫
2f44eee816 Initial commit 2014-02-21 11:18:47 -08:00
Binux
b3b4866ffe add processor 2014-02-22 03:00:53 +08:00
Binux
f4b5903c3c add sync_fetch method for fetcher 2014-02-16 15:27:11 +08:00
Binux
3114d92f71 add fetcher 2014-02-15 22:53:29 +08:00
Binux
54de75d432 scheduler base process flow 2014-02-09 21:37:03 +08:00
Binux
939030a5c6 add projectdb 2014-02-09 17:39:19 +08:00
Binux
223489dca7 add sqlite database and test 2014-02-09 00:24:57 +08:00
Binux
2ee0bbd335 first commit
finished:
scheduler.task_queue # task queue with priority queue, time queue and
                     # processing queue
scheduler.token_bucket # a token bucket based flow control
scheduler.scheduler # part
2014-02-08 00:43:04 +08:00