shen/pyspider
1
0
Fork 0
mirror of https://github.com/binux/pyspider.git synced 2024-11-25 16:34:30 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
1,181 Commits 5 Branches 13 Tags 30 MiB
master
Commit Graph

34 Commits

Author SHA1 Message Date
Keith Tunstead
fd47784b76 making symlink to node_modules 2019-10-24 19:42:50 +02:00
Keith Tunstead
592af4df53 moved NODE_PATH assignment after install 2019-10-24 19:11:18 +02:00
Keith Tunstead
89bfc577bf using NODE_PATH env var 2019-10-24 19:04:50 +02:00
Keith Tunstead
414de22363 travis test 2019-10-24 18:29:06 +02:00
Keith Tunstead
92173be6a9 fixed phantomjs libssl_conf.so error 2019-10-24 16:03:48 +02:00
Keith Tunstead
dcbf6dff62 port to python 3.6 2019-10-24 13:10:55 +02:00
clchen
96b5128eb2 add puppeteer fetcher 2019-02-14 17:10:54 +08:00
binux
124b9f2b6a fix docker build 2017-03-05 23:32:22 +00:00
Kuan Huang
0d197db65a change dockerfile mysql-connector-python curl 2017-01-17 01:17:25 +08:00
binux
0d0c9d6891 fix docker build 
pool mysql-Connector! https://bugs.mysql.com/bug.php?id=79766
 2016-05-24 22:22:23 +01:00
VicYu
75ff368d25 Update Dockerfile about new version mysql connector 
Update Dockerfile about new version mysql connector
 2016-04-15 14:42:21 +08:00
binux
ac672c695e revert git pull, doesn't work! 2016-04-06 20:09:46 +01:00
binux
d973cc2142 git pull to make sure the code in docker is up to data 2016-04-05 22:13:21 +01:00
binux
f8c889a8c4 fix docker build 2016-01-21 21:54:54 +00:00
binux
583dfd1616 add postgresql support to docker, try catch for postgresql 2015-09-29 20:56:40 +01:00
binux
3601753e9e fix Docerfile 2015-06-04 11:51:22 +08:00
binux
617c94b86c add easywebdav for test 2015-06-04 10:37:05 +08:00
binux
41f55d75a4 use mysqldb in docker 2015-05-27 15:26:01 +08:00
binux
2863e2cd1f Revert "use mysqldb in docker" 
This reverts commit cd1aab3f97.
 2015-05-25 00:08:00 +08:00
binux
cd1aab3f97 use mysqldb in docker 2015-05-24 21:35:52 +08:00
binux
df73747b2d fix for docker deployment 2015-04-11 17:51:51 +08:00
binux
234c569cbf fix docker again? 2015-04-11 16:36:45 +08:00
binux
6f8a9e5739 fix for ubuntu 12.04 2015-04-11 16:19:41 +08:00
binux
28069386ef restart phantomjs if crash, it's a workaround of #175 
build docker with phantomjs image to support pyspider phantomjs command
 2015-04-11 15:37:03 +08:00
binux
efc6c20078 change docker base image to offical ubuntu 2015-03-25 21:46:52 +08:00
binux
6b02ed527b add one mode for result worker, writing results to stdout 
fix Dockerfile
fix quit_interactive will quit_pyspider when not crawl request
 2015-01-20 23:30:17 +08:00
binux
1e0f12c7ba fix docker file 2015-01-01 10:50:17 +08:00
binux
1f850541d3 fix phantomjs keep-alive bug 
add processed new task cache when check new tasks. not process new
request twice for perform.
update dockerfile set pyspider as volumn for debug
fix bug in tornado_fetcher when using async mode
debugger load fetch options from old task
 2014-10-31 22:45:36 +08:00
binux
7a82e3d875 add phantomjs to run.py 
add logs for phantomjs_fetcher
update README
fix timeout error message for tornado fetcher proxy to phantomjs fetcher
run test exit with right exit code when test is failed
 2014-10-31 20:25:37 +08:00
binux
f8702f2927 a better docker file 2014-10-22 23:23:25 +08:00
binux
73e47e8317 fix docker 2014-10-17 01:09:20 +08:00
binux
d9233ef785 docker fix 2014-10-12 14:43:39 +08:00
binux
a4c089d285 add mongodb.taskdb 2014-10-12 12:17:48 +08:00
binux
75d45c8333 active tasks for each project 2014-10-09 22:58:47 +08:00