Pyspider配置本地數據庫

一、配置mysql 

• 創建相關數據庫及用戶

• 
  mysql> create database taskdb default character set 'utf8';
  Query OK, 1 row affected (0.01 sec)
   
  mysql> create database projectdb default character set 'utf8';
  Query OK, 1 row affected (0.01 sec)
   
  mysql> create database resultdb default character set 'utf8';
  Query OK, 1 row affected (0.01 sec)
   
  mysql> grant all on taskdb .* to 'user'@'192.168.1.%' identified by 'pwd';
  Query OK, 0 rows affected, 1 warning (0.01 sec)
   
  mysql> grant all on projectdb .* to 'user'@'192.168.1.%' identified by 'pwd';
  Query OK, 0 rows affected, 1 warning (0.00 sec)
   
  mysql> grant all on resultdb.* to 'user'@'192.168.1.%' identified by 'pwd';
  

   在pyspider中配置數據庫連接信息，config.json

• 
  {
  	"taskdb": "mysql+taskdb://user:[email protected]:3306/taskdb",
  	"projectdb": "mysql+projectdb://user:[email protected]:3306/projectdb",
  	"resultdb": "mysql+resultdb://user:[email protected]:3306/resultdb",
  	"webui": {
  		"port":5000,
  		"username": "user",
  		"password": "password",
  		"need-auth": true
  	}
  
  

   

• 測試啓動pyspider
•  pyspider -c config.json all

二、配置MongoDB

{
    "taskdb": "mongodb+taskdb://127.0.0.1:27017/pyspider_taskdb",
    "projectdb": "mongodb+projectdb://127.0.0.1:27017/pyspider_projectdb",
    "resultdb": "mongodb+resultdb://127.0.0.1:27017/pyspider_resultdb",
    "message_queue": "redis://127.0.0.1:6379/db",
    "webui": {
        "port": 5001
    }
}