一、redis
redis是一個key-value存儲系統。和Memcached類似,它支持存儲的value類型相對更多,包括string(字符串)、list(鏈表)、set(集合)、zset(sorted set --有序集合)和hash(哈希類型)。這些數據類型都支持push/pop、add/remove及取交集並集和差集及更豐富的操作,而且這些操作都是原子性的。在此基礎上,redis支持各種不同方式的排序。與memcached一樣,爲了保證效率,數據都是緩存在內存中。區別的是redis會週期性的把更新的數據寫入磁盤或者把修改操作寫入追加的記錄文件,並且在此基礎上實現了master-slave(主從)同步。
Redis 是一個高性能的key-value數據庫。 redis的出現,很大程度補償了memcached這類key/value存儲的不足,在部 分場合可以對關係數據庫起到很好的補充作用。它提供了Python,Ruby,Erlang,PHP客戶端,使用很方便,Redis支持主從同步。數據可以從主服務器向任意數量的從服務器上同步,從服務器可以是關聯其他從服務器的主服務器。這使得Redis可執行單層樹複製。從盤可以有意無意的對數據進行寫操作。由於完全實現了發佈/訂閱機制,使得從數據庫在任何地方同步樹時,可訂閱一個頻道並接收主服務器完整的消息發佈記錄。
redis集羣搭建:https://blog.csdn.net/qq_21153619/article/details/81866011
二、python操作redis
採用連接資源池方式
- configuration.properties
[Redis]
redis_host:172.8.10.xx
redis_port:6379
redis_username:0
redis_password:xxx
redis_db:1
- RedisClient
#!/usr/bin/python3
# -*- coding: UTF-8 -*-
import json
import redis
## READ CONFIGURATION FILE
config_file = pd.read_table(filepath_or_buffer="configuration.properties",
header=None, delim_whitespace=True,index_col=0).transpose()
config=ConfigParser()
config.read(str(config_file['configPath'].iloc[0]))
# =============================================================================
# initialization
# =============================================================================
Redis_host = config.get('Redis', 'Redis_host')
Redis_port = config.get('Redis', 'Redis_port')
Redis_username = config.get('Redis', 'Redis_username')
Redis_password = config.get('Redis', 'Redis_password')
Redis_db = config.get('Redis', 'Redis_db')
redisPool = redis.ConnectionPool(
host=Redis_host,
port=Redis_port,
max_connections=100,
password=Redis_password,
decode_responses=True,
db=Redis_db)
RedisServer = redis.Redis(connection_pool=redisPool)
class RedisClient(object):
global RedisServer
@staticmethod
def initConn():
return RedisClient()
def table_exists(self, tableName):
boolean = RedisServer.exists(tableName)
return boolean
## hash: select
def hash_hget(self, tableName, key):
value = RedisServer.hget(tableName, key)
return value
## hash: insert
def hash_hset(self, tableName, key, value):
RedisServer.hset(tableName, key, value)
## hash: determine if the table exists
def hash_hexists(self, tableName, key):
boolean = RedisServer.hexists(tableName, key)
return boolean
## hash: del
def hash_hdel(self, tableName, key):
RedisServer.hdel(tableName, key)
## zset: select
def zset_zrangebyscore(self, tableName, start_score, end_score):
value = RedisServer.zrangebyscore(tableName, start_score, end_score)
return value
## zset: insert signle line
def zset_zadd(self, tableName, dict):
##dict={'{"companyID":46,"projectID":74,...,"pVal1":""}':123}
RedisServer.zadd(tableName, dict)
## list: insert log
def LogUtils(self, tableName, cc, mn, stn, steps, SpnPnConfig, info):
exceptionLog = json.dumps({
'Exception Time': datetime.now().strftime("%Y-%m-%d %H:%M:%S"),
'cc': str(cc), 'mn': str(mn), 'stn': str(stn), 'steps': str(steps),
'WebConfig': str(SpnPnConfig), 'info': str(info)
})
RedisServer.lpush(tableName, exceptionLog)
## list: insert
def list_lpush(self, tableName, exceptionLog):
RedisServer.lpush(tableName, exceptionLog)
## list: select list number
def list_llen(self, tableName):
number = RedisServer.llen(tableName)
return number
## list: remove from the list that is not in the index
def list_ltrim(self, tableName, start, end):
RedisServer.ltrim(tableName, start, end)
## list: Slice to get the element
def list_lrange(self, tableName, start, end):
rangelist = RedisServer.lrange(tableName, start, end)
return rangelist
## list: drop data
def list_lrem(self, tableName, value, num):
RedisServer.lrem(tableName, value, num)