os: centos 7.4.1708
db: postgresql 11.8
Slony-I: 2.2.8
192.168.56.111 n1
192.168.56.112 n2
192.168.56.113 n3
這3個節點都需要安裝 postgresql 11 及 Slony-I
本次實現同步 n1 節點某個表數據到 n2 節點。
版本
# cat /etc/centos-release
CentOS Linux release 7.4.1708 (Core)
#
#
# yum list installed |grep -i postgresql
postgresql11.x86_64 11.8-1PGDG.rhel7 @pgdg11
postgresql11-contrib.x86_64 11.8-1PGDG.rhel7 @pgdg11
postgresql11-debuginfo.x86_64 11.5-1PGDG.rhel7 @pgdg11
postgresql11-devel.x86_64 11.8-1PGDG.rhel7 @pgdg11
postgresql11-docs.x86_64 11.8-1PGDG.rhel7 @pgdg11
postgresql11-libs.x86_64 11.8-1PGDG.rhel7 @pgdg11
postgresql11-llvmjit.x86_64 11.8-1PGDG.rhel7 @pgdg11
postgresql11-odbc.x86_64 12.01.0000-1PGDG.rhel7 @pgdg11
postgresql11-plperl.x86_64 11.8-1PGDG.rhel7 @pgdg11
postgresql11-plpython.x86_64 11.8-1PGDG.rhel7 @pgdg11
postgresql11-pltcl.x86_64 11.8-1PGDG.rhel7 @pgdg11
postgresql11-server.x86_64 11.8-1PGDG.rhel7 @pgdg11
postgresql11-tcl.x86_64 2.4.0-2.rhel7.1 @pgdg11
postgresql11-test.x86_64 11.8-1PGDG.rhel7 @pgdg11
# su - postgres
Last login: Wed Jan 15 18:34:12 CST 2020 on pts/0
$
$
$ psql -c "select version();"
version
---------------------------------------------------------------------------------------------------------
PostgreSQL 11.8 on x86_64-pc-linux-gnu, compiled by gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-39), 64-bit
(1 row)
n1,n2,n3 節點創建測試相關
Slony-I depends on the databases having the pl/pgSQL procedural language
# su - postgres
$ psql
psql (11.8)
Type "help" for help.
postgres=# \l
List of databases
Name | Owner | Encoding | Collate | Ctype | Access privileges
-----------+----------+----------+-------------+-------------+-----------------------
postgres | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 |
template0 | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | =c/postgres +
| | | | | postgres=CTc/postgres
template1 | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | =c/postgres +
| | | | | postgres=CTc/postgres
(3 rows)
postgres=# \du
List of roles
Role name | Attributes | Member of
-----------+------------------------------------------------------------+-----------
postgres | Superuser, Create role, Create DB, Replication, Bypass RLS | {}
創建 yewu 用戶，yewudb 數據庫，測試表
postgres=# create user yewu with password 'yewuyewu';
postgres=# create database yewudb with owner=yewu;
postgres=# \l
List of databases
Name | Owner | Encoding | Collate | Ctype | Access privileges
-----------+----------+----------+-------------+-------------+-----------------------
postgres | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 |
template0 | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | =c/postgres +
| | | | | postgres=CTc/postgres
template1 | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | =c/postgres +
| | | | | postgres=CTc/postgres
yewudb | yewu | UTF8 | en_US.UTF-8 | en_US.UTF-8 |
(4 rows)
Slony-I depends on the databases having the pl/pgSQL procedural language
postgres=# \c yewudb
yewudb=> select * from pg_language ;
lanname | lanowner | lanispl | lanpltrusted | lanplcallfoid | laninline | lanvalidator | lanacl
----------+----------+---------+--------------+---------------+-----------+--------------+--------
internal | 10 | f | f | 0 | 0 | 2246 |
c | 10 | f | f | 0 | 0 | 2247 |
sql | 10 | f | t | 0 | 0 | 2248 |
plpgsql | 10 | t | t | 13868 | 13869 | 13870 |
(4 rows)
表必須要有主鍵
yewudb=> create table tmp_t0(c0 int8 primary key,c1 varchar(100));
n1,n2 節點創建 slony 用戶
秉承功能用戶與業務用戶分離的原則,slony 最小權限可以參考 https://www.slony.info/documentation/2.2/security.html
postgres=# \c yewudb
yewudb=# create user slony with password 'slonyslony';
grant select on public.tmp_t0 to slony;
alter user slony with superuser;
配置 slony
先配置 n1,n2節點
# su - postgres
$ ls -l /usr/pgsql-11/bin/sl*
-rwxr-xr-x 1 root root 496208 Jun 10 17:10 /usr/pgsql-11/bin/slon
-rwxr-xr-x 1 root root 315976 Jun 10 17:10 /usr/pgsql-11/bin/slonik
-rwxr-xr-x 1 root root 176736 Jun 10 17:10 /usr/pgsql-11/bin/slony_logshipper
n1 節點(master 節點) 初始化腳本
# su - postgres
$ vi slon_init.sh
#!/bin/sh
slonik <<_EOF_
#--
cluster name = slony_example;
#--
node 1 admin conninfo = 'dbname=yewudb host=192.168.56.111 port=5432 user=slony password=slonyslony';
node 2 admin conninfo = 'dbname=yewudb host=192.168.56.112 port=5432 user=slony password=slonyslony';
# init the first node. This creates the schema
init cluster ( id=1, comment = 'Master Node');
#--
create set (id=1, origin=1, comment='slony tables');
set add table (set id=1, origin=1, id=1, fully qualified name = 'public.tmp_t0', comment='tmp_t0');
#--
store node (id=2, comment = 'Slave node n2', event node=1);
store path (server = 1, client = 2, conninfo='dbname=yewudb host=192.168.56.111 port=5432 user=slony password=slonyslony');
store path (server = 2, client = 1, conninfo='dbname=yewudb host=192.168.56.112 port=5432 user=slony password=slonyslony');
_EOF_
執行初始化腳本
$ slon_init.sh
n1 節點(master 節點) 所有訂閱腳本
# su - postgres
$ vi slon_subs.sh
#!/bin/sh
slonik <<_EOF_
#--
cluster name = slony_example;
#--
node 1 admin conninfo = 'dbname=yewudb host=192.168.56.111 port=5432 user=slony password=slonyslony';
node 2 admin conninfo = 'dbname=yewudb host=192.168.56.112 port=5432 user=slony password=slonyslony';
# subscribe
subscribe set ( id = 1, provider = 1, receiver = 2, forward = no);
_EOF_
執行訂閱腳本，會前端運行，不停有日誌輸出
$ slon_subs.sh
waiting for events (2,5000000001) only at (2,0) to be confirmed on node 1
waiting for events (2,5000000001) only at (2,0) to be confirmed on node 1
waiting for events (2,5000000001) only at (2,0) to be confirmed on node 1
n1 節點啓動守護進程
# su - postgres
$ slon slony_example 'dbname=yewudb host=192.168.56.111 port=5432 user=slony password=slonyslony';
n2 節點啓動守護進程
# su - postgres
$ slon slony_example 'dbname=yewudb host=192.168.56.112 port=5432 user=slony password=slonyslony';
驗證 slony
n1 節點插入測試數據
$ psql -U yewu yewudb
yewudb=> insert into tmp_t0 select id,md5(id::varchar) from generate_series(1,10000) as id;
n2 節點驗證
yewudb=# select count(1) from tmp_t0;
count
-------
10000
(1 row)
再驗證一下
n1 節點插入測試數據
$ psql -U yewu yewudb
yewudb=> insert into tmp_t0 select 99999,'this is slony test';
yewudb=> select count(1) from tmp_t0;
count
-------
10001
(1 row)
n2 節點驗證
yewudb=> select * from tmp_t0 where c0=99999;
c0 | c1
-------+--------------------
99999 | this is slony test
(1 row)
yewudb=> select count(1) from tmp_t0;
count
-------
10001
(1 row)
查看錶信息
slony 添加了觸發器
n1 節點查看
yewudb=> \d+ tmp_t0
Table "public.tmp_t0"
Column | Type | Collation | Nullable | Default | Storage | Stats target | Description
--------+------------------------+-----------+----------+---------+----------+--------------+-------------
c0 | bigint | | not null | | plain | |
c1 | character varying(100) | | | | extended | |
Indexes:
"tmp_t0_pkey" PRIMARY KEY, btree (c0)
Triggers:
_slony_example_logtrigger AFTER INSERT OR DELETE OR UPDATE ON tmp_t0 FOR EACH ROW EXECUTE PROCEDURE _slony_example.logtrigger('_slony_example', '1', 'k')
_slony_example_truncatetrigger BEFORE TRUNCATE ON tmp_t0 FOR EACH STATEMENT EXECUTE PROCEDURE _slony_example.log_truncate('1')
Disabled user triggers:
_slony_example_denyaccess BEFORE INSERT OR DELETE OR UPDATE ON tmp_t0 FOR EACH ROW EXECUTE PROCEDURE _slony_example.denyaccess('_slony_example')
_slony_example_truncatedeny BEFORE TRUNCATE ON tmp_t0 FOR EACH STATEMENT EXECUTE PROCEDURE _slony_example.deny_truncate()
n2 節點查看
yewudb=> \d+ tmp_t0;
Table "public.tmp_t0"
Column | Type | Collation | Nullable | Default | Storage | Stats target | Description
--------+------------------------+-----------+----------+---------+----------+--------------+-------------
c0 | bigint | | not null | | plain | |
c1 | character varying(100) | | | | extended | |
Indexes:
"tmp_t0_pkey" PRIMARY KEY, btree (c0)
Triggers:
_slony_example_denyaccess BEFORE INSERT OR DELETE OR UPDATE ON tmp_t0 FOR EACH ROW EXECUTE PROCEDURE _slony_example.denyaccess('_slony_example')
_slony_example_truncatedeny BEFORE TRUNCATE ON tmp_t0 FOR EACH STATEMENT EXECUTE PROCEDURE _slony_example.deny_truncate()
Disabled user triggers:
_slony_example_logtrigger AFTER INSERT OR DELETE OR UPDATE ON tmp_t0 FOR EACH ROW EXECUTE PROCEDURE _slony_example.logtrigger('_slony_example', '1', 'k')
_slony_example_truncatetrigger BEFORE TRUNCATE ON tmp_t0 FOR EACH STATEMENT EXECUTE PROCEDURE _slony_example.log_truncate('1')
參考:
http://slony.info/
https://www.slony.info/documentation/2.2/index.html
https://www.slony.info/documentation/2.2/tutorial.html