接上篇 Kubernetes 中部署 NFS Provisioner 爲 NFS 提供動態分配卷(上篇)請添加鏈接描述
一、nginx 使用 nfs 靜態 PV
1、靜態 nfs-static-nginx-rc.yaml
##清理資源
kubectl delete -f nfs-static-nginx-rc.yaml -n test
cat >nfs-static-nginx-rc.yaml<<\EOF
##創建namespace
---
apiVersion: v1
kind: Namespace
metadata:
name: test
labels:
name: test
##創建nfs-pv
---
apiVersion: v1
kind: PersistentVolume
metadata:
name: nfs-pv
labels:
pv: nfs-pv
spec:
capacity:
storage: 10Gi
accessModes:
- ReadWriteMany
persistentVolumeReclaimPolicy: Retain
storageClassName: nfs # 注意這裏使用nfs的storageClassName,如果沒改k8s的默認storageClassName的話,這裏可以省略
nfs:
path: /data/nfs/nginx/
server: 10.198.1.155
##創建nfs-pvc
---
kind: PersistentVolumeClaim
apiVersion: v1
metadata:
name: nfs-pvc
namespace: test
labels:
pvc: nfs-pvc
spec:
accessModes:
- ReadWriteMany
resources:
requests:
storage: 10Gi
storageClassName: nfs
selector:
matchLabels:
pv: nfs-pv
##部署應用nginx
---
apiVersion: v1
kind: ReplicationController
metadata:
name: nginx-test
namespace: test
labels:
name: nginx-test
spec:
replicas: 2
selector:
name: nginx-test
template:
metadata:
labels:
name: nginx-test
spec:
containers:
- name: nginx-test
image: docker.io/nginx
volumeMounts:
- mountPath: /usr/share/nginx/html
name: nginx-data
ports:
- containerPort: 80
volumes:
- name: nginx-data
persistentVolumeClaim:
claimName: nfs-pvc
##創建service
---
apiVersion: v1
kind: Service
metadata:
namespace: test
name: nginx-test
labels:
name: nginx-test
spec:
type: NodePort
ports:
- port: 80
protocol: TCP
targetPort: 80
name: http
nodePort: 30080
selector:
name: nginx-test
EOF
##創建資源
kubectl apply -f nfs-static-nginx-rc.yaml -n test
##查看pv資源
kubectl get pv -n test --show-labels
##查看pvc資源
kubectl get pvc -n test --show-labels
##查看pod
$ kubectl get pods -n test
NAME READY STATUS RESTARTS AGE
nginx-test-r4n2j 1/1 Running 0 54s
nginx-test-zstf5 1/1 Running 0 54s
#可以看到,nginx應用已經部署成功。
#nginx應用的數據目錄是使用的nfs共享存儲,我們在nfs共享的目錄里加入index.html文件,然後再訪問nginx-service暴露的端口
#切換到到nfs-server服務器上
echo "Test NFS Share discovery with nfs-static-nginx-rc" > /data/nfs/nginx/index.html
#在瀏覽器上訪問kubernetes主節點的 http://master:30080,就能訪問到這個頁面內容了
2、靜態 nfs-static-nginx-deployment.yaml
##清理資源
kubectl delete -f nfs-static-nginx-deployment.yaml -n test
cat >nfs-static-nginx-deployment.yaml<<\EOF
##創建namespace
---
apiVersion: v1
kind: Namespace
metadata:
name: test
labels:
name: test
##創建nfs-pv
---
apiVersion: v1
kind: PersistentVolume
metadata:
name: nfs-pv
labels:
pv: nfs-pv
spec:
capacity:
storage: 10Gi
accessModes:
- ReadWriteMany
persistentVolumeReclaimPolicy: Retain
storageClassName: nfs # 注意這裏使用nfs的storageClassName,如果沒改k8s的默認storageClassName的話,這裏可以省略
nfs:
path: /data/nfs/nginx/
server: 10.198.1.155
##創建nfs-pvc
---
kind: PersistentVolumeClaim
apiVersion: v1
metadata:
name: nfs-pvc
namespace: test
labels:
pvc: nfs-pvc
spec:
accessModes:
- ReadWriteMany
resources:
requests:
storage: 10Gi
storageClassName: nfs
selector:
matchLabels:
pv: nfs-pv
##部署應用nginx
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: nginx-deployment
namespace: test
labels:
name: nginx-test
spec:
replicas: 2
selector:
matchLabels:
name: nginx-test
template:
metadata:
labels:
name: nginx-test
spec:
containers:
- name: nginx-test
image: docker.io/nginx
volumeMounts:
- mountPath: /usr/share/nginx/html
name: nginx-data
ports:
- containerPort: 80
volumes:
- name: nginx-data
persistentVolumeClaim:
claimName: nfs-pvc
##創建service
---
apiVersion: v1
kind: Service
metadata:
namespace: test
name: nginx-test
labels:
name: nginx-test
spec:
type: NodePort
ports:
- port: 80
protocol: TCP
targetPort: 80
name: http
nodePort: 30080
selector:
name: nginx-test
EOF
##創建資源
kubectl apply -f nfs-static-nginx-deployment.yaml -n test
##查看pv資源
kubectl get pv -n test --show-labels
##查看pvc資源
kubectl get pvc -n test --show-labels
##查看pod
$ kubectl get pods -n test
NAME READY STATUS RESTARTS AGE
nginx-deployment-64d6f78cdf-8bw8t 1/1 Running 0 55s
nginx-deployment-64d6f78cdf-n5n4q 1/1 Running 0 55s
#可以看到,nginx應用已經部署成功。
#nginx應用的數據目錄是使用的nfs共享存儲,我們在nfs共享的目錄里加入index.html文件,然後再訪問nginx-service暴露的端口
#切換到到nfs-server服務器上
echo "Test NFS Share discovery with nfs-static-nginx-deployment" > /data/nfs/nginx/index.html
#在瀏覽器上訪問kubernetes主節點的 http://master:30080,就能訪問到這個頁面內容了
3、nginx 多目錄掛載
-
PV 和 PVC 是一一對應關係,當有 PV 被某個 PVC 所佔用時,會顯示 banding,其它 PVC 不能再使用綁定過的 PV。
-
PVC 一旦綁定 PV,就相當於是一個存儲卷,此時 PVC 可以被多個 Pod 所使用。(PVC支不支持被多個 Pod 訪問,取決於訪問模型 accessMode 的定義)。
-
PVC 若沒有找到合適的 PV 時,則會處於 pending 狀態。
-
PV 是屬於集羣級別的,不能定義在名稱空間中。
- PVC 時屬於名稱空間級別的。
##清理資源
kubectl delete -f nfs-static-nginx-dp-many.yaml -n test
cat >nfs-static-nginx-dp-many.yaml<<\EOF
##創建namespace
---
apiVersion: v1
kind: Namespace
metadata:
name: test
labels:
name: test
##創建nginx-data-pv
---
apiVersion: v1
kind: PersistentVolume
metadata:
name: nginx-data-pv
labels:
pv: nginx-data-pv
spec:
capacity:
storage: 50Gi
accessModes:
- ReadWriteMany
persistentVolumeReclaimPolicy: Retain
storageClassName: nfs # 注意這裏使用nfs的storageClassName,如果沒改k8s的默認storageClassName的話,這裏可以省略
nfs:
path: /data/nfs/nginx/
server: 10.198.1.155
##創建nginx-etc-pv
---
apiVersion: v1
kind: PersistentVolume
metadata:
name: nginx-etc-pv
labels:
pv: nginx-etc-pv
spec:
capacity:
storage: 50Gi
accessModes:
- ReadWriteMany
persistentVolumeReclaimPolicy: Retain
storageClassName: nfs # 注意這裏使用nfs的storageClassName,如果沒改k8s的默認storageClassName的話,這裏可以省略
nfs:
path: /data/nfs/nginx/
server: 10.198.1.155
##創建pvc名字爲nfs-nginx-data,存放數據
---
kind: PersistentVolumeClaim
apiVersion: v1
metadata:
name: nfs-nginx-data
namespace: test
labels:
pvc: nfs-nginx-data
spec:
accessModes:
- ReadWriteMany
resources:
requests:
storage: 50Gi
storageClassName: nfs
selector:
matchLabels:
pv: nginx-data-pv
##創建pvc名字爲nfs-nginx-etc,存放配置文件
---
kind: PersistentVolumeClaim
apiVersion: v1
metadata:
name: nfs-nginx-etc
namespace: test
labels:
pvc: nfs-nginx-etc
spec:
accessModes:
- ReadWriteMany
resources:
requests:
storage: 50Gi
storageClassName: nfs
selector:
matchLabels:
pv: nginx-etc-pv
##部署應用nginx
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: nginx-deployment
namespace: test
labels:
name: nginx-test
spec:
replicas: 2
selector:
matchLabels:
name: nginx-test
template:
metadata:
labels:
name: nginx-test
spec:
containers:
- name: nginx-test
image: docker.io/nginx
volumeMounts:
- mountPath: /usr/share/nginx/html
name: nginx-data
# - mountPath: /etc/nginx #--這裏需要注意,如果是這麼掛載,那麼需要事先現在/data/nfs/nginx/目錄下把nginx的完整配置提前拷貝好
# name: nginx-etc
ports:
- containerPort: 80
volumes:
- name: nginx-data
persistentVolumeClaim:
claimName: nfs-nginx-data
# - name: nginx-etc
# persistentVolumeClaim:
# claimName: nfs-nginx-etc
##創建service
---
apiVersion: v1
kind: Service
metadata:
namespace: test
name: nginx-test
labels:
name: nginx-test
spec:
type: NodePort
ports:
- port: 80
protocol: TCP
targetPort: 80
name: http
nodePort: 30080
selector:
name: nginx-test
EOF
##創建資源
kubectl apply -f nfs-static-nginx-dp-many.yaml -n test
##查看pv資源
kubectl get pv -n test --show-labels
##查看pvc資源
kubectl get pvc -n test --show-labels
##查看pod
$ kubectl get pods -n test
NAME READY STATUS RESTARTS AGE
nginx-deployment-64d6f78cdf-8bw8t 1/1 Running 0 55s
nginx-deployment-64d6f78cdf-n5n4q 1/1 Running 0 55s
##進入容器
kubectl exec -it nginx-deployment-f687cdf47-xncj8 -n test /bin/bash
#可以看到,nginx應用已經部署成功。
#nginx應用的數據目錄是使用的nfs共享存儲,我們在nfs共享的目錄里加入index.html文件,然後再訪問nginx-service暴露的端口
#切換到到nfs-server服務器上
echo "Test NFS Share discovery with nfs-static-nginx-dp-many" > /data/nfs/nginx/index.html
#在瀏覽器上訪問kubernetes主節點的 http://master:30080,就能訪問到這個頁面內容了
4、參數 namespace
##清理資源
export NAMESPACE="mos-namespace"
kubectl delete -f nfs-static-nginx-dp-many.yaml -n ${NAMESPACE}
cat >nfs-static-nginx-dp-many.yaml<<-EOF
##創建namespace
---
apiVersion: v1
kind: Namespace
metadata:
name: ${NAMESPACE}
labels:
name: ${NAMESPACE}
##創建nginx-data-pv
---
apiVersion: v1
kind: PersistentVolume
metadata:
name: nginx-data-pv
labels:
pv: nginx-data-pv
spec:
capacity:
storage: 50Gi
accessModes:
- ReadWriteMany
persistentVolumeReclaimPolicy: Retain
storageClassName: nfs # 注意這裏使用nfs的storageClassName,如果沒改k8s的默認storageClassName的話,這裏可以省略
nfs:
path: /data/nfs/nginx/
server: 10.198.1.155
##創建nginx-log-pv
---
apiVersion: v1
kind: PersistentVolume
metadata:
name: nginx-log-pv
labels:
pv: nginx-log-pv
spec:
capacity:
storage: 50Gi
accessModes:
- ReadWriteMany
persistentVolumeReclaimPolicy: Retain
storageClassName: nfs # 注意這裏使用nfs的storageClassName,如果沒改k8s的默認storageClassName的話,這裏可以省略
nfs:
path: /data/nfs/nginx/
server: 10.198.1.155
##創建pvc名字爲nfs-nginx-data,存放數據
---
kind: PersistentVolumeClaim
apiVersion: v1
metadata:
name: nfs-nginx-data
labels:
pvc: nfs-nginx-data
spec:
accessModes:
- ReadWriteMany
resources:
requests:
storage: 50Gi
storageClassName: nfs
selector:
matchLabels:
pv: nginx-data-pv
##創建pvc名字爲nfs-nginx-log,存放日誌文件
---
kind: PersistentVolumeClaim
apiVersion: v1
metadata:
name: nfs-nginx-log
labels:
pvc: nfs-nginx-log
spec:
accessModes:
- ReadWriteMany
resources:
requests:
storage: 50Gi
storageClassName: nfs
selector:
matchLabels:
pv: nginx-log-pv
##部署應用nginx
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: nginx-deployment
labels:
name: nginx-test
spec:
replicas: 2
selector:
matchLabels:
name: nginx-test
template:
metadata:
labels:
name: nginx-test
spec:
containers:
- name: nginx-test
image: docker.io/nginx
volumeMounts:
- mountPath: /usr/share/nginx/html
name: nginx-data
- mountPath: /var/log/nginx
name: nginx-log
ports:
- containerPort: 80
volumes:
- name: nginx-data
persistentVolumeClaim:
claimName: nfs-nginx-data
- name: nginx-log
persistentVolumeClaim:
claimName: nfs-nginx-log
##創建service
---
apiVersion: v1
kind: Service
metadata:
name: nginx-test
labels:
name: nginx-test
spec:
type: NodePort
ports:
- port: 80
protocol: TCP
targetPort: 80
name: http
nodePort: 30180
selector:
name: nginx-test
EOF
##創建資源
kubectl apply -f nfs-static-nginx-dp-many.yaml -n ${NAMESPACE}
二、nginx 使用 nfs 動態 PV
1、動態 nfs-dynamic-nginx.yaml
通過參數控制在哪個命名空間創建
##清理命名空間
kubectl delete ns k8s-public
##創建命名空間
kubectl create ns k8s-public
##清理資源
kubectl delete -f nfs-dynamic-nginx-deployment.yaml -n k8s-public
cat >nfs-dynamic-nginx-deployment.yaml<<\EOF
##動態申請nfs-dynamic-pvc
---
kind: PersistentVolumeClaim
apiVersion: v1
metadata:
name: nfs-dynamic-claim
spec:
storageClassName: nfs-storage #--需要與上面創建的storageclass的名稱一致
accessModes:
- ReadWriteMany
resources:
requests:
storage: 90Gi
##部署應用nginx
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: nginx-deployment
labels:
name: nginx-test
spec:
replicas: 3
selector:
matchLabels:
name: nginx-test
template:
metadata:
labels:
name: nginx-test
spec:
containers:
- name: nginx-test
image: docker.io/nginx
volumeMounts:
- mountPath: /usr/share/nginx/html
name: nginx-data
ports:
- containerPort: 80
volumes:
- name: nginx-data
persistentVolumeClaim:
claimName: nfs-dynamic-claim
##創建service
---
apiVersion: v1
kind: Service
metadata:
name: nginx-test
labels:
name: nginx-test
spec:
type: NodePort
ports:
- port: 80
protocol: TCP
targetPort: 80
name: http
nodePort: 30090
selector:
name: nginx-test
EOF
##創建資源
kubectl apply -f nfs-dynamic-nginx-deployment.yaml -n k8s-public
##查看pv資源
kubectl get pv -n k8s-public --show-labels
##查看pvc資源
kubectl get pvc -n k8s-public --show-labels
##查看pod
$ kubectl get pods -n k8s-public
NAME READY STATUS RESTARTS AGE
nginx-deployment-544f569478-5t8wm 1/1 Running 0 40s
nginx-deployment-544f569478-8gks5 1/1 Running 0 40s
nginx-deployment-544f569478-pw96x 1/1 Running 0 40s
#可以看到,nginx應用已經部署成功。
#nginx應用的數據目錄是使用的nfs共享存儲,我們在nfs共享的目錄里加入index.html文件,然後再訪問nginx-service暴露的端口
#切換到到nfs-server服務器上
#注意動態的在這個目錄,創建的目錄命名方式爲 “namespace名稱-pvc名稱-pv名稱”
/data/nfs/kube-public-test-claim-pvc-ad304939-e75d-414f-81b5-7586ef17db6c
echo "Test NFS Share discovery with nfs-dynamic-nginx-deployment" > /data/nfs/kube-public-test-claim-pvc-ad304939-e75d-414f-81b5-7586ef17db6c/index.html
#在瀏覽器上訪問kubernetes主節點的 http://master:30090,就能訪問到這個頁面內容了
參考文檔:
-
https://kubernetes.io/zh/docs/tasks/run-application/run-stateless-application-deployment/
- https://blog.51cto.com/ylw6006/2071845 在kubernetes集羣中運行nginx
作者:Lancger
github 地址:https://url.cn/5osLAuY
轉載請獲得作者授權
Golang 課程火熱招生資料找WeChat:17812796384