kvm虛擬化部署

虛擬化介紹

• 虛擬化是雲計算的基礎。簡單的說，虛擬化使得在一臺物理的服務器上可以跑多臺虛擬機，虛擬機共享物理機的 CPU、內存、IO 硬件資源，但邏輯上虛擬機之間是相互隔離的。

• 物理機我們一般稱爲宿主機（Host），宿主機上面的虛擬機稱爲客戶機（Guest）。

• 那麼 Host 是如何將自己的硬件資源虛擬化，並提供給 Guest 使用的呢？
  這個主要是通過一個叫做 Hypervisor 的程序實現的。

• 根據 Hypervisor 的實現方式和所處的位置，虛擬化又分爲兩種：

• 全虛擬化

• 半虛擬化

全虛擬化：

Hypervisor 直接安裝在物理機上，多個虛擬機在 Hypervisor 上運行。Hypervisor 實現方式一般是一個特殊定製的 Linux 系統。Xen 和 VMWare 的 ESXi 都屬於這個類型

半虛擬化：

物理機上首先安裝常規的操作系統，比如 Redhat、Ubuntu 和 Windows。Hypervisor 作爲 OS 上的一個程序模塊運行，並對管理虛擬機進行管理。KVM、VirtualBox 和 VMWare Workstation 都屬於這個類型

理論上講：

全虛擬化一般對硬件虛擬化功能進行了特別優化，性能上比半虛擬化要高；
半虛擬化因爲基於普通的操作系統，會比較靈活，比如支持虛擬機嵌套。嵌套意味着可以在KVM虛擬機中再運行KVM。

kvm介紹

• kVM 全稱是 Kernel-Based Virtual Machine。也就是說 KVM 是基於 Linux 內核實現的。

• KVM有一個內核模塊叫 kvm.ko，只用於管理虛擬 CPU 和內存。

• 那 IO 的虛擬化，比如存儲和網絡設備則是由 Linux 內核與Qemu來實現。

• 作爲一個 Hypervisor，KVM 本身只關注虛擬機調度和內存管理這兩個方面。IO 外設的任務交給 Linux 內核和 Qemu。

• 大家在網上看 KVM 相關文章的時候肯定經常會看到 Libvirt 這個東西。

• Libvirt 就是 KVM 的管理工具。

-其實，Libvirt 除了能管理 KVM 這種 Hypervisor，還能管理 Xen，VirtualBox 等。

• Libvirt 包含 3 個東西：後臺 daemon 程序 libvirtd、API 庫和命令行工具 virsh

• libvirtd是服務程序，接收和處理 API 請求；

• API 庫使得其他人可以開發基於 Libvirt 的高級工具，比如 virt-manager，這是個圖形化的 KVM 管理工具；

• virsh 是我們經常要用的 KVM 命令行工具

kvm部署

• 環境說明

系統類型	ip地址
RHEL7	192.168.170.13

• kvm安裝

• 部署前請確保你的CPU虛擬化功能已開啓。分爲兩種情況：

• 虛擬機要關機設置CPU虛擬化

• 物理機要在BIOS裏開啓CPU虛擬化

• 關閉防火牆與SELINUX

[root@kvm ~]# systemctl stop firewalld
[root@kvm ~]# systemctl disable firewalld
Removed symlink /etc/systemd/system/multi-user.target.wants/firewalld.service.
Removed symlink /etc/systemd/system/dbus-org.fedoraproject.FirewallD1.service.
[root@kvm ~]# setenforce 0
[root@kvm ~]# sed -ri 's/^(SELINUX=).*/\1disabled/g' /etc/selinux/config
[root@localhost ~]# reboot

• 配置網絡源

[root@localhost ~]# curl -o /etc/yum.repos.d/CentOS7-Base-163.repo http://mirrors.163.com/.help/CentOS7-Base-163.repo
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  1572  100  1572    0     0  17810      0 --:--:-- --:--:-- --:--:-- 17662
[root@localhost ~]# sed -i 's/\$releasever/7/g' /etc/yum.repos.d/CentOS7-Base-163.repo
[root@localhost ~]# sed -i 's/^enabled=.*/enabled=1/g' /etc/yum.repos.d/CentOS7-Base-163.repo

• 安裝依賴包、工具

[root@kvm ~]# yum -y install epel-release vim wget net-tools unzip zip gcc gcc-c++
安裝過程略.....

• 驗證CPU是否支持KVM；如果結果中有vmx（Intel）或svm(AMD)字樣，就說明CPU的支持的

[root@localhost ~]# egrep -o 'vmx|svm' /proc/cpuinfo
vmx
[root@localhost ~]# 

• kvm安裝

[root@localhost ~]#yum -y install qemu-kvm qemu-kvm-tools qemu-img virt-manager libvirt libvirt-python libvirt-client virt-install virt-viewer bridge-utils libguestfs-tools

……
安裝過程省略

• 因爲虛擬機中網絡，我們一般都是和公司的其他服務器是同一個網段，所以我們需要把 KVM服務器的網卡配置成橋接模式。這樣的話KVM的虛擬機就可以通過該橋接網卡和公司內部 其他服務器處於同一網段

• 此處我的網卡是ens33，所以用br0來橋接ens33網卡

[root@localhost network-scripts]# cp ifcfg-ens33 ifcfg-br0
[root@localhost network-scripts]# ls
ifcfg-br0    ifdown-ippp    ifdown-Team      ifup-ib     ifup-ppp       init.ipv6-global
ifcfg-ens33  ifdown-ipv6    ifdown-TeamPort  ifup-ippp   ifup-routes    network-functions
ifcfg-lo     ifdown-isdn    ifdown-tunnel    ifup-ipv6   ifup-sit       network-functions-ipv6
ifdown       ifdown-post    ifup             ifup-isdn   ifup-Team
ifdown-bnep  ifdown-ppp     ifup-aliases     ifup-plip   ifup-TeamPort
ifdown-eth   ifdown-routes  ifup-bnep        ifup-plusb  ifup-tunnel
ifdown-ib    ifdown-sit     ifup-eth         ifup-post   ifup-wireless
[root@localhost network-scripts]# 
[root@localhost network-scripts]# vim ifcfg-br0 
[root@localhost network-scripts]# cat ifcfg-br0 
[root@localhost ~]# cat /etc/sysconfig/network-scripts/ifcfg-br0 
TYPE=Bridge
DEVICE=br0
NM_CONTROLLED=no
BOOTPROTO=static
NAME=br0
ONBOOT=yes
IPADDR=192.168.170.13
NETMASK=255.255.255.0
GATEWAY=192.168.170.2
DNS1=114.114.114.114
DNS2=8.8.8.8
[root@localhost ~]# 
[root@localhost network-scripts]# 

[root@localhost ~]# cat /etc/sysconfig/network-scripts/ifcfg-ens33 
TYPE=Ethernet
BOOTPROTO=static
NAME=ens33
DEVICE=ens33
ONBOOT=yes
BRIDGE=br0
NM_CONTROLLED=no

• 重啓網絡

[root@localhost ~]# 
[root@localhost ~]# /etc/init.d/network restart
Restarting network (via systemctl):                        [  ok  ]
[root@localhost ~]# 

• 啓動服務

[root@localhost ~]# systemctl start libvirtd
[root@localhost ~]# systemctl enable libvirtd

• 驗證安裝結果

[root@localhost ~]#  lsmod|grep kvm
kvm_intel             170086  0 
kvm                   566340  1 kvm_intel
irqbypass              13503  1 kvm

• 測試並驗證安裝結果

[root@localhost ~]# virsh -c qemu:///system list
 Id    名稱                         狀態
----------------------------------------------------

[root@localhost ~]# virsh --version
4.5.0
[root@localhost ~]# virt-install --version
1.5.0
[root@localhost ~]# 

[root@localhost ~]# ln -s /usr/libexec/qemu-kvm /usr/bin/qemu-kvm
[root@localhost ~]# ll /usr/bin/qemu-kvm
lrwxrwxrwx 1 root root 21 8月  31 12:09 /usr/bin/qemu-kvm -> /usr/libexec/qemu-kvm

• 查看網卡信息

[root@localhost ~]# brctl show
bridge name	bridge id		STP enabled	interfaces
br0		8000.000c292184e7	no		ens33
virbr0		8000.525400585a5f	yes		virbr0-nic
[root@localhost ~]# 

• 使用xmanaer管理，掉出界面 kvm

web管理界面安裝

• 安裝依賴包

[root@localhost ~]# yum -y install git python-pip libvirt-python libxml2-python python-websockify supervisor nginx python-devel

• 升級pip

[root@localhost ~]#pip install --upgrade pip

• 從github上下載webvirtmgr代碼

[root@localhost ~]#cd /usr/local/src/
[root@localhost src]#git clone git://github.com/retspen/webvirtmgr.git
Cloning into 'webvirtmgr'...
remote: Enumerating objects: 5730, done.
remote: Total 5730 (delta 0), reused 0 (delta 0), pack-reused 5730
Receiving objects: 100% (5730/5730), 3.01 MiB | 39.00 KiB/s, done.
Resolving deltas: 100% (3688/3688), done.

• 安裝webvirtmgr

[root@localhost src]#cd webvirtmgr/
[root@localhost webvirtmgr]# pip install -r requirements.txt
Collecting django==1.5.5 (from -r requirements.txt (line 1))
  Downloading https://files.pythonhosted.org/packages/38/49/93511c5d3367b6b21fc2995a0e53399721afc15e4cd6eb57be879ae13ad4/Django-1.5.5.tar.gz (8.1MB)
    57% |██████████████████▌             | 4.7MB 38kB/s eta 0:01:28 
.....此處省略安裝步驟

• 檢查sqlite3是否安裝

[root@localhost webvirtmgr]# python
Python 2.7.5 (default, May  3 2017, 07:55:04)
[GCC 4.8.5 20150623 (Red Hat 4.8.5-14)] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import sqlite3
>>> exit()

• 初始化帳號信息

[root@localhost webvirtmgr]# python manage.py syncdb
WARNING:root:No local_settings file found.
Creating tables ...
Creating table auth_permission
Creating table auth_group_permissions
Creating table auth_group
Creating table auth_user_groups
Creating table auth_user_user_permissions
Creating table auth_user
Creating table django_content_type
Creating table django_session
Creating table django_site
Creating table servers_compute
Creating table instance_instance
Creating table create_flavor

You just installed Django's auth system, which means you don't have any superusers defined.
Would you like to create one now? (yes/no): yes     //問你是否創建超級管理員帳號
Username (leave blank to use 'root'):   //指定超級管理員帳號用戶名，默認留空爲root
Email address: [email protected]     //設置超級管理員郵箱
Password:       //設置超級管理員密碼
Password (again):       //再次輸入超級管理員密碼
Superuser created successfully.
Installing custom SQL ...
Installing indexes ...
Installed 6 object(s) from 1 fixture(s)

• 拷貝web網頁至指定目錄

[root@localhost webvirtmgr]# mkdir /var/www
[root@localhost webvirtmgr]#cp -r /usr/local/src/webvirtmgr /var/www/
[root@localhost webvirtmgr]#chown -R nginx.nginx /var/www/webvirtmgr/

• 生成密鑰

[root@localhost ~]# ssh-keygen -t rsa
Generating public/private rsa key pair.
Enter file in which to save the key (/root/.ssh/id_rsa):
Created directory '/root/.ssh'.
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /root/.ssh/id_rsa.
Your public key has been saved in /root/.ssh/id_rsa.pub.
The key fingerprint is:
SHA256:CQoZtso2M5Uo39lKvjZboncqakQ69iJt5wnjiJKZNhw root@kvm
The key's randomart image is:
+---[RSA 2048]----+
|  o              |
| ..+.            |
|..+o  .          |
|o+.o + . .       |
|+*. = . S        |
|+E+o .           |
|+*= + .          |
|BO+===.          |
|Oo=**=           |
+----[SHA256]-----+
//由於這裏webvirtmgr和kvm服務部署在同一臺機器，所以這裏本地信任。如果kvm部署在其他機器，那麼這個ip

[root@localhost ~]#ssh-copy-id  192.168.170.13

• 配置端口轉發

[root@localhost ~]#ssh 192.168.100.13 -L localhost:8000:localhost:8000 -L localhost:6080:localhost:60
[root@localhost~]# ss -antl
State       Recv-Q Send-Q Local Address:Port               Peer Address:Port
LISTEN      0      128              *:111                          *:*
LISTEN      0      5      192.168.122.1:53                           *:*
LISTEN      0      128              *:22                           *:*
LISTEN      0      100      127.0.0.1:25                           *:*
LISTEN      0      128      127.0.0.1:6080                         *:*
LISTEN      0      128      127.0.0.1:8000                         *:*
LISTEN      0      128             :::111                         :::*
LISTEN      0      128             :::22                          :::*
LISTEN      0      100            ::1:25                          :::*
LISTEN      0      128            ::1:6080                        :::*
LISTEN      0      128            ::1:8000                        :::* 

• 配置nginx

[root@localhost ~]#vim /etc/nginx/nginx.conf
user nginx;
worker_processes auto;
error_log /var/log/nginx/error.log;
pid /run/nginx.pid;

include /usr/share/nginx/modules/*.conf;

events {
    worker_connections 1024;
}

http {
    log_format  main  '$remote_addr - $remote_user [$time_local] "$request" '
                      '$status $body_bytes_sent "$http_referer" '
                      '"$http_user_agent" "$http_x_forwarded_for"';

    access_log  /var/log/nginx/access.log  main;

    sendfile            on;
    tcp_nopush          on;
    tcp_nodelay         on;
    keepalive_timeout   65;
    types_hash_max_size 2048;

    include             /etc/nginx/mime.types;
    default_type        application/octet-stream;

    include /etc/nginx/conf.d/*.conf;

    server {
        listen       80;
        server_name  localhost;

        include /etc/nginx/default.d/*.conf;

        location / {
            root html;
            index index.html index.htm;
        }

        error_page 404 /404.html;
            location = /40x.html {
        }

        error_page 500 502 503 504 /50x.html;
            location = /50x.html {
        }
    }
}


[root@kvm ~]# vim /etc/nginx/conf.d/webvirtmgr.conf
server {
    listen 80 default_server;

    server_name $hostname;
    #access_log /var/log/nginx/webvirtmgr_access_log;

    location /static/ {
        root /var/www/webvirtmgr/webvirtmgr;
        expires max;
    }

    location / {
        proxy_pass http://127.0.0.1:8000;
        proxy_set_header X-Real-IP $remote_addr;
        proxy_set_header X-Forwarded-for $proxy_add_x_forwarded_for;
        proxy_set_header Host $host:$server_port;
        proxy_set_header X-Forwarded-Proto $remote_addr;
        proxy_connect_timeout 600;
        proxy_read_timeout 600;
        proxy_send_timeout 600;
        client_max_body_size 1024M;
    }
}

• 確保bind綁定的是本機的8000端口

[root@localhost ~]# vim /var/www/webvirtmgr/conf/gunicorn.conf.py
.....此處省略N行
bind = '0.0.0.0:8000'     //確保此處綁定的是本機的8000端口，這個在nginx配置中定義了，被代理的端口
backlog = 2048
.....此處省略N行

• 重啓nginx

[root@localhost ~]#systemctl restart nginx
[root@localhost ~]#ss -antl
State       Recv-Q Send-Q Local Address:Port               Peer Address:Port
LISTEN      0      128              *:111                          *:*
LISTEN      0      128              *:80                           *:*
LISTEN      0      5      192.168.122.1:53                           *:*
LISTEN      0      128              *:22                           *:*
LISTEN      0      100      127.0.0.1:25                           *:*
LISTEN      0      128      127.0.0.1:6080                         *:*
LISTEN      0      128      127.0.0.1:8000                         *:*
LISTEN      0      128             :::111                         :::*
LISTEN      0      128             :::22                          :::*
LISTEN      0      100            ::1:25                          :::*
LISTEN      0      128            ::1:6080                        :::*
LISTEN      0      128            ::1:8000                        :::*

• 設置supervisor

[root@localhost ~]#vim /etc/supervisord.conf
.....此處省略上面的內容，在文件最後加上以下內容
[program:webvirtmgr]
command=/usr/bin/python2 /var/www/webvirtmgr/manage.py run_gunicorn -c /var/www/webvirtmgr/conf/gunicorn.conf.py
directory=/var/www/webvirtmgr
autostart=true
autorestart=true
logfile=/var/log/supervisor/webvirtmgr.log
log_stderr=true
user=nginx

[program:webvirtmgr-console]
command=/usr/bin/python2 /var/www/webvirtmgr/console/webvirtmgr-console
directory=/var/www/webvirtmgr
autostart=true
autorestart=true
stdout_logfile=/var/log/supervisor/webvirtmgr-console.log
redirect_stderr=true
user=nginx

• 啓動supervisor並設置開機自啓

[root@localhost ~]#systemctl start supervisord
[root@localhost ~]#systemctl enable supervisord
[root@localhost ~]#systemctl status supervisord
```

- 配置nginx用戶
```
[root@localhost ~]# su - nginx -s /bin/bash
-bash-4.2$ ssh-keygen -t rsa
Generating public/private rsa key pair.
Enter file in which to save the key (/var/lib/nginx/.ssh/id_rsa):
Created directory '/var/lib/nginx/.ssh'.
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /var/lib/nginx/.ssh/id_rsa.
Your public key has been saved in /var/lib/nginx/.ssh/id_rsa.pub.
The key fingerprint is:
SHA256:rdbmW/YIXxAJBzPsd9q9eKHPjWtSZ5EQC5li3tkczYI [email protected]
The key's randomart image is:
+---[RSA 2048]----+
|         .=o=.+  |
|         o.E.=.o |
|        o.o *.+ .|
|         o.o.+.o |
|        S ...+ ..|
|         o  ..o.+|
|        o + o.+oo|
|       . o =.*o+.|
|          o.oo*+.|
+----[SHA256]-----+

-bash-4.2$ touch ~/.ssh/config && echo -e "StrictHostKeyChecking=no\nUserKnownHostsFile=/dev/null" >> ~/.ssh/config
-bash-4.2$ chmod 0600 ~/.ssh/config

-bash-4.2$ ssh-copy-id [email protected]
/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/var/lib/nginx/.ssh/id_rsa.pub"
/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
Warning: Permanently added '192.168.160.109' (ECDSA) to the list of known hosts.
[email protected]'s password:

Number of key(s) added: 1

Now try logging into the machine, with:   "ssh '[email protected]'"
and check to make sure that only the key(s) you wanted were added.

-bash-4.2$ exit
logout





[root@localhost ~]# vim /etc/polkit-1/localauthority/50-local.d/50-libvirt-remote-access.pkla
[Remote libvirt SSH access]
Identity=unix-user:root
Action=org.libvirt.unix.manage
ResultAny=yes
ResultInactive=yes
ResultActive=yes


[root@localhost ~]# chown -R root.root /etc/polkit-1/localauthority/50-local.d/50-libvirt-remote-access.pkla
[root@localhost ~]#  systemctl restart nginx
[root@localhost ~]# systemctl restart libvirtd
```

## kvm web 界面管理
通過ip地址在瀏覽器上訪問kvm，例如我這裏就是：http://192.168.170.13

![在這裏插入圖片描述](https://img-blog.csdnimg.cn/20191102154020949.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MjMxMzc0OQ==,size_16,color_FFFFFF,t_70)