{"id":289,"date":"2016-09-23T12:44:40","date_gmt":"2016-09-23T02:44:40","guid":{"rendered":"https:\/\/icicimov.com\/blog\/?p=289"},"modified":"2017-01-03T00:17:47","modified_gmt":"2017-01-02T13:17:47","slug":"ha-features-in-proxmox-pve-cluster-and-final-words","status":"publish","type":"post","link":"https:\/\/icicimov.com\/blog\/?p=289","title":{"rendered":"HA Features in Proxmox PVE cluster and final words"},"content":{"rendered":"
At the end, some testing of the High Availability fatures in PVE 4.2 on node and VM\/LXC level.<\/p>\n
Instance Migration<\/h2>\n
Migrating (moving) LXC and VM instances from one node to the other when the instance is stopped works without any issues given the instance does not have a locally attached CD-ROM drive. We can use the GUI for this pusrpose but it is possible via the CLI too, it is simple as:<\/p>\n
For live migration, ie the VM instance is running, the VM’s root disk needs to be created on a shared storage (and any other secondary attached disks too for that matter). Then the VM can be migrated with no downtime using the GUI or the CLI command from above. Log of a successful live VM migration of vm104<\/code> with root disk on GlusterFS cluster storage:<\/p>\n
May 02 10:57:01 starting migration of VM 104 to node 'proxmox02' (192.168.0.186)\nMay 02 10:57:01 copying disk images\nMay 02 10:57:01 starting VM 104 on remote node 'proxmox02'\nMay 02 10:57:04 starting ssh migration tunnel\nMay 02 10:57:05 starting online\/live migration on localhost:60000\nMay 02 10:57:05 migrate_set_speed: 8589934592\nMay 02 10:57:05 migrate_set_downtime: 0.1\nMay 02 10:57:07 migration speed: 256.00 MB\/s - downtime 15 ms\nMay 02 10:57:07 migration status: completed\nMay 02 10:57:11 migration finished successfully (duration 00:00:10)\nTASK OK\n<\/code><\/pre>\n
The same was successfully tested for VM with root disk on DRBD storage. Here we can see the moving of vm105<\/code> from one node to the other while the instance was running:<\/p>\n
May 06 17:40:25 starting migration of VM 105 to node 'proxmox01' (192.168.0.185)\nMay 06 17:40:25 copying disk images\nMay 06 17:40:25 starting VM 105 on remote node 'proxmox01'\nMay 06 17:40:29 starting ssh migration tunnel\nbind: Cannot assign requested address\nMay 06 17:40:30 starting online\/live migration on localhost:60000\nMay 06 17:40:30 migrate_set_speed: 8589934592\nMay 06 17:40:30 migrate_set_downtime: 0.1\nMay 06 17:40:32 migration status: active (transferred 197603120, remaining 32460800), total 1082990592)\nMay 06 17:40:32 migration xbzrle cachesize: 67108864 transferred 0 pages 0 cachemiss 0 overflow 0\nMay 06 17:40:34 migration speed: 256.00 MB\/s - downtime 7 ms\nMay 06 17:40:34 migration status: completed\nMay 06 17:40:39 migration finished successfully (duration 00:00:14)\nTASK OK\n<\/code><\/pre>\n
Finally example of moving an instance with root device on the iSCSI shared storage:<\/p>\n
I have also tested the scenario of node failure by shutting down the proxmox02<\/code> cluster node. The VM’s running on this node automatically migrated to proxmox01<\/code> instance and started up successfully (this can be seen on one of the screen shots attached for PVE-4.2 at the bottom of this page). The VM’s need to be added to the HA group and marked for autostart for this to happen.<\/p>\n
Conclusion<\/h1>\n
Proxmox PVE has proved as very robust and feature reach open source virtualization environment for KVM and LXC. Proxmox VE 4 supports clusters of up to 32 physical nodes. The centralized Proxmox management makes it easy to configure all available nodes from one place. No SPOF (Single Point of Failure) when using a cluster, we can connect to any node to manage the entire cluster. The management is done through a Web console, based on a javascript frameworks, and gives the administrator a full control over every aspect of the infrastructure.<\/p>\n
It supports Local Storage, FC, iSCSI, NFS, ZFS and CEPH as storage technologies which is really impressive. If VM\/LXC is created as HA instance with disk(s) on shared storage it can easily be live migrated between the nodes. The integrated backup tool creates snapshots of virtual guests both for LXC and KVM all managed through the web UI console and CLI if needed. In practice it creates a tarball of the VM or CT data that includes the virtual disks and all the configuration data.<\/p>\n
The networking supports Linux Bridges and OpenVSwitch which can easily be extended to SDN overlay as described above. For added flexibility, it supports VLAN’s (IEEE 802.1 Q), bonding and network aggregations allowing us to build complex flexible virtual networks for the hosts.<\/p>\n
![\"\"](\"https:\/\/icicimov.com\/blog\/wp-content\/uploads\/2017\/01\/pve-4.2_01-420x204.png\")
<\/a><\/div>\n\t\t\t\t\t<\/figure>\n\t\t\t\t\t![\"\"](\"https:\/\/icicimov.com\/blog\/wp-content\/uploads\/2017\/01\/pve-4.2_02-420x204.png\")
<\/a><\/div>\n\t\t\t\t\t<\/figure>\n\t\t\t\t\t![\"\"](\"https:\/\/icicimov.com\/blog\/wp-content\/uploads\/2017\/01\/pve-4.2_03-420x204.png\")
<\/a><\/div>\n\t\t\t\t\t<\/figure>\n\t\t\t\t<\/div>\n\t\t\t\t\n\t\t\t\t\t![\"\"](\"https:\/\/icicimov.com\/blog\/wp-content\/uploads\/2017\/01\/pve-4.2_04-420x204.png\")
<\/a><\/div>\n\t\t\t\t\t<\/figure>\n\t\t\t\t\t![\"\"](\"https:\/\/icicimov.com\/blog\/wp-content\/uploads\/2017\/01\/pve-4.2_05-420x204.png\")
<\/a><\/div>\n\t\t\t\t\t\t![\"\"](\"https:\/\/icicimov.com\/blog\/wp-content\/uploads\/2017\/01\/pve-4.2_06-420x204.png\")
<\/a><\/div>\n\t\t\t\t\t<\/figure>\n\t\t\t\t<\/div>\n\t\t\t\t\n\t\t\t\t\t![\"\"](\"https:\/\/icicimov.com\/blog\/wp-content\/uploads\/2017\/01\/pve-4.2_07-420x204.png\")
<\/a><\/div>\n\t\t\t\t\t<\/figure>\n\t\t\t\t\t![\"\"](\"https:\/\/icicimov.com\/blog\/wp-content\/uploads\/2017\/01\/pve-4.2_08-420x204.png\")
<\/a><\/div>\n\t\t\t\t\t<\/figure>\n\t\t\t\t\t![\"\"](\"https:\/\/icicimov.com\/blog\/wp-content\/uploads\/2016\/09\/pve-4.2_09-420x223.png\")
<\/a><\/div>\n\t\t\t\t\t<\/figure>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\n
<\/a><\/div>\n\t\t\t\t\t<\/figure>\n\t\t\t\t\t