Configuring Proxmox to replicate between two hosts

Intro

The goal is to have one primary server (pve1) that is running my web server VM and a secondary server (pve2) that is in standby in the event that pve1 fails and then pve3 if pve1 and pve2 are out, and so on.

Basic requirements

The solution is simple. Pve1 will replicate the VM’s hard drive to pve2’s storage. There are some requirements:

1. Both servers must be a part of a cluster
2. ZFS storage must be used instead of lvm
   (other options also exist outside the scope of this post)
3. ZFS Pools must have the same name - lake (in my cluster)
4. The network connection must be super reliable and free of noise
5. All nodes need to have the same networks vmbr0, vmbr1 ...
6. All nodes need to use the same VLANs
7. Nodes should preferably use the same CPU family

See my post Proxmox HA