Ceph Opennebula

Please turn on subtitle for this video.
Ceph 15.2.4
Opennebula 5.12.0.1
Virtual mashine live migration 2:33 in Opennebula using Ceph cluster as block storage.
2:03 a virt-viewer is used to open the VNC from Opennebula in a separate window ;)

Tutorial for installing Ceph running on Debian 10:
Tutorial for installing Ceph running on CentOS 8:

Infrastructure setup:
/etc/hosts
#Ceph cluster
192.168.100.116 ceph1
192.168.100.64 ceph2
192.168.100.67 ceph3

#Opennebula cluster
192.168.100.127 ON-FrontEnd-CentOS
192.168.100.104 ON-node3
192.168.100.128 OP-Node4

Old video with Ceph ver. 14 and Opennebula 5.8:

[MiljanArandjelovic]

Execute on Opennebula nodes to allow VMs to access the Internet, If we want the VMs to be from the 172.16.0.0/24 network,
while the access to the Internet via the network is 192.168.100.0/24
We need to create a bridge interface and add IP 172.16.0.1 to it.
In the routing table we need to add a default route for the bridge over IP 172.16.0.1
# ip a
...
2: eth0: <BROADCAST, MULTICAST, UP, LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether 00:15:5d:64:08:52 brd ff:ff:ff:ff:ff:ff
inet 192.168.100.104/24 brd 192.168.100.255 scope global noprefixroute eth0
valid_lft forever preferred_lft forever
inet6 fe80::eb2e:7922:1204:2eb9/64 scope link noprefixroute
valid_lft forever preferred_lft forever
4: br0: <BROADCAST, MULTICAST, UP, LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether fe:00:ac:10:00:0b brd ff:ff:ff:ff:ff:ff
inet6 fe80::ec34:4fff:feee:f56d/64 scope link
valid_lft forever preferred_lft forever
5: one-75-0: <BROADCAST, MULTICAST, UP, LOWER_UP> mtu 1500 qdisc fq_codel master br0 state UNKNOWN group default qlen 1000
link/ether fe:00:ac:10:00:0c brd ff:ff:ff:ff:ff:ff
inet6 fe80::fc00:acff:fe10:c/64 scope link
valid_lft forever preferred_lft forever
...

In opennebula we have to create a network that will use bridge driver, bridge interface br0 and network pool from 172.16.0.0/24

Execute the following commands only on Opennebula nodes:

sysctl -w net.ipv4.ip_forward=1
#iptables -t nat -A POSTROUTING -s 172.16.100.0/24 ! -d 172.16.100.0/24 -j MASQUERADE
#iptables -L -t nat
...
Chain POSTROUTING (policy ACCEPT)
target prot opt source destination
MASQUERADE all -- 172.16.100.0/24 !172.16.100.0/24
...

iptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE
...
Chain POSTROUTING (policy ACCEPT)
target prot opt source destination
MASQUERADE all -- anywhere anywhere

...

# /sbin/iptables-save > /etc/sysconfig/iptables