Yes you can, basically in networking you can solve any issue with a tunnel interface :D As long as your underlay network can reach across your AWS VPC or Azure VNET - the overlay should work granted that the proper ports are opened. TCP port 2377 for cluster management communications. TCP and UDP port 7946 for communication among nodes. UDP port 4789 for overlay network traffic.
