So MAGICAL! I pre-booked the balloon through Klook (link in description) I think the prices vary depending on season so best to check your own dates. Otherwise most of the hotels will have options to book through them which may be cheaper.
The caves were whole cities with churches and homes etc! I believe people still live in them today, but a lot of it seems to have been commercialised for tourism. Definitely a fascinating place!