You are right you definitely missed out by not spending at least one night. Though it's pretty quiet after dark. It's nice to get up early and spend time on Phra Nang beach before the day trip crowds arrive. The longest I spent in Ao Nang is 6 hours back in April as a day trip from Railay for Songkran.
