Better to stay in the heart of the action - Haad Rin. Or one one of the many beaches around this wonderful island. Being stuck in the middle of nowhere is not so great.
If your solo or group of friends who want to be close to the action and party is your scene, then yes haad rin is a good option, but it was only about 15 min ride on the scooter for us to get there :)
