I understand what you mean, quiet is nice.....BUT....it will very tough getting transport (tuk tuk) back up to places like the Hilltop. And if you're planning on drinking a fair bit and using your own motorbike, that can be pretty hairy too.
Really give some consideration to staying somewhere central. There are a number of GF hotels which are within walking distance of Bangla, yet offer a quiet stay.
My 2c worth.