Weekends away (Colombo)

Hi all
We're looking for suggestions for weekends away Protected content drive from colombo. Any recommendations for towns and accommodation would be greatly appreciated. We will have a small baby so we are looking for a luxury villa/small hotel in an area with activities such as hiking/cycling or simply chilling by the beach. We haven't been anywhere yet so looking for areas of beauty you can recommend! Trying to avoid too touristy resorts. Thanks for any advice!