KP is a great place for kids! So feel free to bring them.
Here’s a great blog post about the 15 best activities to do with kids in Koh Phangan.
There are great nannies and even a jungle school that you can put your kids into for a week at a time called Arki.