In a public park, you can absolutely ask random people to leave your party area. Not the park, but the space you are using. Double so if you've gone through the official channels to reserve that section.

And that goes both ways: If someone is having an event and one inserts themselves where they're clearly not invited, then that person very much has issues respecting others' boundaries.

It all boils down to people respecting each other.