Please let us kick people from challenges/don't allow people to join without invitation

I do weekly challenges with friends but if we have an empty spot people from my or their friends lists just join and then we can’t have our friends in. I wish we could not allow people to join without an invitation or we were able to kick people from groups