Inviting ONLY through in-game

I am playing this on ps5

I wanted to know if there is a way to choose to only invite people through the in-game party system because trading with other people on ps5 and I can only invite them through ps5. This is a bit annoying because I find that people on ps5 are much less likely to join that invite or they unknowingly have the ps5 setting of not allowing invites from people who aren't on their friends list. I would love there to be a way to turning on inviting only through the in-game system.

Thank you for any help.