Game Crashes When In Party

When warping to my party member the game will run for about 30-40 seconds where I can move around and play, before forcing me back to the Xbox Home Screen. When I hit play on the game again it starts up fine and loads my character fine, and even shows that the party member is still in my party, just in another instance. As soon as I go to join their instance it does it all over again. Had this problem over and over last night, started up today and it worked for a few hours and has now started up again. Doesn't seem to matter who is warping to who, and it has never happened to my party member. Please help!