Can you play multiplayer minecraft on the Xbox 1 without Xbox live gold?

I'm trying to play minecraft with a friend online but when I do offers for Xbox live gold pop up. I decline both of them and the invite sends regardless but I don't think my friend gets them. Any help?