Island not loading without other player near (multiplayer)

For the topic title above, please use the format:
PC 0.90.08 World Loading Island not loading without other player near (multiplayer)

For the main post please follow the summary as best you can:
Feel free to edit and replace each section with your own info.

I rafted to another Island and the host was still on the Island I departed from, but when I got to the next Island the textures did not load, so I was unable to see shiprecks properly and the animals where stuck in a pose except when attacking and as soon as I got back to the island I originally departed from it loaded fully.

Unknown seed

Default options for loading except random gen

Leave the area the Host is in is what I think is the main issue