A fix was issued for interaction prompts on ladders and while climbing up is no longer an issue the interaction for climbing down is difficult to find.
Players have mentioned jumping into the water where possible or jumping and turning to quickly grab the ladder as the prompt appears on the way down. Both can potentially result in broken bones if a player misses.
I did notice that the interaction prompt for climbing back down the buildable tower wasn’t there, but if I look down at the ladder and interact anyway, it has always worked just fine for me and attaches to the ladder to climb down easily. I can’t remember if it’s the same for the top of freighters though. Either way try this before you jump! Or at least aim for the water if you do have to jump. Lol.