I use kinesiology tape.
I cut a short length (rounding the corners to reduce chance of it peeling off, and making sure the skin there is dry and without sun lotion/moisturiser). I also put a disk of paper the size of the sensor between them to avoid pulling off the sensor when you remove the tape. It's a bit of a fiddle applying it centered and smoothly, particularly if you've got your sensor somewhere inaccessible, and it can be helpful to have someone else help.
Even for multiple extended swimming sessions over a day at the beach I find this keeps it on.
The tape seems pricey per roll, but you get dozens of patches from it, so it works out cheap.
Saunas on the other hand are a different story - I've never successfully kept a sensor on in one. Maybe skin-tac would work? I haven't tried yet.