Hey,
I have been on the pump now for 3 years and I have not had any problems in this area at all.
I think if you just explain to people what it is then they in my experience are fine with it.
Depending on what your comfortable with I tend to unclip mine before and then just reclip it back on...