I was on BP meds (10mg of Lisinopril) when I first started Atkins (pre-diabetes), and came off them after 6 months, when I'd lost 50lbs. I went back on Lisinopril at my own request 2 years later, when I started to regain the weight, the BP started to creep up, and I started a very stressful job.
At present I'm on 2.5mg of Lisinopril. My BP at my last blood test (last Monday) was 134/80. I asked the doctor if I could come off then again when I've finished this packet, and he said yes, but pop in to the nurse every fortnight or so to make sure things have stabilised.
So - depending on how high your BP is, it's possible to stop taking the meds, though some people will never be able to.
Why not ask your GP to decrease the dose and see what happens?
I usually take 450mg of absorbable magnesium daily because this helps with BP, but I haven't taken it for about 2 months now. I shall start again soon.
Viv 8)