hi shygirl,
please try not to panic too much about this letter. "Some nerve damage" can mean a lot of things, and may be nothing terribly serious at all. You know many diabetics (most? - not sure of the percentage) have some nerve damage, myself included.
Two things to say: first, nerves can heal, so nerve damage may not be permanent (I had neuropathy [nerve damage] in my feet, which has improved considerably over this past year); and secondly, I'd question why you need medication for it. If you don't want more meds, which I totally understand, you're not obliged to take them. My nerve damage improved with an extended period of good blood sugar control, no pills apart from the 2x500 Metformin I take anyway.
I know it's hard to cope with scary communications from the medical profession, especially if you're on your own, but you get great advice and support from this forum which personally I value higher.
So please try not to worry, it sounds like you're doing pretty well overall.