Sounds very familiar though I've never thought my hypos were associated with anxiety because the anxious feeling always went away when the hypo was resolved. Having grown up with both T1 and T2 in my family, I knew what a hypo was and that the hypos I started having in my early 20's meant I would become T2 later in life.
You should probably ask your GP to refer you for a prolonged Glucose Tolerance Test. A prolonged GTT will probably show you to have reactive hypoglycaemina as well as T2.
If that's the case then what is likely to help is to stick to foods that are low on the glycaemic index and to eat several small sensible meals a day at regular intervals rather than three normal meals. Managing reactive hypoglycaemia effectively requires that you plan for those times when you are likely to have a low and to have eaten something around half an hour to an hour before to prevent it. I tend to have a small breakfast, then snack every few hours through the day and finish with a normal evening meal that is fairly high in protein.
I still have hypos on weekends when I fail to follow my regular schedule, but that's my own fault for not eating when I should.