I'm T2 and I made gradual changes in my diet, first by cutting out added sugar to anything and by adding fresh and raw. Then I started to drop the startchy carbs and adopted a low GI approach to the carbs I did eat.
Then I started cutting out bread, pasta, anything with flour, rice and potato. That made a massive change to my blood sugar. I made this switch at about the time I got my meter.
I think my approach to removing something is "what are you actually going to replace it with?" The thing you are removing may not be nutritionally essential, but it is a habit and I think we have to take that in to account, over and above what might be going on in our bodies. I don't think massive sudden changes are sustainable in the longer term, especially if we have not checked out some of the alternatives before we make the change. I looked at what kind of food I was going to eat instead (I'm a vegetarian), so I bought some receipe books to get some ideas and started experiementing before I went low carb.
Since I worked out what were helpful low carb snacks and made sure I had them on me, especially out of the house, it has been a lot easier. I usually have some nuts or bits of cheese on me if I'm travelling.
I have also found that I'm not so hungry all the time, which makes it easier, but if I go too long without eating my blood sugar goes astray, so I try to have snacks available. I have found it isn't just what I'm eating, but when. I have to manage that carefully at work because if I'm out of the office or in a long meeting it can completely throw my blood sugar.
I have found planning is really important and I have had to get a lot more organised around eating, and I'm a diet only T2!