I'm type 2 and have been on tablets for a long time, and 18 months ago was also started on insulin.
I have cut as many carbs from my daily food intake as I can without being silly about it. Yes you're right to cut out the obvious bad carbs (cakes, biscuits, sweets, chocolate, fizzy drinks, etc.)...