You need to realise that the carbs you'd eaten were the probably the first significant carbs that you'd eaten for a while. Your body CAN deal with one off's like that pretty well if you're lo-carbing.
BUT - I believe the effects of carbohydrates are cumulative. So the carbs you ate then will continue to effect your BG for a couple of days to come.
Again, a one off can be dealt with, but taking it everyday will likely cause your BG's to steadily rise.
Don't forget - it takes 2 days to deplete your carb stores, so if you had a slice every 3 days, your BG levels shouldn't take such a hit.