I had the same experience. I eat breakfast, then fast thorough the day and eat again in the evening. That seems to bring about the best results.
As that is what always happens, I just accept that it is the way I am programmed - if I do not eat in the morning my ever helpful liver keeps on putting out the glucose so that I can find something to eat.
I eat only limited carbs in the morning, up to about 10 gm max, as that is also the time I am most insulin resistant, from what I can work out.