I might be irritated, but provided I felt fine, I wouldn't be too concerned about it. It could be either your lunch causing a delayed rise (if it contained a lot of fat, say), or, as others have suggested a liver dump.
@Inchindown - The way I view liver dumps is a bit like how a rechargeable battery works. Our livers store some glucose to help us out if we need additional energy, for whatever reason. As you appreciate, that can be getting up from a rest, strenuous exercise, just as examples.
When we are trying to bring our numbers down, we can have more liver dumps than later on. Our bodies like to work to a routine, including blood numbers, and will try to keep us in it's established comfort zone, so if that comfort zone is too high, we want to reset that comfort zone to a lower, healthier level.
When our livers make a contribution to our energy requirements, it's resources get a little depleted (like a battery), but as soon as we eat something, the first our body prioritises is replenishing that charge, making it available for next time.
Personally, I don't feed my liver dumps, provided I feel fine and I'm comfortable that a meal will be along relatively soon. If, on the other hand, I just know I'd have to gnaw on a chair leg if I didn't eat something, I do just that. I either have a few nuts or a cup of tea.
I see liver dumps as actually very healthy, and when our liver make a contribution, then recharge, that's healthy too. In my visualising mind, I see it a bit like having a spare carton of milk in the fridge. I make sure I cycle that, to keep it fresh. When I buy milk, I will put it into the fridge in such an order that means I will use the older carton first.
That's just the way I look upon it.