That has happened to me with cream, too. Though that seems to have resolved, and now eggs give some trouble. Though not all the time. Confusing? Oh yes! Even with an ‘elimination diet’ , supervised and supported by HCP, there was no discernable pattern.
I am no longer missing cream. Nuts and cheese, I crave, but have not weakened.
Also, reflecting on what I have been doing differently, I realise that I am not drinking water as much as I used to. Partly because when I get out for exercise, there are no toilet facilities, so reduced input = reduced output. That doesn’t explain why my coffee , without milk or sweeteners, consumption has doubled over last few months. An aha moment. Going to go back to drinking at least 2 litres of water a day, and reduce coffee from 6 or 7 to 3 or less a day.