I still have milk, but only full fat and less than I used to. All included in my daily carb count.
I am not lactose intolerant and love milk products, but realised I was having at least 35g of carbs a day in milk.
Apart from switching from skimmed to full fat, I replaced some of the milk in coffees with coconut milk or cream to reduce carbs. So my latte is now just a third milk, a little cream/coconut milk plus extra water - and I drink fewer mugs a day.