If you're anything like me then the initial tendency when you give in to a craving is basically the mindset "I might as well keep going."
There's nothing wrong with giving in to the occasional craving, but you have to find a way to discipline yourself. I'll tell you from experience that the "All or nothing" approach generally isn't sustainable long-term.
Yes, for me some of the low-carb substitutes do work, but I have to make sure I don't over-indulge on those too (which is arguably even easier).
For me, my guilty pleasure is low-carb ice cream with powdered cinnamon on top. I can (and have) eaten an entire container's full before so it's certainly something I have to moderate.
I allow myself to have SOME of the ice cream whenever I've accomplished something: maybe that's run 5+ miles that day, achieve 12000 steps, maybe I hit a certain bodyweight on my scale, etc. No matter what, it's always an achievement/reward approach.
In contrast, if I haven't achieved anything that day, I'm not allowed to eat the ice cream. It's not that I couldn't moderate the urge....I just don't want to find out.
Long story short, try to set some goals and/or rules for yourself where you can OCCASIONALLY reward yourself with the foods you crave in MODERATION. That makes it more difficult to go crazy and eat everything in sight.