The gallbladder stones can be made smaller, or if you are lucky, asymptomatic or even dissolved by adjusting your diet.
If your diet is low in fats, the gallbladder does not empty then replenish on a regular basis. Bile remains in the sac long enough for spontaneous crystallisation to occur. Stones form but there is little pain as the is no irritation caused by gallbladder emptying and becoming inflamed by stones rubbing the sac lining.
If your diet is high in fats the gallbladder is emptied and refilled regularly, thus not producing stones in the first place, and creating a "rinse" effect that can dissolve stone layers.
The problem may be if you move from low fat to moderate/high fat diet. This may be first time you discover presence of gall stones - they are likely to have been present before diet change, but not caused by diet change.
Unless you have to have gall stones removed (the inflammation becomes chronic, or spreads), it may be worth to persevere with high fat, and ask your doctor for analgesia to manage episodic pain.