Your doctor is wrong, most people without diabetes will be at a lower level a lot of the time. Unless for some reason a person's body is unable to increase BG when required, "fitness to drive" is based on an accessible of a person's medical and physical state not a magic BG number.