Even if surgery is recommended by your doctor, it is always your choice whether or not to have surgery. This is an elective procedure, meaning that there are no serious or life-threatening consequences associated with not having it. Furthermore, there are many alternatives available for treating vision problems, including continuing to wear your glasses or contacts.
Each surgical procedure does carry some risk, however, the final decision to have or not have surgery rests with you. All concerns related to this decision should be discussed with your doctor to your satisfaction. Then you and your doctor can decide upon a treatment method that is comfortable for you.