The way in which memory can be impacted is a fascinating subject, and there are a variety of synonyms for the phrase "affect memory." One common term is "deteriorate," which suggests a gradual decline in memory abilities due to age or disease. Another synonym is "impair," which is often used to describe the impact of drugs, alcohol or head injuries on memory. More specific terms include "amnesia," which refers to a condition in which memory is lost completely, and "forgetfulness," which describes a more mild form of memory loss that is often associated with stress or aging. Other possible synonyms for affecting memory might include "hinder," "limit," or "inhibit".