The phrase "rubbing the wrong way" typically refers to something that causes annoyance or irritation. While it is a well-known idiomatic expression, there are various synonyms that can be used to convey the same sentiment. For instance, you can use the phrase "getting on someone's nerves" to describe an activity or action that is irritating. "Grinding someone's gears," "making someone's blood boil," and "getting under someone's skin" are also commonly used alternatives for "rubbing the wrong way." Whatever term you use, the overall meaning remains the same: the situation is causing frustration and annoyance.