Antonyms for the phrase "have confidence of" would include "lack faith in," "doubt," "mistrust," "disbelieve," and "question." These words all suggest a lack of trust or belief in someone or something, which is the opposite of having confidence. When we lack confidence, doubts and uncertainties can cloud our judgment and prevent us from taking action. Conversely, having faith and confidence can inspire us to take risks, tackle challenges, and achieve our goals. Therefore, it is essential to identify and address any negative feelings or doubts that may be undermining our confidence and self-belief.