Confidence is over rated and misunderstood.
It's an emotion, based on results.
When you're not good at something, when the risk is high, when the game is on the line, it's difficult to feel confident.
How about trying courage instead?
Confidence is an emotion, courage is an action.
You can be courageous even when you don't feel confident.