The colour psychology of yellow is uplifting and illuminating, offering hope, happiness, cheerfulness and fun but beware though as it can also bring about feelings of anxiety and agitation!
If you don't like the idea of wearing it directly next to your face (it can drain you and make you look pale and washed out), wear it on your lower half or mix it in with patterns.
If yellow is a complete clothing no-go, use it in your accessories instead and buy a yellow bag, belt, shoes or even nail varnish to add some zest and sunshine to your outfit.