Good luck, Krista. It should be pretty strait forward. Once you pull the cover off you should be able to tell if one of the leds are fried. At that point it looks like just a simple matter of turning a few screws, pull the old one out and then lay the new one in. There's nothing to hook up or unhook. Those black square looking things should have contact points on the bottom side of them. Pretty simple, actually.
Just keep in mind exactly which 4 aren't lit right now. Are they all the same color?
If for some reason you cannot visually see which led is bad then just becareful that you don't accidentally go changing the colors around without confirmation from them that it's ok.