Ok wanted to revisit this thread as its been almost a month to give an update.
I went to Europe for 25 days, and in that time I had someone watching my tank and feeding daily one cube of either mysis/brine/blood worms. I didnt do a water change for a month, and when I returned my SPS definitely colored up pretty nicely to the point where I am satisfied with the colors. The only thing that changed was that, as previously stated I stopped running GFO, and I changed my light bulbs from Radiums to Ushios.
I am not happy with the color of the water now due to the Ushios being pretty yellow. So I switched back to the Radiums. If I see color loss then I will know it was the bulb, if I dont see color loss then I know it was too sterile water. It definitely wasn't the PO4 levels as some had suggested because now they are even higher yet sps colors are great. If it turns out being the lighting then I will probably end up changing over to a vertex LED system.