Generally, folks go skimmerless for the refugues and find this works rather well.
As mentioned, pull too much out= nothing for them to grow with.
Too much one way(too little), or not enough relative to export goal(too much, but finding the balance is the key, so if you watch the NO3, and dose accordingly, say KNO3 or Ca(NO3)2, then they grow well.
You can add PO4, but adding just the NO3 drives the PO4 lower than any test kit can measure hobbyists might use.
If that is the goal...........no phos ban needed then.
You have to trim and prune the excess macro also, other wise it keeps demanding more and more.
Since PO4 is strongly limiting, you can now feed corals and fish more without worry.
Skimmers have their advantages, but so do macros and ATS's.
Regards,
Tom Barr