I think you'll be fine. I used to take skimmer water from overflow then it was fed into the refugium. The skimmer couldn't take all the nutrients out of the water. On second thought, the water that entered the fuge also went thru a filter bag before going into the skimmer and refugium. I still had plenty of pods and macro growth. Maybe I would have had more if it was run the otherway around, I don't know, But IME you're idea will work fine.