Andrew, if he were talking about good biological filtering, you'd be right on the money, but for mechanical filtering, rock and sand is going to be a horrible way to go. YOu'll end up with high nitrates in the end.
Sgarron, I have recently added a fluval to a couple of my tanks, for just that reason, mechanical filtering. I removed all the biological media, filled one with phophate remover (seachem), some denitrator and matrix, and then lot's of filter floss, that I change out at least once a week. But as Lesages mentioned, it'll need to be cleaned according to how filthy it gets. And you definatly do not want it to start biologically filtering your tank, keep all the media cleaned and rinsed, even if not being replaced weekly, it should still get cleaned. Let the rock and sand biologically filter the tank.
As for using carbon or live rock in there, if you do not have a refugium going, than I'd probably pick at least one compartment to add some good rubble pieces too, if you do have a fuge, as I do, then really no point, save that last compartment for carbon or more mechanical filter media. I don't run carbon often, only after fragging alot or when alot of leathers decide to slim up on me at once. sTuff like that, otherwise it's just the stuff mentioned above.