Ya, having a small amount of rock will limit you in terms of the bioload your tank can handle. There are ways to squeeze more rock in, suck as putting some rubble in a chamber in your sump. Keep flow high to keep particles suspended, skim very heavily, feed smartly so that as little food is not eaten as possible, etc. I think you are probably underestimating the amount of rock you will want. A 180 is a big tank with nice 24" depth and height. You could probably easily put double that rock in and still have a very, very open and clean aquascape. You could probably do 3x 30-40# pillar/islands and have a ton of swimming room.
You might go around and look at other peoples 6' tanks and see how much rock they are using to give you an idea.