Go watch videos of real "reefs" on youtube..
That stuff is MOVING.. Currents can be very strong,etc..
Now there is a point where soft tissue corals are getting damaged by excessive movement/ripping their tissue on their own skeleton,etc... but I highly doubt you are there.. and its usually easy to see when its "swaying,etc.." versus violent abuse..
They should certainly be swaying/moving though..