What kind of diver's gloves? you mean like the thick neoprene ones you'd use diving on a real reef?
They should be OK, but it seems excessive to me. Just get a pair of those durable rubber gloves made for dishwashing.
At any rate, make sure whatever you use doesn't have any contaminants on it!