There really isn't anything toxic in PVC to aquarium life. Some plastics, like BPA can leach elements that can cause problems but I would not consider them to be toxic. Some injected plastic parts on equipment can be covered in mold release with is use in pumps, heaters, and any HOB or canister filters. Rinse those with warm water and you should be fine.
If you are gluing parts, PVC cleaner and primer will remove anything that might make a bad bond.