In some cases, where a product could provide a benefit, I carefully test it. A case in point is the Seachem borate alkalinity test. If it worked, it would be a benefit. But careful testing shows it does not work well enough to be useful:
http://www.advancedaquarist.com/issues/june2003/chem.htm
In other cases, I determine based on the known chemistry of the product, whether it can actually work as described (or not). Sometimes I also combine testing with that to "prove" that known science holds true. Aragamight is an example:
http://www.advancedaquarist.com/issues/july2002/chem.htm
I try not to get too involved in the relative merits of things what absolutely can only be tested in aquaria, and have high potential variability of results. Many food products fit this category, and even some trace element supplements.
In other cases, I read everything I can find in the scientific literature, and combine it with my experiences and those of many others (I have read hundreds of thousands of reefers posts on products) to come to an assessment. Iodine and strontium supplements are examples of that:
Iodine in Marine Aquaria: Part I
http://www.advancedaquarist.com/issues/mar2003/chem.htm
Iodine in Reef Tanks 2: Effects on Macroalgae Growth
http://www.advancedaquarist.com/issues/april2003/chem.htm
Strontium and the Reef Aquarium
http://www.advancedaquarist.com/issues/nov2003/chem.htm
Never is my assessment based on a simple: It doesn't work for me so it cannot work for you" type of analysis, nor do I ever accept a simple 'It did work for me so it WILL work for you".
http://www.advancedaquarist.com/issues/june2003/chem.htm
In other cases, I determine based on the known chemistry of the product, whether it can actually work as described (or not). Sometimes I also combine testing with that to "prove" that known science holds true. Aragamight is an example:
http://www.advancedaquarist.com/issues/july2002/chem.htm
I try not to get too involved in the relative merits of things what absolutely can only be tested in aquaria, and have high potential variability of results. Many food products fit this category, and even some trace element supplements.
In other cases, I read everything I can find in the scientific literature, and combine it with my experiences and those of many others (I have read hundreds of thousands of reefers posts on products) to come to an assessment. Iodine and strontium supplements are examples of that:
Iodine in Marine Aquaria: Part I
http://www.advancedaquarist.com/issues/mar2003/chem.htm
Iodine in Reef Tanks 2: Effects on Macroalgae Growth
http://www.advancedaquarist.com/issues/april2003/chem.htm
Strontium and the Reef Aquarium
http://www.advancedaquarist.com/issues/nov2003/chem.htm
Never is my assessment based on a simple: It doesn't work for me so it cannot work for you" type of analysis, nor do I ever accept a simple 'It did work for me so it WILL work for you".
