It does clearly appear the ballast exceeded the lamps rated operating current. During lamp warm up all ballasts provide approximately 1.5 times the nominal lamp operating current. With the son agro ballast the current will be higher than the lamp is designed to handle. This can sometimes be seen when the lamp is first fired. The long wire lead / fly wire may glow from excessive current. The lamp current decreases until the lamp is fully warmed up. This is why I asked if you knew when the lamp failed. During normal operation the current is lower and should not exceed the lamps current rating, even when using that ballast.
The input voltage will influence the lamp current with magnetic ballasts. Typically autotransformer CW type ballasts can tolerate a 10% difference in input voltage without going too far out of spec. If your input voltage (from your outlet) isn't too high this should not be an issue. If your input voltage drops too low the ballast will not be able to support the lamp. The arc will just extinguish and the lamp will restart. This could potentially be a problem. The lamp will cool down slightly before starting up again. If the lamp is still hot the wire will handle even less current.
Another problem could be the capacitor on the ballast. If the capacitor is operating out of spec or another capacitor with a different rating is used, the lamp current will change. If you replaced the ballast and capacitor this should not be an issue.
This was not an issue when that ballast and lamp combination was popular. Radium changed the internal construction of the lamp a few years ago. The 400 watt lamp now has a longer thin wire and the arc tube was shortened. This change could theoretically cause problems when overdriving this lamp. Positioning the lamp so the long wire is at the bottom of the lamp may help.
The M135/M155 ballast is the recommended ballast but the lamp will be dimmer and bluer. The PAR output will be approximately 35% less and the light will appear more monochromatic blue. When the Radium 20,000K lamps are operated on the recommended ballasts the 400 watt lamp is the bluest of the lamps (150W and 250W).