I wouldn't say it "totally torpedoes" the whole standardization. Obviously, the "Duramax ISO 5011 Test" was all done on the same test setup/hardware under the same test conditions by the same operator(s), so that's a pretty good apples-to-apples comparison there.
As far as comparing different company efficiency claims, the main thing you need to know is if the test was done with the "ISO Fine Dust" or the "ISO Coarse Dust" - see attachment below for the specs on the two test dust options. Most will not divulge that info unless you contact the manufacturer. For instance, I contacted Fram about the Ultra air filter and asked them which test dust was used in the ISO 5011 test and was told it was the fine dust (link below to my post).
Looking to replace the air filter on my 2005 Tacoma with 4.0L V6 (1GR-FE engine). I usually go with OEM, but wondering if anyone has found a good aftermarket filter (like AC Delco, WIX, etc) that fits and filters well. One concern is that it must fit well like the OEM filter. The Toyota dealers...
bobistheoilguy.com
Question is ... if the same filter brand & model was tested in the same test setup under the same test parameters, except that the dust used was the specified coarse instead of fine, how much would the efficiency really change? Only some controlled experimentation would tell.
As far as the three different efficiency tests, I would think most filter testers are reporting the "full life efficiency" since air filters will become more efficient as they load up (oil filters do not, they actually get less efficient when loaded up, as discussed in many threads).
I would think the air flow rate may have some impact on the measured efficiency as that may cause some captured debris "sloughing off", but nobody would know for sure without some controlled experimentation to show how. I'd suspect the design of the media has a big factor there, and filters that test lower efficiency are 1) letting particles through, and 2) probably sloughing off some already captured debris too. Filters that test higher in efficiency are doing 1) and 2) to a lesser degree.
The delta-p across air filters is really very low, only 25-30 inches of H20 (1 PSI) when really loaded near usable capacity, so it may be that air filters really don't slough off much if any already captured debris, and that phenomena is what cause them to become more efficient as the loading increases and the dP increases (without sloughing debris).
Also, keep in mind that ISO 5011 does not determine efficiency by using "particle counters" like ISO 4548-12 does for oil filter testing. ISO 5011 uses the weight of the total amount of test dust used, and compares the amount of the test dust by weight caught in the air filter to determine the overall efficiency of the filter.
Obviously, like any testing there is some room for setup and testing parameters, but the standard is better than nothing. It's an industry standard that's been around over 20 years, just like ISO 4548-12. If it was "that bad" it wouldn't have survived that long IMO.
From ISO 5011:
ISO 5011 Test Dust Specs for "fine" and "course" test dust:
Reporting sheet from ISO 5011 - Automotive Applications:
There are different test methods and reporting sheet for industrial application air filters.