1) there is no laboratory style test or tests that will tell you if you have made a quality blade.
Right! There are tests that will tell you if your heading in the direction YOU want to go, but there simply is no lab test(s) that can conclusivley say "That's a quality blade", or "That one isn't any good".
2) Since ultimately blade performance is what matters, we should be testing how a blade performs and worry less about lab data. (possibly this will tell us much about design issues also?)
I believe without even realizing it, you've sumed up much in that one sentence! I believe it's all about the "Overall Package"....while certain lab tests can point us in a general direction, intengration of design elements can either enhance or detract from the overall performance of a blade.....for example, you can have a high hardness, but if your grind geometry doesn't compliment that geometry (of vice versa) the edge can chip of "flake" during use. It's about mixing the proper "chemical" properties, with mechanical properties that compliment each other.
Believe it or not, there are a number of "knifemakers" out there who take little interest in "performance", and rely more on "bling" to sell their knives...and their customers frankly don't care about performance....only that they have the "coolest" looking knife. (yeah.....I don't get that one either, but it's out there).
3) consistency in manufacture, heat treat, temper, etc. will narrow the chance of flaws and help "corral" some of the unknown variables that exist.
Again, yes! The caveate is that the "variables" can be constantly changing.....therefore we must be capable of adjusting from blade to blade that we produce. If anyone ever claims they produced the "perfect" blade, their either a lier, or simply have a very limited concept of knifemaking. As I mentioned before, the best knifemakers are the one's who constantly seek improvement, eventhough they realize and understand that they will never produce a "perfect" blade.....it's all about the race....not the finish.
My hat's off to you for asking these questions....many wouldn't. They would be too embarassed to do so. As I tell anyone who will listen, I learn something new, every single day in the shop, and over the years have learned many more ways NOT to do something, then I have "correct" ways of doing the task(s).....each of us must learn what works FOR US, and what works well for one knifemaker, does not work the same for another. There are always broad similarities that apply throughout, but it's the "tweaking" that makes each one of us different from the next.
Heck, there was a time when Kevin and I used to argue over heat treating blades.....but we both achieved our MS rating, going about it in different ways/methods, and I suspect to this day we do things differently, but that doesn't mean one is right and the other is wrong...just that we each do what works for us. In my opinon, there's not another MS that has the level of metallurgy knowledge Kevin does.....and when I have that type of question, I can general browse Kevin's posts and find what I need....if not, then I will ask him! If you EVER think you know it all, you're only foolin youself.