![\"waterfall\"](\"http:\/\/www.dkms.com\/kmci\/alllifeisproblemsolving\/wp-content\/themes\/cutline-3-column-split-11\/images\/waterfall.jpg\")
<\/p>\n<\/p>\n
(Co-Authored with Steven A. Cavaleri)<\/font><\/font><\/strong><\/p>\n Here are some examples of criteria that may be used for comparing alternative solutions (i.e. decision models) in a Comparative Decision Making (CDM) context.<\/a><\/font><\/font><\/p>\n — Logical consistency (inconsistent decision models are invalid and must be reformulated)<\/font><\/font><\/p>\n — Empirical fit (competing models fit current and past data to varying degrees)<\/font><\/font><\/p>\n — Projectibility (models vary in their plausibility; models also vary in their after the fact success in prediction)<\/font><\/font><\/p>\n — Systematic fruitfulness (extent to which a decision model facilitates novel deductions)<\/font><\/font><\/p>\n — Heuristic quality (extent to which a decision model facilitates new conjectures)<\/font><\/font><\/p>\n — Systematic coherence and testability (coherence of statements relating abstractions in decision models, coherence of statements relating abstractions and concrete terms in decision models, and testability of expectations resulting from such coherence) <\/font><\/font><\/p>\n — Simplicity (economy in number of variables in a decision model, simplicity of mathematical form)<\/font><\/font><\/p>\n — Estimated risk of error in accepting a model rather than its alternatives.<\/font><\/font><\/p>\n In comparatively evaluating alternative solutions, the criteria we use and the way we combine them together comprise a kind of measurement model for a regulative ideal for comparison. Here are some examples of regulative ideals that might guide comparison in CDM. <\/font><\/font><\/p>\n — Comparison in the service of justifying a favored solution as the most valid one<\/font><\/font><\/p>\n — Comparison in the service of justifying one of the alternative decision models or solutions as the most valid one<\/font><\/font><\/p>\n — Comparison in the service of showing that one of the alternative decision models is a consensual model<\/font><\/font><\/p>\n — Fair Critical Comparison<\/a> to evaluate which of the alternative solutions stands up best to the most severe criticisms and safe-fail tests<\/a> that can be developed<\/font><\/font><\/p>\n Each of these regulative ideals for comparison will be accompanied by implicit or explicit requirements that need to be fulfilled to perform valid comparisons relative to the regulative ideal. For example, to perform \u201cfair\u201d critical comparisons one needs to ensure a \u201clevel playing field\u201d for the alternative solutions. Here are some requirements for that:<\/font><\/font><\/p>\n — Equivalent specification (competing solutions must be developed with equal specificity before comparative evaluation);<\/font><\/font><\/p>\n — Continuity (when preparing competing solutions for comparison, more concrete versions of them must not change the fundamental ideas expressed in their original, less evolved versions);<\/font><\/font><\/p>\n — Commensurability (when competing solutions are expressed in terminology that’s so different that they defy easy critical comparison, the solutions must be restated using a broader conceptual framework that enables comparing alternatives); and <\/font><\/font><\/p>\n — Completeness of the comparison set (the competing solutions must be representative of the range of alternatives as far as one knows, since it is easy to bias a comparison by leaving a strong alternative out of it).<\/font><\/font><\/p>\n There\u2019s a very important reason why we used the label CDM, rather than Rational Decision Making (RDM), to describe pre-action selection involving alternative models. It is that we believe that the term \u201crationality\u201d should not be associated solely with the CDM pattern, and that the Authoritarian Decision Making (ADM) and Recognition-Primed Decision Making<\/a> (RPD) patterns should not be associated solely with non-rationality. The choice of any of these three selection methods may be \u201crational\u201d depending on the context, and depending on what one means by \u201crationality.\u201d And once a choice is made about which selection method is appropriate in a particular context, the method selected can be implemented either \u201crationally,\u201d \u201cnon-rationally,\u201d or \u201cirrationally.\u201d<\/font><\/font><\/p>\n Of course, the Open Problem Solving Pattern<\/a> requires distributed, transparent, and \u201crational\u201d evaluation and selection of solutions to organizational problems. But, what do we mean by \u201crationality\u201d in the method of selection and evaluation of new solutions? Simply that, to the extent possible, the pre-action evaluation and selection process we implement, ought to be one that provides the most severe test<\/a> possible, within the bounds of practicality, of any proposed solution to a problem; so that solutions in error are eliminated before we have to implement them in action.<\/font><\/font><\/p>\n In other words, enhancing selecting and evaluating processes, means setting up as Darwinian an environment as possible for our solutions, on the assumption that the solution or solutions that best survive the pre-action critical process, are the ones most likely to be true. Or, if you like, to work, when we move from the PSP back to the Operational Pattern (OP).<\/font><\/font><\/p>\n Another way of viewing this is to note that even though the process of evaluating beliefs is Darwinian in the OP, it is not Darwinian in the PSP, unless we design it that way. That is, organizations can insulate beliefs from critical evaluation, testing, and fair comparison easily enough. In fact, they do that all the time. So the results of evaluation in the PSP may ill-prepare an individual or an organization for the reality it will face in the OP.<\/font><\/font><\/p>\n There are countless examples of this, but perhaps the most outstanding contemporary example is in the \u201cBush 43\u201d Administration\u2019s evaluation of whether or not to attack preceding the Iraq War. It\u2019s commonplace to point out that the Administration slanted the case for intervention to arrive at the result it wanted. It protected the \u201cGo-to-War\u201d solution from other alternatives that might have been adopted, and arranged any evidence so that it would \u201cjustify\u201d that alternative. But, clearly, the Administration\u2019s non-Darwinian, justificationist, evaluation process ill-prepared it for the Darwinian selection process imposed by the post-action OP of Iraq\u2019s reality. That process now has led most viewing the situation to conclude that the \u201cGo-To-War\u201d solution was a disastrous error resulting in costs that are much heavier than would have resulted from just continuing to contain Saddam.<\/font><\/font><\/p>\n To Be Continued<\/font><\/font><\/p>\n","protected":false},"excerpt":{"rendered":" (Co-Authored with Steven A. Cavaleri) Here are some examples of criteria that may be used for comparing alternative solutions (i.e. decision models) in a Comparative Decision Making (CDM) context. — Logical consistency (inconsistent decision models are invalid and must be reformulated) — Empirical fit (competing models fit current and past data to varying degrees) — […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[16,3],"tags":[951,886,607,885,156,763,146,153,130,84,151,907],"class_list":["post-117","post","type-post","status-publish","format-standard","hentry","category-epistemologyontology","category-knowledge-making","tag-951","tag-cdm","tag-commensurability","tag-comparative-decision-making","tag-fair-critical-comparison","tag-open-psp","tag-rational-decision-making","tag-rdm","tag-recognition-primed-decision-making","tag-risk-of-error","tag-rpd","tag-selecting-among-alternative-solutions"],"_links":{"self":[{"href":"https:\/\/kmci.org\/alllifeisproblemsolving\/wp-json\/wp\/v2\/posts\/117","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/kmci.org\/alllifeisproblemsolving\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kmci.org\/alllifeisproblemsolving\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kmci.org\/alllifeisproblemsolving\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/kmci.org\/alllifeisproblemsolving\/wp-json\/wp\/v2\/comments?post=117"}],"version-history":[{"count":0,"href":"https:\/\/kmci.org\/alllifeisproblemsolving\/wp-json\/wp\/v2\/posts\/117\/revisions"}],"wp:attachment":[{"href":"https:\/\/kmci.org\/alllifeisproblemsolving\/wp-json\/wp\/v2\/media?parent=117"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kmci.org\/alllifeisproblemsolving\/wp-json\/wp\/v2\/categories?post=117"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kmci.org\/alllifeisproblemsolving\/wp-json\/wp\/v2\/tags?post=117"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}