{"id":207,"date":"2009-06-14T20:31:04","date_gmt":"2009-06-15T00:31:04","guid":{"rendered":"http:\/\/kmci.org\/alllifeisproblemsolving\/archives\/benchmarking-or-measurement-validity\/"},"modified":"2009-06-14T21:00:25","modified_gmt":"2009-06-15T01:00:25","slug":"benchmarking-or-measurement-validity","status":"publish","type":"post","link":"https:\/\/kmci.org\/alllifeisproblemsolving\/archives\/benchmarking-or-measurement-validity\/","title":{"rendered":"Benchmarking or Measurement Validity?"},"content":{"rendered":"<p align=\"center\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/www.dkms.com\/kmci\/alllifeisproblemsolving\/wp-content\/themes\/cutline-3-column-split-11\/images\/colethegiantschalice1833.jpeg\" alt=\"colechalice\" height=\"250\" width=\"379\" \/><\/p>\n<p style=\"line-height: 150%\" align=\"left\"><font face=\"Arial, sans-serif\"><font size=\"3\">In a recent exchange in the Fed KM Google group, one of my correspondents thought that it would be very helpful to a National KM Center to have access to benchmarking-derived \u201clessons learned,\u201d \u201cbest practices,\u201d and \u201cknowledge architecture\u201d from <a href=\"http:\/\/www.apqc.org\/portal\/apqc\/site\" title=\"APQC\">APQC<\/a>. In reply, I indicated my agreement provided that these ideas were construed appropriately, but then I also expressed doubt about whether APQC excelled in measurement theory and methodology, or whether they had a very good knowledge processing framework on which to base their indicators. And I also expressed doubts about the adequacy of their measures of impact.<\/font><\/font><!--more--><\/p>\n<p style=\"line-height: 150%\" align=\"left\"><font face=\"Arial, sans-serif\"><font size=\"3\">My correspondent replied by saying that APQC&#8217;s practices and methodologies \u201care adequate for the job APQC performs as a benchmarking and consulting service provider,\u201d and then suggested that they ought to be evaluated \u201c. . . against the standard appropriate to their business . . .\u201d This reply seems fair and reasonable, but only if one adopts a relative standard of excellence based on APQC&#8217;s acceptance in the market place, rather than a standard based on KM&#8217;s needs and requirements. Since APQC is in the end driven by its benchmarking of existing Best Practices, its methodological approaches appear to be limited to what already exists in KM, is being practiced somewhere, and has also been made available to APQC benchmarking activities.<\/font><\/font><\/p>\n<p style=\"line-height: 150%\" align=\"left\"><font face=\"Arial, sans-serif\"><font size=\"3\">This is, if you will, an internal, industry and market-based approach to methodology; an approach that confounds what is, with what ought to be. But the issue I raised earlier, is the issue of the adequacy or validity of APQC&#8217;s approach as a guide to measuring impact, and not the issue of whether its practices are adequate for its consulting goals, or for industry or market place success. Best practices and lessons learned from benchmarking are not necessarily the best practices and lessons learned we need to do a good job of measuring KM impact. My conjecture about the inadequacy of APQC measurements, methodologies, and conceptual frameworks might well be correct, regardless of the quality of their benchmarking, <a href=\"http:\/\/kmci.org\/alllifeisproblemsolving\/archives\/why-dont-we-write-much-about-km-metrics\/\" title=\"KM Metrics\">if impact measurement best practices within the KM industry are themselves inadequate.<\/a> Based on my own very long experience in the social sciences, and exposure to many different kinds of measurement methodologies, and research on measurement practices in use within KM, I believe that these practices are inadequate. As long as APQC&#8217;s methodologies reflect only the best of these, they too will not meet the need of Federal KM to measure the impact of KM interventions in such a way that KM programs can be accountable. More is necessary than simply the best that can now be found in industry.<\/font><\/font><\/p>\n<p style=\"line-height: 150%\" align=\"left\"><font face=\"Arial, sans-serif\"><font size=\"3\">There&#8217;s an old saying that I ran into years ago at, of all places, the US Census Bureau, which says: &#8220;It&#8217;s good enough for Government work.&#8221; This is a saying that the Government needs badly to eliminate from American business folklore. The only way to do that is to make Government work so high in quality that it often leads work done in the private sector. To have that happen in KM, we have to do a better job of measuring KM impact than we currently find in private sector best practices, and that will require better measurement methodology than is currently being practiced there.<\/font><\/font><\/p>\n","protected":false},"excerpt":{"rendered":"<p>In a recent exchange in the Fed KM Google group, one of my correspondents thought that it would be very helpful to a National KM Center to have access to benchmarking-derived \u201clessons learned,\u201d \u201cbest practices,\u201d and \u201cknowledge architecture\u201d from APQC. In reply, I indicated my agreement provided that these ideas were construed appropriately, but then [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[9,12,8],"tags":[1719,1706,1707,1709,364,1704,3531,361,1705,1703,1708],"class_list":["post-207","post","type-post","status-publish","format-standard","hentry","category-km-methodology","category-km-techniques","category-knowledge-management","tag-1719","tag-apqc","tag-benchmarking","tag-federal-km","tag-impact-measurement","tag-indicators","tag-knowledge-management","tag-measurement","tag-measures","tag-methodology","tag-validity"],"_links":{"self":[{"href":"https:\/\/kmci.org\/alllifeisproblemsolving\/wp-json\/wp\/v2\/posts\/207","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/kmci.org\/alllifeisproblemsolving\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kmci.org\/alllifeisproblemsolving\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kmci.org\/alllifeisproblemsolving\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/kmci.org\/alllifeisproblemsolving\/wp-json\/wp\/v2\/comments?post=207"}],"version-history":[{"count":0,"href":"https:\/\/kmci.org\/alllifeisproblemsolving\/wp-json\/wp\/v2\/posts\/207\/revisions"}],"wp:attachment":[{"href":"https:\/\/kmci.org\/alllifeisproblemsolving\/wp-json\/wp\/v2\/media?parent=207"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kmci.org\/alllifeisproblemsolving\/wp-json\/wp\/v2\/categories?post=207"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kmci.org\/alllifeisproblemsolving\/wp-json\/wp\/v2\/tags?post=207"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}