{"id":201,"date":"2017-08-30T16:28:10","date_gmt":"2017-08-30T20:28:10","guid":{"rendered":"https:\/\/www.fecundity.com\/nfw\/?p=201"},"modified":"2022-05-02T12:09:04","modified_gmt":"2022-05-02T16:09:04","slug":"the-slipperiness-of-significant-publication","status":"publish","type":"post","link":"https:\/\/www.fecundity.com\/nfw\/2017\/08\/30\/the-slipperiness-of-significant-publication\/","title":{"rendered":"The slipperiness of significant publication"},"content":{"rendered":"<p>I&#8217;ve written before about trying to establish the significance of a philosophy publication, which mostly becomes an issue at tenure and promotion time. In <a href=\"http:\/\/laser.fontmonkey.com\/foe\/comments.php?y=15&amp;m=04&amp;entry=entry150408-113435\">an earlier post<\/a>, I argued that citation counts are mostly rubbish for philosophy. Still, there are pressures to provide numerical measures.<\/p>\n<p>In support of <a href=\"https:\/\/jasondcruz.com\/\">a recent tenure case<\/a>, our department gave the acceptance rates at journals as evidence of their significance.<span id='easy-footnote-1-201' class='easy-footnote-margin-adjust'><\/span><span class='easy-footnote'><a href='https:\/\/www.fecundity.com\/nfw\/2017\/08\/30\/the-slipperiness-of-significant-publication\/#easy-footnote-bottom-1-201' title='We also had both internal and outside letters discussing the prestige of the journals he had published in.'><sup>1<\/sup><\/a><\/span> The danger in using such a measure is that, if widely adopted, it would quickly become uninformative.<span id='easy-footnote-2-201' class='easy-footnote-margin-adjust'><\/span><span class='easy-footnote'><a href='https:\/\/www.fecundity.com\/nfw\/2017\/08\/30\/the-slipperiness-of-significant-publication\/#easy-footnote-bottom-2-201' title='There&amp;#8217;s already a limit to how informative it is, because some journals are more likely to get a steady stream of poor submissions than others. For example, &lt;em&gt;The Journal of Symbolic Logic&lt;\/em&gt; is a prestigious specialist journal which might not get unsuitable papers. A less technical journal might receive more crackpot weltanschauung submissions, driving up its total number of submissions and driving down its acceptance rate.'><sup>2<\/sup><\/a><\/span> If scholars get more credit for publishing in journals with low acceptance rates, they will preferentially start to submit to those. The journals will get more submissions but still accept the same number. This will, in turn, drive down the acceptance rates of those journals.<\/p>\n<p>I recently learned that there is a name for this general phenomenon, <a href=\"https:\/\/en.wikipedia.org\/w\/index.php?title=Goodhart%27s_law&amp;oldid=795793086\">Goodhart&#8217;s Law<\/a>: &#8220;When a measure becomes a target, it ceases to be a good measure.&#8221;<\/p>\n<p>This shifts it from being this hunch I have to being a well-established phenomenon. I can now invoke it with greater conversational gravitas.<!--more--><\/p>\n","protected":false},"excerpt":{"rendered":"<p>I&#8217;ve written before about trying to establish the significance of a philosophy publication, which mostly becomes an issue at tenure and promotion time. In an earlier post, I argued that citation counts are mostly rubbish for philosophy. Still, there are pressures to provide numerical measures. In support of a recent tenure case, our department gave &hellip; <a href=\"https:\/\/www.fecundity.com\/nfw\/2017\/08\/30\/the-slipperiness-of-significant-publication\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;The slipperiness of significant publication&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[9],"tags":[11],"class_list":["post-201","post","type-post","status-publish","format-standard","hentry","category-philosophy","tag-the-profession"],"jetpack_publicize_connections":[],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p7PjAo-3f","jetpack_likes_enabled":false,"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/www.fecundity.com\/nfw\/wp-json\/wp\/v2\/posts\/201","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.fecundity.com\/nfw\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.fecundity.com\/nfw\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.fecundity.com\/nfw\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.fecundity.com\/nfw\/wp-json\/wp\/v2\/comments?post=201"}],"version-history":[{"count":4,"href":"https:\/\/www.fecundity.com\/nfw\/wp-json\/wp\/v2\/posts\/201\/revisions"}],"predecessor-version":[{"id":279,"href":"https:\/\/www.fecundity.com\/nfw\/wp-json\/wp\/v2\/posts\/201\/revisions\/279"}],"wp:attachment":[{"href":"https:\/\/www.fecundity.com\/nfw\/wp-json\/wp\/v2\/media?parent=201"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.fecundity.com\/nfw\/wp-json\/wp\/v2\/categories?post=201"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.fecundity.com\/nfw\/wp-json\/wp\/v2\/tags?post=201"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}