Yesterday, Slate ran the antithesis under the headline For All We Know, Gaiter Masks Are Fine<\/a>.<\/p>\n\n\n\n\n\n\n\n The story makes the sensible point that the research doesn’t give detailed descriptions of the masks that were tested. The results that people interpret as being about gaiters were given under the label “neck fleece.”<\/span>2<\/sup><\/a><\/span> It is unclear whether the researchers were using whatever it is that readers have in mind when they think of gaiters.<\/span>3<\/sup><\/a><\/span><\/p>\n\n\n\n Although the researchers tested some of the masks with a few subjects, the neck fleece was only tested with one person. N was small.<\/p>\n\n\n\n Moreover, the study wasn’t aimed to yield verdicts about kinds of face masks. It was primarily about a new, low-cost method for making these kinds of evaluations. Susan Matthews, writing in Slate, puts the point this way:<\/p>\n\n\n\n The purpose of the research was to establish that the testing method worked in principle\u2014not to come up with meaningful or accurate verdicts about particular masks. … It was by no means an exhaustive study that lets us make conclusions about gaiters\u2014it\u2019s a study that incidentally happened to use a gaiter in the course of putting forth a methodology that other people might be able to use to in doing real experiments that would make conclusions about gaiters.<\/p><\/blockquote>\n\n\n\n This shifts matters a bit too far, though. Although the study can’t be taken to provide final verdicts on types of masks, it must provide at least somewhat meaningful and somewhat accurate data about how the masks performed under the circumstances observed. More decisive evidence will test masks on multiple people under an array of conditions, but this study can’t establish the method in principle without also providing information about the actual subjects observed. The method is shown to be legitimate only insofar as the numbers it gets are plausible. <\/p>\n\n\n\n This is an instance of what Harry Collins called the experimenter’s regress<\/em>. In developing a new instrument or method, experimenters rely on an array of theory and tacit knowledge. Without this background knowledge, it would be impossible to validate or calibrate the new method as a legitimate way of discovering things. Yet the results of a new method also serve as some evidence.<\/p>\n\n\n\n The way to keep the experimenter’s regress from becoming vicious is to do further experiments and develop further methods. That itself is a complicated business that relies on further theory and tacit knowledge, so there is no way out of it entirely. Regardless, it’s a slow synthesis that won’t show up in your social media feed.<\/p>\n\n\n\n The dialectic of science journalism, especially as refracted through social media, is to begin with the overenthusiastic claim “Study proves P.” Within a couple of days, the antithesis: “Study shows nothing of the kind, and anyway not-P.” Then there’s a storm, a cute puppy, or racism, and the matter is never resolved in a progressive … Continue reading “Science journalism and the experimenter’s regress”<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[33,9],"tags":[62],"class_list":["post-1185","post","type-post","status-publish","format-standard","hentry","category-link-dump","category-philosophy","tag-ssk"],"jetpack_publicize_connections":[],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p7PjAo-j7","jetpack_likes_enabled":false,"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/www.fecundity.com\/nfw\/wp-json\/wp\/v2\/posts\/1185","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.fecundity.com\/nfw\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.fecundity.com\/nfw\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.fecundity.com\/nfw\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.fecundity.com\/nfw\/wp-json\/wp\/v2\/comments?post=1185"}],"version-history":[{"count":2,"href":"https:\/\/www.fecundity.com\/nfw\/wp-json\/wp\/v2\/posts\/1185\/revisions"}],"predecessor-version":[{"id":1188,"href":"https:\/\/www.fecundity.com\/nfw\/wp-json\/wp\/v2\/posts\/1185\/revisions\/1188"}],"wp:attachment":[{"href":"https:\/\/www.fecundity.com\/nfw\/wp-json\/wp\/v2\/media?parent=1185"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.fecundity.com\/nfw\/wp-json\/wp\/v2\/categories?post=1185"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.fecundity.com\/nfw\/wp-json\/wp\/v2\/tags?post=1185"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}![\"the](\"https:\/\/i0.wp.com\/www.fecundity.com\/nfw\/wp-content\/uploads\/2020\/08\/20200812batmanmask.jpg?resize=450%2C450&ssl=1\")
<\/figure><\/div>\n","protected":false},"excerpt":{"rendered":"