{"id":10,"date":"2005-01-31T08:07:11","date_gmt":"2005-01-31T14:07:11","guid":{"rendered":"\/?p=10"},"modified":"2005-02-04T09:45:39","modified_gmt":"2005-02-04T15:45:39","slug":"watchword-assumption","status":"publish","type":"post","link":"https:\/\/hunch.net\/?p=10","title":{"rendered":"Watchword: Assumption"},"content":{"rendered":"

“Assumption” is another word to be careful with in machine learning because it is used in several ways.<\/p>\n

    \n
  1. Assumption = Bias<\/strong> There are several ways to see that some form of ‘bias’ (= preferring of one solution over another) is necessary. This is obvious in an adversarial setting. A good bit of work has been expended explaining this in other settings with “no free lunch<\/a>” theorems. This is a usage specialized to learning which is particularly common when talking about priors for Bayesian Learning.<\/li>\n
  2. Assumption = “if” of a theorem<\/strong> The assumptions are the ‘if’ part of the ‘if-then’ in a theorem. This is a fairly common usage.<\/li>\n
  3. Assumption = Axiom<\/strong> The assumptions are the things that we assume are true, but which we cannot verify. Examples are “the IID assumption” or “my problem is a DNF on a small number of bits”. This is the usage which I prefer.<\/li>\n<\/ol>\n

    One difficulty with any use of the word “assumption” is that you often encounter “if assumption<\/em> then conclusion<\/em> so if not assumption<\/em> then not conclusion<\/em>“. This is incorrect logic. For example, with variant (1), “the assumption of my prior is not met so the algorithm will not learn”. Or, with variant (3), “the data is not IID, so my learning algorithm designed for IID data will not work”. In each of these cases “will” must be replaced with “may” for correctness.<\/p>\n","protected":false},"excerpt":{"rendered":"

    “Assumption” is another word to be careful with in machine learning because it is used in several ways. Assumption = Bias There are several ways to see that some form of ‘bias’ (= preferring of one solution over another) is necessary. This is obvious in an adversarial setting. A good bit of work has been … <\/p>\n

    Continue reading “Watchword: Assumption”<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[15],"tags":[],"class_list":["post-10","post","type-post","status-publish","format-standard","hentry","category-definitions"],"_links":{"self":[{"href":"https:\/\/hunch.net\/index.php?rest_route=\/wp\/v2\/posts\/10","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/hunch.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hunch.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hunch.net\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/hunch.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=10"}],"version-history":[{"count":0,"href":"https:\/\/hunch.net\/index.php?rest_route=\/wp\/v2\/posts\/10\/revisions"}],"wp:attachment":[{"href":"https:\/\/hunch.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=10"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hunch.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=10"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hunch.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=10"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}