{"id":6,"date":"2000-01-01T00:10:56","date_gmt":"2000-01-01T07:10:56","guid":{"rendered":"http:\/\/www.mii.ucla.edu\/causality\/?p=15"},"modified":"2000-01-01T00:10:56","modified_gmt":"2000-01-01T07:10:56","slug":"d-separation-without-tears","status":"publish","type":"post","link":"https:\/\/causality.cs.ucla.edu\/blog\/index.php\/2000\/01\/01\/d-separation-without-tears\/","title":{"rendered":"d-Separation Without Tears"},"content":{"rendered":"<h3>Introduction<\/h3>\n<p> <em>d-<\/em>separation is a criterion for deciding, from a given a causal graph, whether a set <em>X<\/em> of variables is independent of another set <em>Y,<\/em> given a third set <em>Z.<\/em> The idea is to associate &quot;dependence&quot; with &quot;connectedness&quot; (i.e., the existence of a connecting path) and &quot;independence&quot; with &quot;unconnected-ness&quot; or &quot;separation&quot;. The only twist on this simple idea is to define what we mean by &quot;connecting path&quot;, given that we are dealing with a system of directed arrows in which some  vertices (those residing in <em>Z<\/em>) correspond to measured variables, whose values are known precisely. To account for the orientations of the arrows we use the terms &quot;<em>d-<\/em>separated&quot; and &quot;<em>d-<\/em>connected&quot; (<em>d<\/em> connotes &quot;directional&quot;). <\/p>\n<p>We start by considering separation between two singleton variables, <em>x<\/em> and <em>y;<\/em> the extension to sets of variables is straightforward (i.e., two sets are separated if and only if each element in one set is separated from every element in the other).<\/p>\n<h3>1. Unconditional separation<\/h3>\n<p><strong>Rule 1:<\/strong> <em>x<\/em> and <em>y<\/em> are <em>d-<\/em>connected if there is an unblocked path \tbetween them.<\/p>\n<p>By a &quot;path&quot; we mean any consecutive sequence of edges, disregarding their directionalities. By &quot;unblocked path&quot; we mean a path that can be traced without traversing a pair of arrows that collide &quot;head-to-head&quot;. In other words, arrows that meet head-to-head do not constitute  a connection for the purpose of passing information, such a meeting will be called a &quot;collider&quot;.<\/p>\n<p><strong>Example 1<\/strong><br \/> <img decoding=\"async\" src=\"http:\/\/bayes.cs.ucla.edu\/BOOK-2K\/web-eq1.gif\" height=\"37\" align=\"middle\" \/><br \/> This graph contains one collider, at <em>t.<\/em> The path <em>x-r-s-t<\/em> is unblocked, hence <em>x<\/em> and <em>t<\/em> are <em>d<\/em>-connected. So is also the path <em>t-u-v-y,<\/em> hence <em>t<\/em> and <em>y<\/em> are <em>d-<\/em>connected, as well as the pairs <em>u<\/em> and <em>y, t<\/em> and <em>v, t<\/em> and <em>u, x<\/em> and <em>s<\/em> etc&#8230;. However, <em>x<\/em> and <em>y<\/em> are not <em>d-<\/em>connected; there is no way of tracing a path from <em>x<\/em> to <em>y<\/em> without traversing the collider at <em>t.<\/em> Therefore, we conclude that <em>x<\/em> and <em>y<\/em> are <em>d-<\/em>separated, as well as <em>x<\/em> and <em>v, s<\/em> and <em>u, r<\/em> and <em>u,<\/em> etc. (The ramification is that the covariance terms corresponding to these pairs of variables will be zero, for every choice of model parameters).<\/p>\n<h3>1.2 blocking by conditioning<\/h3>\n<p> <strong>Motivation:<\/strong> When we measure a set <em>Z<\/em> of variables, and take their values as given, the conditional distribution of the remaining variables changes character; some dependent variables become independent, and some independent variables become dependent. To represent this dynamics in the graph, we need the notion of &quot;conditional <em>d-<\/em>connectedness&quot; or, more concretely, &quot;<em>d-<\/em>connectedness, conditioned on a set <em>Z<\/em> of measurements&quot;. <\/p>\n<p><strong>Rule 2:<\/strong>   <em>x<\/em> and <em>y<\/em> are <em>d-<\/em>connected, conditioned on a set <em>Z<\/em> of nodes, \t if there is a collider-tree path between <em>x<\/em> and <em>y<\/em> \t that traverses no member of <em>Z.<\/em> \t If no such path exists, we say that <em>x<\/em> and <em>y<\/em> are \t <em>d-<\/em>separated by <em>Z,<\/em>  \t We also say then that every path between <em>x<\/em> and <em>y<\/em> is \t &quot;blocked&quot; by <em>Z.<\/em><\/p>\n<p><strong>Example 2<\/strong><br \/> <img decoding=\"async\" src=\"http:\/\/singapore.cs.ucla.edu\/BOOK-2K\/web-eq2.gif\" height=\"48\" align=\"middle\" \/> <\/p>\n<p>Let <em>Z<\/em> be the set {<em>r, v<\/em>} (marked by circles in the figure).   Rule 2 tells us that <em>x<\/em> and <em>y<\/em> are <em>d-<\/em>separated by <em>Z,<\/em>  and so are also <em>x<\/em> and <em>s, u<\/em> and <em>y, s<\/em> and <em>u<\/em> etc. The path <em>x-r-s<\/em> is blocked by <em>Z,<\/em> and so are also the paths <em>u-v-y<\/em> and <em>s-t-u.<\/em> The only pairs of unmeasured nodes that remain <em>d-<\/em>connected in  this example, conditioned on <em>Z,<\/em> are <em>s<\/em> and <em>t<\/em> and  <em>u<\/em> and <em>t.<\/em> Note that, although <em>t<\/em> is not in <em>Z,<\/em> the path <em>s-t-u<\/em> is nevertheless blocked by <em>Z,<\/em> since <em>t<\/em> is a collider, and is blocked by Rule 1.<\/p>\n<h3>1.3. Conditioning on colliders<\/h3>\n<p> <strong>Motivation:<\/strong> When we measure a common effect of two independent causes, the causes becomes dependent, because finding the truth of one makes the other less likely (or &quot;explained away&quot;), and refuting one implies the truth of the other. This phenomenon (known as Berkson paradox, or &quot;explaining away&quot;) requires a slightly special treatment when we condition on colliders (representing common effects) or their descendants (representing effects of common effects). <\/p>\n<p><strong>Rule 3:<\/strong> If a collider is a member of the conditioning set <em>Z,<\/em> \t or has a descendant in <em>Z,<\/em> then it no longer blocks \t any path that traces this collider.<\/p>\n<p><strong>Example 3<\/strong><br \/> <img decoding=\"async\" src=\"http:\/\/bayes.cs.ucla.edu\/BOOK-2K\/web-eq3.gif\" height=\"107\" align=\"middle\" \/><\/p>\n<p>Let <em>Z<\/em> be the set {<em>r, p<\/em>} (again, marked with circles). Rule 3 tells us that <em>s<\/em> and <em>y<\/em> are <em>d<\/em>-connected by <em>Z,<\/em> because the collider at <em>t<\/em> has a descendant (<em>p<\/em>) in <em>Z,<\/em> which unblocks the path <em>s-t-u-v-y.<\/em> However, <em>x<\/em> and <em>u<\/em> are still <em>d<\/em>-separated by <em>Z,<\/em> because although the linkage at <em>t<\/em> is unblocked, the one at <em>r<\/em> is blocked by Rule 2 (since <em>r<\/em> is in <em>Z<\/em>).<\/p>\n<p>This completes the definition of <em>d-<\/em>separation, and the reader is invited to try it on some more intricate graphs, such as those shown in Figure 1.3<\/p>\n<p><strong>Typical application:<\/strong><br \/> Suppose we consider the regression of <em>y<\/em> on <em>p, r<\/em> and <em>x,<\/em><\/p>\n<p> <em> y = c<sub>1 <\/sub> p + c<sub>2<\/sub> r + c<sub>3<\/sub>x <\/em> and suppose we wish to predict which coefficient in this regression is zero. From the discussion above we can conclude immediately that <em>c<sub>3<\/sub><\/em> is zero, because <em>y<\/em> and <em>x<\/em> are  <em>d-<\/em>separated given <em>p<\/em> and <em>r,<\/em> hence the partial correlation between <em>y<\/em>  and <em>x,<\/em> conditioned on <em>p<\/em> and <em>r,<\/em> must vanish. <em>c<sub>1<\/sub><\/em> and <em>c<sub>2<\/sub>,<\/em> on the other hand, will in general not be zero, as can be seen from the graph: <em>Z<\/em>={<em>r, x<\/em>} does not <em>d<\/em>-separate <em>y<\/em> from <em>p,<\/em> and <em>Z<\/em>={<em>p, x<\/em>} does not <em>d<\/em>-separate <em>y<\/em> from <em>r.<\/em> <\/p>\n<p><strong>Remark on correlated errors:<\/strong><br \/> Correlated exogenous variables (or error terms) need no special treatment. These are represented by bi-directed arcs (double-arrowed) and their arrowheads are treated as any other arrowhead for the purpose of path tracing. For example, if we add to the graph above a bi-directed arc  between <em>x<\/em> and <em>t,<\/em> then <em>y<\/em> and <em>x<\/em> will no longer  be <em>d-<\/em>separated (by <em>Z<\/em>={<em>r, p<\/em>}), because the path  <em>x-t-u-v-y<\/em> is <em>d-<\/em>connected &#8212; the collider at <em>t<\/em> is  unblocked by virtue of having a descendant, <em>p,<\/em> in <em>Z.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Introduction d-separation is a criterion for deciding, from a given a causal graph, whether a set X of variables is independent of another set Y, given a third set Z. The idea is to associate &quot;dependence&quot; with &quot;connectedness&quot; (i.e., the existence of a connecting path) and &quot;independence&quot; with &quot;unconnected-ness&quot; or &quot;separation&quot;. The only twist on [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8],"tags":[],"class_list":["post-6","post","type-post","status-publish","format-standard","hentry","category-d-separation"],"_links":{"self":[{"href":"https:\/\/causality.cs.ucla.edu\/blog\/index.php\/wp-json\/wp\/v2\/posts\/6","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/causality.cs.ucla.edu\/blog\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/causality.cs.ucla.edu\/blog\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/causality.cs.ucla.edu\/blog\/index.php\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/causality.cs.ucla.edu\/blog\/index.php\/wp-json\/wp\/v2\/comments?post=6"}],"version-history":[{"count":0,"href":"https:\/\/causality.cs.ucla.edu\/blog\/index.php\/wp-json\/wp\/v2\/posts\/6\/revisions"}],"wp:attachment":[{"href":"https:\/\/causality.cs.ucla.edu\/blog\/index.php\/wp-json\/wp\/v2\/media?parent=6"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/causality.cs.ucla.edu\/blog\/index.php\/wp-json\/wp\/v2\/categories?post=6"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/causality.cs.ucla.edu\/blog\/index.php\/wp-json\/wp\/v2\/tags?post=6"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}