Great Theoretical Ideas In Computer Science John Lafferty Lecture 11 CS 15 251 Fall 2006 Oct 3 2006 Carnegie Mellon University Probability III The Probabilistic Method Recap Random Variables An event is a subset of S A Random Variable RV is a realvalued function on S x Example Event A the first die came up 1 Random Variable X the value of the first die E g X 3 5 3 X 1 6 1 P x 1 1 1 36 1 2 1 36 1 3 1 4 1 36 1 36 1 5 1 36 1 6 1 36 2 1 1 36 M M 6 5 1 36 6 6 1 36 It s a floor wax and a dessert topping It s a function on the sample space S It s a variable with a probability distribution on its values HMU You should be comfortable with both views Definition expectation The expectation or expected value of a random variable X is E g 2 coin flips X heads What is E X 1 HT 2 HH 0 TT 1 TH Thinking about expectation D S TT TH HT HH X Distrib on X 0 1 2 E X 0 1 1 2 1 E X 0 1 2 1 Linearity of Expectation If Z X Y then E Z E X E Y HMU Even if X and Y are not independent New topic The probabilistic method Use a probabilistic argument to prove a non probabilistic mathematical theorem Definition A cut in a graph A cut is a partition of the nodes of a graph into two sets U and V We say that an edge crosses the cut if it goes from a node is U to a node in V Cut U V Theorem In any graph there exists a cut such that at least half the edges cross the cut Theorem In any graph there exists a cut such that at least half the edges cross the cut How are we going to prove this Will show that if we pick a cut at random random the expected number of edges crossing is edges How does this prove the theorem What might be is surely possible Goal show exists object of value at least v Proof strategy Define distribution D over objects Define RV X object value of object Show E X v Conclude it must be possible to have X v Pigeonhole principle Given n boxes and m n objects at least one box must contain more than one object Letterbox principle If the average number of letters per box is a then some box will have at least a letters Similarly some box has at most a Theorem In any graph there exists a cut such that at least half the edges cross the cut Theorem In any graph there exists a cut such that at least half the edges cross the cut Proof Pick a cut uniformly at random I e for each node flip a fair coin to determine if it is in U or V Let Xe be the indicator RV for the event that edge e crosses the cut What is E Xe Ans Theorem In any graph there exists a cut such that at least half the edges cross the cut Proof Pick random cut Let Xe 1 if e crosses else Xe 0 Let X total edges crossing So X e Xe Also E Xe By linearity of expectation E X total edges Pick a cut uniformly at random I e for each node flip a fair coin to see if it should be in U E of edges crossing cut of edges 2 The sample space of all possible cuts must contain at least one cut that at least half the edges cross if not the average number of edges would be less than half Another example of prob method If you color nodes at random Pr every v has a neighbor of a different color 0 So must exist coloring where every v has a neighbor of a different color This then implies existence of evenlength cycle Can you use this argument to also find such a cut In this case you can through a neat strategy called the conditional expectation method HMU Idea make decisions in greedy manner to maximize expectation to go First a few more facts For any partition of the sample space S into disjoint events A1 A2 An and any event B Pr B i Pr B Ai i Pr B Ai Pr Ai B A1 A2 A3 An Def Conditional Expectation For a random variable X and event A the conditional expectation of X given A is defined as E g roll two dice X sum of dice E X 7 Let A be the event that the first die is 5 E X A 8 5 Conditional Expectation Def Conditional Expectation For a random variable X and event A the conditional expectation of X given A is defined as Useful formula for any partition of S into A1 A2 we have E X i E X Ai Pr Ai Proof just plug in Pr X k i Pr X k Ai Pr Ai Recap of cut argument Pick random cut Let Xe 1 if e crosses else Xe 0 Let X total edges crossing So X e Xe Also E Xe By linearity of expectation E X total edges Conditional expectation method Say we have already decided fate of nodes 1 2 i 1 Let X number of edges crossing cut if we place rest of nodes into U or V at random Let A event that node i is put into U So E X E X A E X A It can t be the case that both terms on the RHS are smaller than the LHS So just put node i into side whose C E is larger Pictorial view important View S as leaves of choice tree ith choice is where to put node i Label leaf by value of X E X avg leaf value G U U 1 3 2 V V U V U V U V U V U V 0 1 2 1 1 2 1 0 Pictorial view important If A is some node the event that we reach that node then E X A avg value of leaves below A Alg greedily follow path to maximize avg G U U 1 3 2 V V U V U V U V U V U V 0 1 2 1 1 2 1 0 Pictorial view important Linearity of expectation gives us a way of magically computing E X A for any node A Even though the tree has 2n leaves G U U 1 3 2 V V U V U V U V U V U V 0 1 2 1 1 2 1 0 Pictorial view important In particular E X A edges crossing so far edges not yet determined G U U 1 3 2 V V U V U V U V U V U V 0 1 2 1 1 …
View Full Document
Unlocking...