CS1800: Intro to Probability. Professor Kevin Gold
|
|
- Lucinda Henderson
- 5 years ago
- Views:
Transcription
1 CS1800: Intro to Probability Professor Kevin Gold
2 Probability Deals Rationally With an Uncertain World Using probabilities is the only rational way to deal with uncertainty De Finetti: If you disagree, there is always some unwise bet you should be willing to make, which will lose money in the long term Though programs can be deterministic, the world they interact with is full of uncertainty. This means probability is important in the fields that deal with real data and real sensors - AI and machine learning. Random users will buy random things from your website Data mining The self-driving car may be unsure of the depth or identity of an object Robotics The interpretation of a sentence or speech recording may be ambiguous, but some interpretations are more likely Natural Language Processing A diagnosis may rely on several symptoms, each of which only tends to coincide with some underlying diseases Probabilistic Expert Systems
3 Probability Also Plays a Role in the Design of Everyday Algorithms We may want to Analyze the expected running time Asymptotic Analysis Behave randomly to avoid bias Randomized Algorithms Create algorithms that are difficult for an adversary to predict and exploit Cryptography/Security Design programs that have novel behaviors or generate random content Procedural Content Generation
4 Events, Experiments, and Probabilities An event is something that might happen - for example, flipping a coin and finding the result is heads, or rolling an even number on a six-sided die. An experiment or observation refers to a situation with one or more possible outcomes. Flipping a coin is an experiment with two possible outcomes: heads or tails. Rolling a six-sided die has six outcomes. An event may describe multiple outcomes: roll an even number A probability is real number in the range [0,1] that describes how much we should believe that an experiment will result in an event happening - because the outcome fits the event description. 0 means the event does not happen. 1 means it definitely does. 0.5 means we think both possibilities are equally likely.
5 Probability Notation Short for probability ; sometimes just P() Pr(heads) = 0.5 the probability brief description of event
6 Probability Notation A random variable representing a value determined by the experiment Pr(C = H ) = 0.5 the specific value that matches the event we re interested in the probability We ll discuss random variables more when we discuss expectations
7 Counting to Calculate Probabilities The sample space, which we ll call S, is the set of all possible outcomes of an experiment. If we think all outcomes are equally likely, we can count outcomes to determine the probability of an event. The probability is Pr(event) = E / S where E is the set of outcomes in which the event is true, and S is the total set of all outcomes. Roll of a 6-sided die S E Pr(roll 5 or 6) = 2/6 = 1/3
8 Counting to Determine Probabilities - Examples Flipping a single coin S = {H, T} Pr(heads) = 1/2 (E = {H}) Rolling a 6-sided die S = {1,2,3,4,5,6} Pr(roll a 1) = 1/6 (E = {1}) Pr(roll an even number) = 3/6 = 1/2 (E = {2, 4, 6})
9 Counting to Determine Probabilities - Examples Rolling two six-sided dice S = {(1,1), (1,2), (1,3),, (2,1), (2,2), (6,5),(6,6)} ( S = 6*6 = 36 possible combinations) Chance of doubles (matching values) E = {(1,1), (2,2), (3,3), (4,4), (5,5), (6,6)} Pr(doubles) = 6/36 = 1/6 Chance of rolling a total of 6 E = {(1,5), (2,4),(3,3),(4,2),(5,1)} Pr(roll a 6) = 5/36
10 More Sophisticated Counting to Calculate Probabilities Flipping 4 coins S = { TTTT, TTTH, TTHT, TTHH,, HHHH } (2 4 = 16 possibilities) Pr (exactly two heads) E = # of strings with exactly 2 H characters = C(4,2) = 4*3/2 = 6 Pr (exactly two heads) = 6/16 = 3/8 Pr(at least one head) E = strings with at least one H = 16 - strings with no H s = 16 - { TTTT } = 15 Pr(at least one head) = 15/16 We can encode outcomes as strings, then count strings
11 Pascal s Triangle and Coin-Flipping If I want to know the probabilities of exactly 0, 1, 2, 3, 4, or 5 heads when flipping 5 coins, I need to know how many strings like TTTTT have 0, 1, 2, 3, 4, or 5 H s These numbers are C(5,0), C(5,1), C(5,2), C(5,3), C(5,4), and C(5,5) Which can be looked up as a row of Pascal s triangle: 1, 5, 10, 10, 5, 1 The relevant probabilities are then 1/2 5, 5/2 5, 10/2 5, 10/2 5, 5/2 5, and 1/2 5, or about 0.03, 0.16, 0.31, 0.31, 0.16, 0.03.
12 Counting Produces Your Weather Forecast Ever wonder where those percentages come from in the weather forecast ( 60% chance of rain )? These are typically produced by running many simulations of the current weather, propagating the present into the future And using random values to perturb the simulation The final forecast percentages are produced by counting the outcomes in which the event in question took place
13 Fallacies to Avoid: Assuming Equal Likelihood of Outcomes We could start to go around thinking everything has a 50% chance of happening because there are two outcomes - either it does happen, or it doesn t. 50% chance of being struck by lightning before the end of the day! 50% chance of winning the lottery today! Counting only produces reasonable probabilities when the counted outcomes are equally likely. That s why many examples use coins, cards, or other scenarios where this is obviously true. In many real-world cases, there is something we could count to get a reasonable probability. For the lottery, we could count equally random ticket numbers For lightning strikes, we could model the problem as picking a day and person at random from our records, and ask whether that person was struck on that day
14 Card-Drawing Problems Recall that a deck of playing cards has 52 possibilities, encoded as [rank] of [suit], such as Jack of Hearts or Two of Spades 13 ranks: 2, 3, 4,, 10, Jack (J), Queen (Q), King (K), Ace (A) 4 suits: Clubs (C), Diamonds (D), Spades (S), Hearts (H) Decisions in games such as Poker hinge on the probability of drawing particular subsets of these cards, such as a flush with 5 cards of the same suit. The order in the hand doesn t matter and the cards are unique, so a subset is a good model. A hand such as {2C, 2D, 10H, 10D, KC} is a subset of cards - the deal chose this many cards from the deck. The sample space consists of C(52,5) possibilities for a 5 card hand (it s not a permutation because the order that the cards were dealt doesn t matter).
15 Sample Card-Drawing Problem: Pocket Aces Pr (chance of 2 aces when dealt 2 cards) S = set of all 2 card hands = {{2H,2D}, {2H,2C},,{AC,AS}} S = C(52,2) E = set of all 2 ace hands = {{AC, AD}, {AC,AS},{AC,AH},{AD,AS},{AD,AH}, {AS,AH}} E = C(4,2) = 6 (choosing 2 of 4 aces in deck) Pr(2 aces) = 6/C(52,2) = 6/(52*51/2) = [which we could describe as 0.45% or 1 in 221]
16 Second Card Drawing Problem: The Full House A full house is a set of 3 cards of the same rank, along with a set of 2 cards of a different rank (eg, 3 kings, 2 aces). What s the probability of a full house in 5 cards? S = Total 5 card hand possibilities: C(52,5) = The rest is counting E, ways to get a full house Pick the first rank: 13 Pick the second rank: 12 Pick which of the 4 suits is missing from first rank: 4 Pick which two cards of the second rank were chosen: C(4,2) = 6 13*12*4*6 = 3744 Prob of full house = 3744/ = [or 0.14%]
17 Drawing With Replacement vs Without Replacement In probability problems involving cards or drawing colored balls out of urns (weird but classic), the instructions may say the draws are either: Without replacement - When an item is drawn, it can t be drawn again on a subsequent draw. Generally true of card games unless you shuffle your card back in on every draw. For these, you can treat the whole experiment as drawing a subset of the items, and use combinations. With replacement - When an item is drawn, it is put back where you got it (replaced) and can be drawn again. You can thus treat each big experiment as repetitions of the same little experiment (or as independent events, which we ll get to)
18 With/Without Replacement Example 20 balls in an urn: 18 red, 2 green. Draw 3 balls with replacement We can think of our items as {red 1, red 2,, red 18, green 1, green 2 } With replacement - we throw back the ball each time Valid draws look like (red 1, red 1, green 1 ) - all 20 possibilities for each ball, order matters, repetition allowed Sample space size is 20*20*20 = 8000 Chance of 0 green: 18 3 red-red-red possibilities, 18 3 /8000 = Chance of exactly 1 green: 18 2 *2*3 sequences with one green (choosing red IDs, green ID, green loc), 18 2 *2*3/8000= Chance of exactly 2 green: 18*2 2 *3 sequences (red ID, green IDs, loc of red), 18*2 2 *3/8000 = Chance of all 3 green: 2 3 /8000 = 8/8000 = 0.001
19 With/Without Replacement Example 20 balls in an urn: 18 red, 2 green. Draw 3 balls without replacement We can think of our items as {red 1, red 2,, red 18, green 1, green 2 } Without replacement - we keep the ball out of the urn after drawing it Valid draws look like {red 1, red 2, green 1 } - all 3-element subsets of the set are equally likely Sample space size is C(20,3) = 1140 (fewer possibilities and we re ignoring order in both numerator and denominator of the probability now) Chance of 0 green: C(18,3) ways to draw 3 different reds, C(18,3)/1140 = (was with replacement) Chance of exactly 1 green: C(18,2)*2 choices of 2 red, 1 green; C(18,2)*2/1140 = 0.27 (was with replacement) Chance of exactly 2 green: sets differ only in choice of red ball; 18/1140 = (was 0.027) Chance of all 3 green: 0 (only 2 green balls exist!)
20 Fallacies to Avoid: The Sample Space vs Reality Recalling that there are 52 cards in the deck: Let s say I deal you a card, then I deal Alice a card at random (both face down, ie in secret). What is the chance you are holding the Ace of Spades?
21 Fallacies to Avoid: The Sample Space vs Reality Recalling that there are 52 cards in the deck: Let s say I deal you a card, then I deal Alice a card at random (both face down, ie in secret). What is the chance you are holding the Ace of Spades? Consider this change to the question. What if I dealt a single card to you, then burned the rest of the deck? What is the chance that you are holding the Ace of Spades?
22 Fallacies to Avoid: The Sample Space vs Reality Recalling that there are 52 cards in the deck: Let s say I deal you a card, then I deal Alice a card at random (both face down, ie in secret). What is the chance you are holding the Ace of Spades? Consider this change to the question. What if I dealt a single card to you, then burned the rest of the deck? What is the chance that you are holding the Ace of Spades? What if, instead of either of those things, I dealt a card to you and handed the rest of the deck to Alice? What is the chance you are holding the Ace of Spades?
23 Fallacies to Avoid: The Sample Space vs Reality The sample space consists of the possibilities that are still open to you, from your point of view. We could burn random cards from the deck, and unless you know what those cards were, it doesn t change your view that there are 52 equally likely possibilities when you draw from the top of the deck. Because you don t know what those cards were. But if we learn information that rules out possibilities for what happened, that changes probabilities. If Alice said hey, the 3 of clubs! that s one fewer card in the sample space, and the probability of the Ace of Spades becomes 1/51.
24 In-Class Exercises (you can leave these unsimplified) Rolling 3 6-sided dice, what is the probability that they sum to 18? What about the probability that they sum to 17? The probability that the roll consists of a 3, a 2, and a 1, not necessarily in that order? If I m dealt 2 cards, what is the probability that both are in the range 2-10?
25 In-Class Exercises (you can leave these unsimplified) Rolling 3 6-sided dice, what is the probability that they sum to 18? E = {(6,6,6)} 1/6 3 = 1/216 What about the probability that they sum to 17? The probability that the roll consists of a 3, a 2, and a 1, not necessarily in that order? If I m dealt 2 cards, what is the probability that both are in the range 2-10?
26 In-Class Exercises (you can leave these unsimplified) Rolling 3 6-sided dice, what is the probability that they sum to 18? E = {(6,6,6)} 1/6 3 = 1/216 What about the probability that they sum to 17? E = {(5,6,6), (6,5,6),(6,6,5)} 3/6 3 = 3/216 = 1/72 The probability that the roll consists of a 3, a 2, and a 1, not necessarily in that order? If I m dealt 2 cards, what is the probability that both are in the range 2-10?
27 In-Class Exercises (you can leave these unsimplified) Rolling 3 6-sided dice, what is the probability that they sum to 18? E = {(6,6,6)} 1/6 3 = 1/216 What about the probability that they sum to 17? E = {(5,6,6), (6,5,6),(6,6,5)} 3/6 3 = 3/216 = 1/72 The probability that the roll consists of a 3, a 2, and a 1, not necessarily in that order? E = {(1,2,3), (1,3,2), } E = 3! = 6 6/6 3 = 1/36 If I m dealt 2 cards, what is the probability that both are in the range 2-10?
28 In-Class Exercises (you can leave these unsimplified) Rolling 3 6-sided dice, what is the probability that they sum to 18? E = {(6,6,6)} 1/6 3 = 1/216 What about the probability that they sum to 17? E = {(5,6,6), (6,5,6),(6,6,5)} 3/6 3 = 3/216 = 1/72 The probability that the roll consists of a 3, a 2, and a 1, not necessarily in that order? E = {(1,2,3), (1,3,2), } E = 3! = 6 6/6 3 = 1/36 If I m dealt 2 cards, what is the probability that both are in the range 2-10? E = {{2D,2H},,{10S,10C}} # cards = 9 ranks* 4 suits = 36 E = C(36,2) E / S = C(36,2)/C(52,2) = 0.475
29 More Counting-Based Probability Examples A deck has 7 cards, A,B,C,1,2,3,4. What is the probability that, after shuffling, the letters are in order in the deck and the numbers are in order, but they aren t necessarily contiguous? Examples: AB12C34, 123A4BC Number of orderings of deck:
30 More Counting-Based Probability Examples A deck has 7 cards, A,B,C,1,2,3,4. What is the probability that, after shuffling, the letters are in order in the deck and the numbers are in order, but they aren t necessarily contiguous? Examples: AB12C34, 123A4BC Number of orderings of deck: 7! (7 factorial)
31 More Counting-Based Probability Examples A deck has 7 cards, A,B,C,1,2,3,4. What is the probability that, after shuffling, the letters are in order in the deck and the numbers are in order, but they aren t necessarily contiguous? Examples: AB12C34, 123A4BC Number of orderings of deck: 7! (7 factorial) Number of orderings with success (hint: once we choose where letters go, nothing left to choose; LLNNLNN = AB12C34):
32 More Counting-Based Probability Examples A deck has 7 cards, A,B,C,1,2,3,4. What is the probability that, after shuffling, the letters are in order in the deck and the numbers are in order, but they aren t necessarily contiguous? Examples: AB12C34, 123A4BC Number of orderings of deck: 7! (7 factorial) Number of orderings with success (hint: once we choose where letters go, nothing left to choose; LLNNLNN = AB12C34): C(7,3)
33 More Counting-Based Probability Examples A deck has 7 cards, A,B,C,1,2,3,4. What is the probability that, after shuffling, the letters are in order in the deck and the numbers are in order, but they aren t necessarily contiguous? Examples: AB12C34, 123A4BC Number of orderings of deck: 7! (7 factorial) Number of orderings with success (hint: once we choose where letters go, nothing left to choose; LLNNLNN = AB12C34): C(7,3) = 7*6*5/3*2*1 = 35 Probability of success: C(7,3)/7! = 7*5/7! = 1/6*4*3*2 = 1/144
34 Axioms of Probability A valid probability is in the range [0,1] The sum of the probabilities of all outcomes ( simple /disjoint events) must be 1. (We should be certain that something will happen.) Corollary: Pr( A) = 1 - Pr(A) Pr (A v B) = Pr(A) + Pr(B) - Pr(A ^ B) This is just an application of inclusion-exclusion to probability - if events overlap in outcomes, we shouldn t double-count
35 The Birthday Paradox How many people do we need in a room to think it s more likely than not that 2 people share a birthday? The pigeonhole principle tells us we need 367 people (taking into account leap years) to be absolutely certain. But we need far fewer to think it s more likely than not that 2 people share a birthday. This is because after a while, it becomes unlikely that we manage to avoid all collisions repeatedly. Every new birthday has to randomly not match the birthdays that came before. The CS application is that sometimes two pieces of data will want to be randomly stored in the same place, needing extra attention - we may care how often that happens
36 The Birthday Paradox Grace bday Eve Chuck Alice Bob bday bday bday bday Jan Jan Jan Jan Jan Jan Jan Dec Dec At what point is it more likely than not that two balls land in the same bin?
37 The Birthday Paradox N people, want to figure what N should be so that Pr(shared birthday) > 50% Pr (shared birthday) = 1 - Pr(no shared birthday) Pr(no shared birthday) = [ways to have N distinct birthdays] [ways to have N birthdays] = P(365,N)/365 N = 365*364* *(365-N+1)/365 N P(365,N) here is an r-permutation, not a probability This makes the chance of a shared birthday 1 - P(365,N)/365 N Some experimentation can reveal that when N = 23, this crosses the threshold to Pr(shared) = 1 - P(365,23)/ = And when N = 70, we get P(shared) = about 0.999
38 Independent Events When events intuitively can have no bearing on each other - 2 flips of a coin, 2 rolls of a die - the events are said to be independent. When events are independent, Pr(A ^ B) = Pr(A)Pr(B). The chance of both events happening is equal to the product of the two probabilities. Chance of flipping heads twice: (1/2)(1/2) = 1/4. Chance of rolling a 2, then a 6 on a 6-sided die: (1/6)(1/6) = 1/36 Chance of flipping heads 5 times out of 5: (1/2) 5 = 1/32 The equation above in bold is the mathematical definition of independence. If it s not clear whether events are independent, we check whether that equation holds. If events are not independent, Pr(A ^ B) = Pr(A)Pr(B) is not true. You ll need to use conditional probability in that case (described later).
39 Independent Events In the Real World Independent Separate die rolls Card draws with replacement Whether it s a hot day on Mars and Venus Birthdays of people who aren t related Not Independent Whether a 6-sider roll is even and whether it s > 3 (2 vs 4,6) Draws without replacement Whether it s a hot day on two consecutive days Whether two stocks went up on the same day True independence can be difficult to find in the real world, but it s a good approximation until it isn t (2008 financial crisis)
40 Checking Indepdendence Suppose we roll 2 six-sided dice just once - both A and B below refer to the same roll. A = event of rolling doubles B = event of rolling at least one 6 Are these events independent? Unclear, so let s check Pr(A) = 6/36 = 1/6 (because six possible doubles rolls) Pr(B) = 1 - Pr(no 6 s) = /36 = 11/36 Pr(A ^ B) = Pr(rolled double 6 s) = 1/36 Pr(A ^ B)!= Pr(A)*Pr(B). These events aren t independent. If I told you that the roll was doubles, that should affect your belief that at least one six was rolled (it goes down because of all the mixed rolls with exactly one six).
41 Checking Indepdendence Suppose we roll 2 six-sided dice just once - both A and B below refer to the same roll. A = event of rolling doubles B = event of rolling a 6 on die #1 Are these events independent? Unclear, so let s check Pr(A) = 6/36 = 1/6 (because six possible doubles rolls) Pr(B) = 1/6 Pr(A ^ B) = Pr(rolled double 6 s) = 1/36 Pr(A ^ B) = Pr(A)*Pr(B). These events are independent. Intuitively, rolling a second die in secret and telling you whether it matches the first doesn t really tell you anything about what the first die was.
42 Birthday Paradox Revisited With Independence Jan Jan Jan Jan Jan Jan Jan Dec Dec We can think of each possible collision as an independent event The chance of avoiding all collisions is 365/365 * 364/365 * 363/365 * * (365-N+1)/365 This results in an identical equation to our countingbased approach earlier (Pr(collision) = 1 - P(365,N)/365 N )
43 Doing a Monopoly Problem Using Independence In Monopoly, you have 3 chances to get out of jail without paying a fine, by rolling doubles (on 2 6-sided dice). What is the chance of at least one doubles in 3 rolls? Pr (at least one doubles on 3 rolls) = 1 - Pr(no doubles on 3 rolls) = 1 - Pr(no doubles on 1 roll) 3 Using Independence = 1 - (1 - Pr(doubles on 1 roll)) 3 = 1 - (1-1/6) 3 = 1 - (5/6) 3 = 1-125/216 = 91/216 = 0.42
44 Multiplying Independent Probabilities Isn t Strictly Better If you are too attached to computing probabilities of complex events by multiplying probabilities, some problems may cause headaches An example we already saw was the problem of the probability of 7 cards A,B,C,1,2,3,4 keeping both letters and numbers in order. This is much cleaner as a problem of counting combinations than of thinking of it as 7 events of card drawing - events that aren t even independent
45 Summary Probability is a measure of how much we should believe an event will happen, in the range [0,1]. With equally likely outcomes we can count outcomes to determine probabilities - using all our counting techniques ( E / S ) When drawing without replacement we generally can use combinations to count subsets, but drawing with replacement is more like just counting strings With independent events Pr(A ^ B) = Pr(A)Pr(B) but truly unrelated events can be rare in the wild
Probability & Expectation. Professor Kevin Gold
Probability & Expectation Professor Kevin Gold Review of Probability so Far (1) Probabilities are numbers in the range [0,1] that describe how certain we should be of events If outcomes are equally likely
More information3 The multiplication rule/miscellaneous counting problems
Practice for Exam 1 1 Axioms of probability, disjoint and independent events 1. Suppose P (A) = 0.4, P (B) = 0.5. (a) If A and B are independent, what is P (A B)? What is P (A B)? (b) If A and B are disjoint,
More information3 The multiplication rule/miscellaneous counting problems
Practice for Exam 1 1 Axioms of probability, disjoint and independent events 1 Suppose P (A 0, P (B 05 (a If A and B are independent, what is P (A B? What is P (A B? (b If A and B are disjoint, what is
More informationHere are two situations involving chance:
Obstacle Courses 1. Introduction. Here are two situations involving chance: (i) Someone rolls a die three times. (People usually roll dice in pairs, so dice is more common than die, the singular form.)
More informationChapter 2. Permutations and Combinations
2. Permutations and Combinations Chapter 2. Permutations and Combinations In this chapter, we define sets and count the objects in them. Example Let S be the set of students in this classroom today. Find
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 13
CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 13 Introduction to Discrete Probability In the last note we considered the probabilistic experiment where we flipped a
More informationThe next several lectures will be concerned with probability theory. We will aim to make sense of statements such as the following:
CS 70 Discrete Mathematics for CS Fall 2004 Rao Lecture 14 Introduction to Probability The next several lectures will be concerned with probability theory. We will aim to make sense of statements such
More informationThe topic for the third and final major portion of the course is Probability. We will aim to make sense of statements such as the following:
CS 70 Discrete Mathematics for CS Spring 2006 Vazirani Lecture 17 Introduction to Probability The topic for the third and final major portion of the course is Probability. We will aim to make sense of
More information1. The chance of getting a flush in a 5-card poker hand is about 2 in 1000.
CS 70 Discrete Mathematics for CS Spring 2008 David Wagner Note 15 Introduction to Discrete Probability Probability theory has its origins in gambling analyzing card games, dice, roulette wheels. Today
More informationThe Teachers Circle Mar. 20, 2012 HOW TO GAMBLE IF YOU MUST (I ll bet you $5 that if you give me $10, I ll give you $20.)
The Teachers Circle Mar. 2, 22 HOW TO GAMBLE IF YOU MUST (I ll bet you $ that if you give me $, I ll give you $2.) Instructor: Paul Zeitz (zeitzp@usfca.edu) Basic Laws and Definitions of Probability If
More informationMAT104: Fundamentals of Mathematics II Summary of Counting Techniques and Probability. Preliminary Concepts, Formulas, and Terminology
MAT104: Fundamentals of Mathematics II Summary of Counting Techniques and Probability Preliminary Concepts, Formulas, and Terminology Meanings of Basic Arithmetic Operations in Mathematics Addition: Generally
More informationNovember 6, Chapter 8: Probability: The Mathematics of Chance
Chapter 8: Probability: The Mathematics of Chance November 6, 2013 Last Time Crystallographic notation Groups Crystallographic notation The first symbol is always a p, which indicates that the pattern
More information(a) Suppose you flip a coin and roll a die. Are the events obtain a head and roll a 5 dependent or independent events?
Unit 6 Probability Name: Date: Hour: Multiplication Rule of Probability By the end of this lesson, you will be able to Understand Independence Use the Multiplication Rule for independent events Independent
More information7.1 Chance Surprises, 7.2 Predicting the Future in an Uncertain World, 7.4 Down for the Count
7.1 Chance Surprises, 7.2 Predicting the Future in an Uncertain World, 7.4 Down for the Count Probability deals with predicting the outcome of future experiments in a quantitative way. The experiments
More informationSection 6.1 #16. Question: What is the probability that a five-card poker hand contains a flush, that is, five cards of the same suit?
Section 6.1 #16 What is the probability that a five-card poker hand contains a flush, that is, five cards of the same suit? page 1 Section 6.1 #38 Two events E 1 and E 2 are called independent if p(e 1
More informationThe probability set-up
CHAPTER 2 The probability set-up 2.1. Introduction and basic theory We will have a sample space, denoted S (sometimes Ω) that consists of all possible outcomes. For example, if we roll two dice, the sample
More informationSuch a description is the basis for a probability model. Here is the basic vocabulary we use.
5.2.1 Probability Models When we toss a coin, we can t know the outcome in advance. What do we know? We are willing to say that the outcome will be either heads or tails. We believe that each of these
More informationPoker: Probabilities of the Various Hands
Poker: Probabilities of the Various Hands 22 February 2012 Poker II 22 February 2012 1/27 Some Review from Monday There are 4 suits and 13 values. The suits are Spades Hearts Diamonds Clubs There are 13
More informationMath 1313 Section 6.2 Definition of Probability
Math 1313 Section 6.2 Definition of Probability Probability is a measure of the likelihood that an event occurs. For example, if there is a 20% chance of rain tomorrow, that means that the probability
More informationPoker: Probabilities of the Various Hands
Poker: Probabilities of the Various Hands 19 February 2014 Poker II 19 February 2014 1/27 Some Review from Monday There are 4 suits and 13 values. The suits are Spades Hearts Diamonds Clubs There are 13
More informationThe probability set-up
CHAPTER The probability set-up.1. Introduction and basic theory We will have a sample space, denoted S sometimes Ω that consists of all possible outcomes. For example, if we roll two dice, the sample space
More informationProbability - Introduction Chapter 3, part 1
Probability - Introduction Chapter 3, part 1 Mary Lindstrom (Adapted from notes provided by Professor Bret Larget) January 27, 2004 Statistics 371 Last modified: Jan 28, 2004 Why Learn Probability? Some
More informationSimulations. 1 The Concept
Simulations In this lab you ll learn how to create simulations to provide approximate answers to probability questions. We ll make use of a particular kind of structure, called a box model, that can be
More informationABE/ASE Standards Mathematics
[Lesson Title] TEACHER NAME PROGRAM NAME Program Information Playing the Odds [Unit Title] Data Analysis and Probability NRS EFL(s) 3 4 TIME FRAME 240 minutes (double lesson) ABE/ASE Standards Mathematics
More informationCSC/MTH 231 Discrete Structures II Spring, Homework 5
CSC/MTH 231 Discrete Structures II Spring, 2010 Homework 5 Name 1. A six sided die D (with sides numbered 1, 2, 3, 4, 5, 6) is thrown once. a. What is the probability that a 3 is thrown? b. What is the
More informationThe study of probability is concerned with the likelihood of events occurring. Many situations can be analyzed using a simplified model of probability
The study of probability is concerned with the likelihood of events occurring Like combinatorics, the origins of probability theory can be traced back to the study of gambling games Still a popular branch
More informationWeek 1: Probability models and counting
Week 1: Probability models and counting Part 1: Probability model Probability theory is the mathematical toolbox to describe phenomena or experiments where randomness occur. To have a probability model
More information4.1 Sample Spaces and Events
4.1 Sample Spaces and Events An experiment is an activity that has observable results. Examples: Tossing a coin, rolling dice, picking marbles out of a jar, etc. The result of an experiment is called an
More informationMixed Counting Problems
We have studied a number of counting principles and techniques since the beginning of the course and when we tackle a counting problem, we may have to use one or a combination of these principles. The
More informationConditional Probability Worksheet
Conditional Probability Worksheet P( A and B) P(A B) = P( B) Exercises 3-6, compute the conditional probabilities P( AB) and P( B A ) 3. P A = 0.7, P B = 0.4, P A B = 0.25 4. P A = 0.45, P B = 0.8, P A
More informationTheory of Probability - Brett Bernstein
Theory of Probability - Brett Bernstein Lecture 3 Finishing Basic Probability Review Exercises 1. Model flipping two fair coins using a sample space and a probability measure. Compute the probability of
More informationMath1116Chapter15ProbabilityProbabilityDone.notebook January 20, 2013
Chapter 15 Notes on Probability 15.4 Probability Spaces Probability assignment A function that assigns to each event E a number between 0 and 1, which represents the probability of the event E and which
More informationConditional Probability Worksheet
Conditional Probability Worksheet EXAMPLE 4. Drug Testing and Conditional Probability Suppose that a company claims it has a test that is 95% effective in determining whether an athlete is using a steroid.
More informationLISTING THE WAYS. getting a total of 7 spots? possible ways for 2 dice to fall: then you win. But if you roll. 1 q 1 w 1 e 1 r 1 t 1 y
LISTING THE WAYS A pair of dice are to be thrown getting a total of 7 spots? There are What is the chance of possible ways for 2 dice to fall: 1 q 1 w 1 e 1 r 1 t 1 y 2 q 2 w 2 e 2 r 2 t 2 y 3 q 3 w 3
More informationDiscrete Structures for Computer Science
Discrete Structures for Computer Science William Garrison bill@cs.pitt.edu 6311 Sennott Square Lecture #23: Discrete Probability Based on materials developed by Dr. Adam Lee The study of probability is
More informationMath116Chapter15ProbabilityProbabilityDone.notebook January 08, 2012
15.4 Probability Spaces Probability assignment A function that assigns to each event E a number between 0 and 1, which represents the probability of the event E and which we denote by Pr (E). Probability
More informationPermutations: The number of arrangements of n objects taken r at a time is. P (n, r) = n (n 1) (n r + 1) =
Section 6.6: Mixed Counting Problems We have studied a number of counting principles and techniques since the beginning of the course and when we tackle a counting problem, we may have to use one or a
More informationCISC 1400 Discrete Structures
CISC 1400 Discrete Structures Chapter 6 Counting CISC1400 Yanjun Li 1 1 New York Lottery New York Mega-million Jackpot Pick 5 numbers from 1 56, plus a mega ball number from 1 46, you could win biggest
More informationCompound Probability. Set Theory. Basic Definitions
Compound Probability Set Theory A probability measure P is a function that maps subsets of the state space Ω to numbers in the interval [0, 1]. In order to study these functions, we need to know some basic
More informationChapter 5: Probability: What are the Chances? Section 5.2 Probability Rules
+ Chapter 5: Probability: What are the Chances? Section 5.2 + Two-Way Tables and Probability When finding probabilities involving two events, a two-way table can display the sample space in a way that
More informationCS1800: More Counting. Professor Kevin Gold
CS1800: More Counting Professor Kevin Gold Today Dealing with illegal values Avoiding overcounting Balls-in-bins, or, allocating resources Review problems Dealing with Illegal Values Password systems often
More information2.5 Sample Spaces Having Equally Likely Outcomes
Sample Spaces Having Equally Likely Outcomes 3 Sample Spaces Having Equally Likely Outcomes Recall that we had a simple example (fair dice) before on equally-likely sample spaces Since they will appear
More informationCounting Methods and Probability
CHAPTER Counting Methods and Probability Many good basketball players can make 90% of their free throws. However, the likelihood of a player making several free throws in a row will be less than 90%. You
More informationIntermediate Math Circles November 1, 2017 Probability I
Intermediate Math Circles November 1, 2017 Probability I Probability is the study of uncertain events or outcomes. Games of chance that involve rolling dice or dealing cards are one obvious area of application.
More informationRANDOM EXPERIMENTS AND EVENTS
Random Experiments and Events 18 RANDOM EXPERIMENTS AND EVENTS In day-to-day life we see that before commencement of a cricket match two captains go for a toss. Tossing of a coin is an activity and getting
More informationCSE 312: Foundations of Computing II Quiz Section #2: Inclusion-Exclusion, Pigeonhole, Introduction to Probability (solutions)
CSE 31: Foundations of Computing II Quiz Section #: Inclusion-Exclusion, Pigeonhole, Introduction to Probability (solutions) Review: Main Theorems and Concepts Binomial Theorem: x, y R, n N: (x + y) n
More informationBefore giving a formal definition of probability, we explain some terms related to probability.
probability 22 INTRODUCTION In our day-to-day life, we come across statements such as: (i) It may rain today. (ii) Probably Rajesh will top his class. (iii) I doubt she will pass the test. (iv) It is unlikely
More informationFundamentals of Probability
Fundamentals of Probability Introduction Probability is the likelihood that an event will occur under a set of given conditions. The probability of an event occurring has a value between 0 and 1. An impossible
More informationMore Probability: Poker Hands and some issues in Counting
More Probability: Poker Hands and some issues in Counting Data From Thursday Everybody flipped a pair of coins and recorded how many times they got two heads, two tails, or one of each. We saw that the
More informationGAMBLING ( ) Name: Partners: everyone else in the class
Name: Partners: everyone else in the class GAMBLING Games of chance, such as those using dice and cards, oporate according to the laws of statistics: the most probable roll is the one to bet on, and the
More informationProbability. Dr. Zhang Fordham Univ.
Probability! Dr. Zhang Fordham Univ. 1 Probability: outline Introduction! Experiment, event, sample space! Probability of events! Calculate Probability! Through counting! Sum rule and general sum rule!
More informationPoker: Further Issues in Probability. Poker I 1/29
Poker: Further Issues in Probability Poker I 1/29 How to Succeed at Poker (3 easy steps) 1 Learn how to calculate complex probabilities and/or memorize lots and lots of poker-related probabilities. 2 Take
More informationI. WHAT IS PROBABILITY?
C HAPTER 3 PROAILITY Random Experiments I. WHAT IS PROAILITY? The weatherman on 10 o clock news program states that there is a 20% chance that it will snow tomorrow, a 65% chance that it will rain and
More informationCombinatorics: The Fine Art of Counting
Combinatorics: The Fine Art of Counting Week 6 Lecture Notes Discrete Probability Note Binomial coefficients are written horizontally. The symbol ~ is used to mean approximately equal. Introduction and
More informationDate. Probability. Chapter
Date Probability Contests, lotteries, and games offer the chance to win just about anything. You can win a cup of coffee. Even better, you can win cars, houses, vacations, or millions of dollars. Games
More informationPROBLEM SET 2 Due: Friday, September 28. Reading: CLRS Chapter 5 & Appendix C; CLR Sections 6.1, 6.2, 6.3, & 6.6;
CS231 Algorithms Handout #8 Prof Lyn Turbak September 21, 2001 Wellesley College PROBLEM SET 2 Due: Friday, September 28 Reading: CLRS Chapter 5 & Appendix C; CLR Sections 6.1, 6.2, 6.3, & 6.6; Suggested
More informationNovember 11, Chapter 8: Probability: The Mathematics of Chance
Chapter 8: Probability: The Mathematics of Chance November 11, 2013 Last Time Probability Models and Rules Discrete Probability Models Equally Likely Outcomes Probability Rules Probability Rules Rule 1.
More informationProblems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman:
Math 22 Fall 2017 Homework 2 Drew Armstrong Problems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman: Section 1.2, Exercises 5, 7, 13, 16. Section 1.3, Exercises,
More informationAdvanced Intermediate Algebra Chapter 12 Summary INTRO TO PROBABILITY
Advanced Intermediate Algebra Chapter 12 Summary INTRO TO PROBABILITY 1. Jack and Jill do not like washing dishes. They decide to use a random method to select whose turn it is. They put some red and blue
More informationKey Concepts. Theoretical Probability. Terminology. Lesson 11-1
Key Concepts Theoretical Probability Lesson - Objective Teach students the terminology used in probability theory, and how to make calculations pertaining to experiments where all outcomes are equally
More informationNovember 8, Chapter 8: Probability: The Mathematics of Chance
Chapter 8: Probability: The Mathematics of Chance November 8, 2013 Last Time Probability Models and Rules Discrete Probability Models Equally Likely Outcomes Crystallographic notation The first symbol
More informationUnit 6: Probability. Marius Ionescu 10/06/2011. Marius Ionescu () Unit 6: Probability 10/06/ / 22
Unit 6: Probability Marius Ionescu 10/06/2011 Marius Ionescu () Unit 6: Probability 10/06/2011 1 / 22 Chapter 13: What is a probability Denition The probability that an event happens is the percentage
More informationProbability. The MEnTe Program Math Enrichment through Technology. Title V East Los Angeles College
Probability The MEnTe Program Math Enrichment through Technology Title V East Los Angeles College 2003 East Los Angeles College. All rights reserved. Topics Introduction Empirical Probability Theoretical
More information3. Discrete Probability. CSE 312 Spring 2015 W.L. Ruzzo
3. Discrete Probability CSE 312 Spring 2015 W.L. Ruzzo 2 Probability theory: an aberration of the intellect and ignorance coined into science John Stuart Mill 3 sample spaces Sample space: S is a set of
More informationUnit 6: Probability. Marius Ionescu 10/06/2011. Marius Ionescu () Unit 6: Probability 10/06/ / 22
Unit 6: Probability Marius Ionescu 10/06/2011 Marius Ionescu () Unit 6: Probability 10/06/2011 1 / 22 Chapter 13: What is a probability Denition The probability that an event happens is the percentage
More informationCIS 2033 Lecture 6, Spring 2017
CIS 2033 Lecture 6, Spring 2017 Instructor: David Dobor February 2, 2017 In this lecture, we introduce the basic principle of counting, use it to count subsets, permutations, combinations, and partitions,
More informationChapter 1. Probability
Chapter 1. Probability 1.1 Basic Concepts Scientific method a. For a given problem, we define measures that explains the problem well. b. Data is collected with observation and the measures are calculated.
More informationChapter 1: Sets and Probability
Chapter 1: Sets and Probability Section 1.3-1.5 Recap: Sample Spaces and Events An is an activity that has observable results. An is the result of an experiment. Example 1 Examples of experiments: Flipping
More informationFall 2017 March 13, Written Homework 4
CS1800 Discrete Structures Profs. Aslam, Gold, & Pavlu Fall 017 March 13, 017 Assigned: Fri Oct 7 017 Due: Wed Nov 8 017 Instructions: Written Homework 4 The assignment has to be uploaded to blackboard
More informationA Probability Work Sheet
A Probability Work Sheet October 19, 2006 Introduction: Rolling a Die Suppose Geoff is given a fair six-sided die, which he rolls. What are the chances he rolls a six? In order to solve this problem, we
More informationPROBABILITY. 1. Introduction. Candidates should able to:
PROBABILITY Candidates should able to: evaluate probabilities in simple cases by means of enumeration of equiprobable elementary events (e.g for the total score when two fair dice are thrown), or by calculation
More informationSTAT 430/510 Probability Lecture 3: Space and Event; Sample Spaces with Equally Likely Outcomes
STAT 430/510 Probability Lecture 3: Space and Event; Sample Spaces with Equally Likely Outcomes Pengyuan (Penelope) Wang May 25, 2011 Review We have discussed counting techniques in Chapter 1. (Principle
More informationCounting (Enumerative Combinatorics) X. Zhang, Fordham Univ.
Counting (Enumerative Combinatorics) X. Zhang, Fordham Univ. 1 Chance of winning?! What s the chances of winning New York Megamillion Jackpot!! just pick 5 numbers from 1 to 56, plus a mega ball number
More informationCS 361: Probability & Statistics
February 7, 2018 CS 361: Probability & Statistics Independence & conditional probability Recall the definition for independence So we can suppose events are independent and compute probabilities Or we
More informationProbability MAT230. Fall Discrete Mathematics. MAT230 (Discrete Math) Probability Fall / 37
Probability MAT230 Discrete Mathematics Fall 2018 MAT230 (Discrete Math) Probability Fall 2018 1 / 37 Outline 1 Discrete Probability 2 Sum and Product Rules for Probability 3 Expected Value MAT230 (Discrete
More informationWaiting Times. Lesson1. Unit UNIT 7 PATTERNS IN CHANCE
Lesson1 Waiting Times Monopoly is a board game that can be played by several players. Movement around the board is determined by rolling a pair of dice. Winning is based on a combination of chance and
More informationProbability Paradoxes
Probability Paradoxes Washington University Math Circle February 20, 2011 1 Introduction We re all familiar with the idea of probability, even if we haven t studied it. That is what makes probability so
More informationFinite Mathematics MAT 141: Chapter 8 Notes
Finite Mathematics MAT 4: Chapter 8 Notes Counting Principles; More David J. Gisch The Multiplication Principle; Permutations Multiplication Principle Multiplication Principle You can think of the multiplication
More informationChapter 1. Probability
Chapter 1. Probability 1.1 Basic Concepts Scientific method a. For a given problem, we define measures that explains the problem well. b. Data is collected with observation and the measures are calculated.
More informationCHAPTERS 14 & 15 PROBABILITY STAT 203
CHAPTERS 14 & 15 PROBABILITY STAT 203 Where this fits in 2 Up to now, we ve mostly discussed how to handle data (descriptive statistics) and how to collect data. Regression has been the only form of statistical
More informationIntroduction to probability
Introduction to probability Suppose an experiment has a finite set X = {x 1,x 2,...,x n } of n possible outcomes. Each time the experiment is performed exactly one on the n outcomes happens. Assign each
More informationStat 20: Intro to Probability and Statistics
Stat 20: Intro to Probability and Statistics Lecture 12: More Probability Tessa L. Childers-Day UC Berkeley 10 July 2014 By the end of this lecture... You will be able to: Use the theory of equally likely
More informationCSE 312: Foundations of Computing II Quiz Section #2: Inclusion-Exclusion, Pigeonhole, Introduction to Probability
CSE 312: Foundations of Computing II Quiz Section #2: Inclusion-Exclusion, Pigeonhole, Introduction to Probability Review: Main Theorems and Concepts Binomial Theorem: Principle of Inclusion-Exclusion
More information7.1 Experiments, Sample Spaces, and Events
7.1 Experiments, Sample Spaces, and Events An experiment is an activity that has observable results. Examples: Tossing a coin, rolling dice, picking marbles out of a jar, etc. The result of an experiment
More informationCMPSCI 240: Reasoning Under Uncertainty First Midterm Exam
CMPSCI 240: Reasoning Under Uncertainty First Midterm Exam February 18, 2015. Name: ID: Instructions: Answer the questions directly on the exam pages. Show all your work for each question. Providing more
More informationMath 166: Topics in Contemporary Mathematics II
Math 166: Topics in Contemporary Mathematics II Xin Ma Texas A&M University September 30, 2017 Xin Ma (TAMU) Math 166 September 30, 2017 1 / 11 Last Time Factorials For any natural number n, we define
More information23 Applications of Probability to Combinatorics
November 17, 2017 23 Applications of Probability to Combinatorics William T. Trotter trotter@math.gatech.edu Foreword Disclaimer Many of our examples will deal with games of chance and the notion of gambling.
More informationEECS 203 Spring 2016 Lecture 15 Page 1 of 6
EECS 203 Spring 2016 Lecture 15 Page 1 of 6 Counting We ve been working on counting for the last two lectures. We re going to continue on counting and probability for about 1.5 more lectures (including
More informationChapter 11: Probability and Counting Techniques
Chapter 11: Probability and Counting Techniques Diana Pell Section 11.3: Basic Concepts of Probability Definition 1. A sample space is a set of all possible outcomes of an experiment. Exercise 1. An experiment
More informationCOUNTING AND PROBABILITY
CHAPTER 9 COUNTING AND PROBABILITY It s as easy as 1 2 3. That s the saying. And in certain ways, counting is easy. But other aspects of counting aren t so simple. Have you ever agreed to meet a friend
More informationProbability. The Bag Model
Probability The Bag Model Imagine a bag (or box) containing balls of various kinds having various colors for example. Assume that a certain fraction p of these balls are of type A. This means N = total
More informationStatistics Intermediate Probability
Session 6 oscardavid.barrerarodriguez@sciencespo.fr April 3, 2018 and Sampling from a Population Outline 1 The Monty Hall Paradox Some Concepts: Event Algebra Axioms and Things About that are True Counting
More informationClass XII Chapter 13 Probability Maths. Exercise 13.1
Exercise 13.1 Question 1: Given that E and F are events such that P(E) = 0.6, P(F) = 0.3 and P(E F) = 0.2, find P (E F) and P(F E). It is given that P(E) = 0.6, P(F) = 0.3, and P(E F) = 0.2 Question 2:
More informationM146 - Chapter 5 Handouts. Chapter 5
Chapter 5 Objectives of chapter: Understand probability values. Know how to determine probability values. Use rules of counting. Section 5-1 Probability Rules What is probability? It s the of the occurrence
More information1. How many subsets are there for the set of cards in a standard playing card deck? How many subsets are there of size 8?
Math 1711-A Summer 2016 Final Review 1 August 2016 Time Limit: 170 Minutes Name: 1. How many subsets are there for the set of cards in a standard playing card deck? How many subsets are there of size 8?
More information1 2-step and other basic conditional probability problems
Name M362K Exam 2 Instructions: Show all of your work. You do not have to simplify your answers. No calculators allowed. 1 2-step and other basic conditional probability problems 1. Suppose A, B, C are
More informationOutcome X (1, 1) 2 (2, 1) 3 (3, 1) 4 (4, 1) 5 {(1, 1) (1, 2) (1, 3) (1, 4) (1, 5) (1, 6) (6, 1) (6, 2) (6, 3) (6, 4) (6, 5) (6, 6)}
Section 8: Random Variables and probability distributions of discrete random variables In the previous sections we saw that when we have numerical data, we can calculate descriptive statistics such as
More informationThe student will explain and evaluate the financial impact and consequences of gambling.
What Are the Odds? Standard 12 The student will explain and evaluate the financial impact and consequences of gambling. Lesson Objectives Recognize gambling as a form of risk. Calculate the probabilities
More informationGrade 6 Math Circles Fall Oct 14/15 Probability
1 Faculty of Mathematics Waterloo, Ontario Centre for Education in Mathematics and Computing Grade 6 Math Circles Fall 2014 - Oct 14/15 Probability Probability is the likelihood of an event occurring.
More informationLenarz Math 102 Practice Exam # 3 Name: 1. A 10-sided die is rolled 100 times with the following results:
Lenarz Math 102 Practice Exam # 3 Name: 1. A 10-sided die is rolled 100 times with the following results: Outcome Frequency 1 8 2 8 3 12 4 7 5 15 8 7 8 8 13 9 9 10 12 (a) What is the experimental probability
More information