List 4 — Discovering Formalism
From intuition to formalism — events as grids
Problem 1 — Coin × Coin: Reading and Writing Events as Grids
Two fair coins are tossed. The sample space is , each outcome equally likely with probability . Part A: for each of the five events below, write the event as a set and compute its probability. Part B: given a marked grid, state which event it encodes.
- a)A(1): exactly one head.
- b)A(2): both tosses show the same face.
- c)A(3): at least one head.
- d)A(4): the first toss is tails.
- e)A(5): the second toss is heads.
- f)B(1): top row entirely marked — which event?
- g)B(2): main diagonal marked — which event?
The most natural way to organise the sample space of two coin tosses is to place the result of the first toss along the rows and the result of the second toss along the columns. The row labelled H corresponds to "first toss is heads" and the row labelled T to "first toss is tails"; similarly the column labelled H means "second toss is heads" and column T means "second toss is tails". The four cells of the resulting 2×2 grid are in bijection with the four outcomes: cell (0,0) encodes HH, cell (0,1) encodes HT, cell (1,0) encodes TH, and cell (1,1) encodes TT. An event is simply a subset of cells — we shade or mark those cells — and its probability equals the number of marked cells divided by four.
| H | T | |
|---|---|---|
| H | X | X |
| T | X | X |
An outcome has exactly one head when the two tosses differ: one shows H and the other shows T. Looking at the grid, this means the row label and column label are different. The cell (0,1) has row H and column T — that is HT — and cell (1,0) has row T and column H — that is TH. Exactly those two cells are marked. The two cells (0,0) = HH and (1,1) = TT are not marked because both tosses are the same there.
| H | T | |
|---|---|---|
| H | . | X |
| T | X | . |
The two tosses agree when the outcome lies on the main diagonal of the grid — both H (top-left) or both T (bottom-right). These are cells (0,0) and (1,1). Notice that is the complement of : the grid for marks the two cells left unmarked by , and as expected. This is a reassuring consistency check: no cell is double-counted, and together they cover the entire space.
| H | T | |
|---|---|---|
| H | X | . |
| T | . | X |
At least one head is satisfied by every outcome except TT, which is the only cell where neither toss produced a head. Equivalently, using the complement rule: . In the grid, three of the four cells are marked, leaving only cell (1,1) = TT empty. The L-shaped region of marked cells is characteristic of "at least one" events across many sample spaces.
| H | T | |
|---|---|---|
| H | X | X |
| T | X | . |
The condition "first toss is tails" constrains only the row: we look at the row labelled T and take both cells in that row regardless of the second toss. This gives cells (1,0) = TH and (1,1) = TT. In grid terms, the event corresponds to the entire bottom row being marked. The probability is 2/4 = 1/2, consistent with P(first toss = T) = 1/2 for a fair coin.
| H | T | |
|---|---|---|
| H | . | . |
| T | X | X |
The condition "second toss is heads" constrains only the column: we look at the column labelled H and take both cells in that column regardless of the first toss. This gives cells (0,0) = HH and (1,0) = TH. In grid terms, the event is the entire left column. Comparing with : that event was the entire bottom row, and this event is the entire left column; together they illustrate how row-events and column-events correspond to conditions on the first and second toss respectively.
| H | T | |
|---|---|---|
| H | X | . |
| T | X | . |
Reading a grid in reverse: if someone hands us a grid with the entire top row (row index 0, label H) marked and nothing else, we must identify the event. Row 0 corresponds to "first toss = H". The two marked cells are (0,0) = HH and (0,1) = HT. Therefore the event is "the first toss landed heads," . The probability is . This is precisely the mirror image of : conditions on the first toss give horizontal bands (entire rows), while conditions on the second toss give vertical bands (entire columns).
| H | T | |
|---|---|---|
| H | X | X |
| T | . | . |
A grid with only the two diagonal cells (0,0) and (1,1) marked encodes the event "both tosses show the same face," namely . We already computed this in part A(2): . The key geometric insight is that the main diagonal of a square grid always encodes "both components are equal" — this pattern recurs for die×die grids, where the diagonal encodes "both dice show the same number." Recognising this shape enables instant identification of equality events in any Cartesian-product sample space.
| H | T | |
|---|---|---|
| H | X | . |
| T | . | X |
Problem 2 — Die × Die: Events in the 6×6 Grid
Two fair six-sided dice are rolled. The sample space has equally likely outcomes , where is the first die and the second. Part A: describe each event as a subset of the 6×6 grid and compute its probability. Part B: given a grid pattern, identify the event.
- a)A(1): sum of both dice equals 8.
- b)A(2): first die shows a larger number than the second.
- c)A(3): both dice show an even number.
- d)A(4): at least one die shows 6.
- e)A(5): exactly one die shows 1.
- f)B(1): the block of cells with row ≥ 2 and col ≥ 2 entirely marked.
- g)B(2): main diagonal of the 6×6 grid marked.
We organise the 36 outcomes into a 6×6 grid. The rows are indexed 0 through 5 and labelled 1 through 6, corresponding to the value shown by the first die. The columns are similarly labelled 1 through 6 for the second die. Cell (r, c) therefore represents the outcome "first die = r+1, second die = c+1." An event is a set of such cells, and its probability equals the cell count divided by 36. The grid makes visible the geometry of events in a way that a plain list does not: sums form diagonals, one-die conditions form rows or columns, and symmetry between the two dice corresponds to symmetry across the main diagonal.
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | . | . | . | . | . | . |
| 2 | . | . | . | . | . | . |
| 3 | . | . | . | . | . | . |
| 4 | . | . | . | . | . | . |
| 5 | . | . | . | . | . | . |
| 6 | . | . | . | . | . | . |
The pairs with are: . In 0-indexed grid coordinates these are (1,5), (2,4), (3,3), (4,2), (5,1). Notice these cells form an anti-diagonal line — sums of constant value always appear as anti-diagonals in the grid. There are 5 such cells. The anti-diagonal corresponding to sum 7 would have 6 cells and the highest probability among all sum-events; sum 8 has one fewer cell on each side, giving 5.
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | . | . | . | . | . | . |
| 2 | . | . | . | . | . | X |
| 3 | . | . | . | . | X | . |
| 4 | . | . | . | X | . | . |
| 5 | . | . | X | . | . | . |
| 6 | . | X | . | . | . | . |
The condition selects all cells strictly below the main diagonal. Enumerating: when first die = 2, second can be 1 (1 cell); when first = 3, second can be 1 or 2 (2 cells); when first = 4, three choices; first = 5, four choices; first = 6, five choices. Total: cells. The lower triangular region occupies exactly of the grid, by symmetry equal to the probability that the first die is strictly less — a useful check.
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | . | . | . | . | . | . |
| 2 | X | . | . | . | . | . |
| 3 | X | X | . | . | . | . |
| 4 | X | X | X | . | . | . |
| 5 | X | X | X | X | . | . |
| 6 | X | X | X | X | X | . |
The even faces are 2, 4, 6, corresponding to row/column indices 1, 3, 5 (0-indexed). We need all combinations of these rows and columns, giving a 3×3 sub-grid embedded in the 6×6 grid. There are such cells. In the grid they form a regular pattern — every other row crossed with every other column — which is visually striking and easy to recognise.
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | . | . | . | . | . | . |
| 2 | . | X | . | X | . | X |
| 3 | . | . | . | . | . | . |
| 4 | . | X | . | X | . | X |
| 5 | . | . | . | . | . | . |
| 6 | . | X | . | X | . | X |
This event is the union of "first die = 6" (entire row 5, 6 cells) and "second die = 6" (entire column 5, 6 cells). By inclusion-exclusion, the overlap is the single cell where both dice show 6, namely (5,5). So . In the grid this is the bottom row plus the rightmost column in an L-shaped pattern. The cell (5,5) is included in both arms of the L, but counted only once.
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | . | . | . | . | . | X |
| 2 | . | . | . | . | . | X |
| 3 | . | . | . | . | . | X |
| 4 | . | . | . | . | . | X |
| 5 | . | . | . | . | . | X |
| 6 | X | X | X | X | X | X |
Exactly one die shows 1 means either first die = 1 and second die ≠ 1, or second die = 1 and first die ≠ 1. The first part is row 0 minus cell (0,0): five cells. The second part is column 0 minus cell (0,0): five cells. Together, cells, arranged in a cross shape with the corner cell removed. Notice this differs from "at least one die shows 1" (which would include (0,0)) by exactly one cell.
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | . | X | X | X | X | X |
| 2 | X | . | . | . | . | . |
| 3 | X | . | . | . | . | . |
| 4 | X | . | . | . | . | . |
| 5 | X | . | . | . | . | . |
| 6 | X | . | . | . | . | . |
When someone presents a grid where the bottom-right 4×4 block (rows 2–5, columns 2–5) is entirely marked, the event is "both dice show at least 3." Row indices 2–5 correspond to die values 3–6, and the same for columns. The event requires both dice simultaneously in , giving cells. Its probability is . This block pattern is characteristic of joint lower-bound events.
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | . | . | . | . | . | . |
| 2 | . | . | . | . | . | . |
| 3 | . | . | X | X | X | X |
| 4 | . | . | X | X | X | X |
| 5 | . | . | X | X | X | X |
| 6 | . | . | X | X | X | X |
A grid with the six main-diagonal cells (0,0), (1,1), (2,2), (3,3), (4,4), (5,5) marked encodes the event "both dice show the same value," i.e., . This is exactly the event of rolling doubles. The probability is . The diagonal pattern is the purest visual signature of an equality constraint between two symmetric components, and it appears identically in the coin×coin grid where the main diagonal encoded "both tosses the same."
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | X | . | . | . | . | . |
| 2 | . | X | . | . | . | . |
| 3 | . | . | X | . | . | . |
| 4 | . | . | . | X | . | . |
| 5 | . | . | . | . | X | . |
| 6 | . | . | . | . | . | X |
Problem 3 — Weekly Weather: A 3×7 Event Grid
The weather each day of a week can be Sunny (S), Cloudy (C), or Rainy (R). We represent the week as a 3×7 grid: rows for the three weather states (S, C, R) and columns for the seven days (Mon through Sun). Marking cell (row, col) means "day col has weather state row." Part A: describe each event as marked cells. Part B: interpret two given grid patterns.
- a)A(1): Monday is sunny.
- b)A(2): the weekend (Sat and Sun) is entirely rainy.
- c)A(3): it rains on Wednesday or Friday (or both).
- d)A(4): no day of the week is rainy.
- e)A(5): Thursday is not sunny.
- f)B(1): cells (S,Sat) and (S,Sun) marked — which event?
- g)B(2): row R left completely empty — which event?
Unlike the previous grids where both axes represented values of the same type (coin tosses or die faces), here the two axes represent fundamentally different things: rows index the weather state and columns index the day of the week. Marking cell (r, c) is a claim about the daily weather: it asserts that on day c the weather is state r. This is a different style of event grid — one that captures the behaviour of a process over time. Each column has exactly one "actual" state on any given week, but an event may allow multiple states per column (uncertainty about the state) or impose conditions on only some of the columns.
| Mon | Tue | Wed | Thu | Fri | Sat | Sun | |
|---|---|---|---|---|---|---|---|
| S | . | . | . | . | . | . | . |
| C | . | . | . | . | . | . | . |
| R | . | . | . | . | . | . | . |
The event "Monday is sunny" constrains only Monday's state to S, leaving all other days unconstrained. In the grid, we mark only the single cell at row S (index 0) and column Mon (index 0). This is a minimal event: a single-cell mark in a 3×7 grid. It eliminates any outcome where Monday is Cloudy or Rainy, while remaining silent on the remaining six days. Provided each daily state has an equal probability of 1/3 and days are independent, .
| Mon | Tue | Wed | Thu | Fri | Sat | Sun | |
|---|---|---|---|---|---|---|---|
| S | X | . | . | . | . | . | . |
| C | . | . | . | . | . | . | . |
| R | . | . | . | . | . | . | . |
The weekend consists of Saturday (column index 5) and Sunday (column index 6). The event requires both days to be in state R (row index 2). In the grid we mark cells (2,5) and (2,6). No other cells are marked because the five weekdays are unconstrained. Assuming independence and per day, . The two marked cells sit in the bottom-right corner of the grid, a compact visual marker for a weekend rainy event.
| Mon | Tue | Wed | Thu | Fri | Sat | Sun | |
|---|---|---|---|---|---|---|---|
| S | . | . | . | . | . | . | . |
| C | . | . | . | . | . | . | . |
| R | . | . | . | . | . | X | X |
The event "it rains on Wednesday OR Friday" is satisfied if at least one of those two days is rainy. This is an OR-event on two separate days. In the grid we mark (R, Wed) = (2,2) and (R, Fri) = (2,4). The word "or" here is inclusive, but since we are marking individual daily conditions (not joint outcomes), there is no double-counting issue at the grid level. The probability depends on whether independence holds: under independence.
| Mon | Tue | Wed | Thu | Fri | Sat | Sun | |
|---|---|---|---|---|---|---|---|
| S | . | . | . | . | . | . | . |
| C | . | . | . | . | . | . | . |
| R | . | . | X | . | X | . | . |
The event "no day is rainy" means every day is either Sunny or Cloudy. In the grid, this corresponds to the entire row R (row index 2) being empty — and equivalently, only rows S and C are ever used. We mark all 14 cells in rows 0 and 1 (S and C) across all 7 columns. This may seem to conflict with the idea that "marking a cell means the state holds," but here we are marking the set of states the day is allowed to be. The probability is , since each of the 7 days must independently avoid rain.
| Mon | Tue | Wed | Thu | Fri | Sat | Sun | |
|---|---|---|---|---|---|---|---|
| S | X | X | X | X | X | X | X |
| C | X | X | X | X | X | X | X |
| R | . | . | . | . | . | . | . |
The event "Thursday is not sunny" excludes state S for Thursday (column index 3) and allows C or R. In the grid we mark (C, Thu) = (1,3) and (R, Thu) = (2,3). This is a two-cell condition on a single column. The probability is . This illustrates a complementary column pattern: the complement "Thursday is sunny" would be the single cell (0,3), and together the three cells in column Thu partition that column, summing to probability 1.
| Mon | Tue | Wed | Thu | Fri | Sat | Sun | |
|---|---|---|---|---|---|---|---|
| S | . | . | . | . | . | . | . |
| C | . | . | . | X | . | . | . |
| R | . | . | . | X | . | . | . |
Reading the grid: cells (0,5) and (0,6) are marked, corresponding to row S and columns Sat and Sun. This encodes the event "Saturday is sunny AND Sunday is sunny," i.e., the entire weekend is sunny. The grid is the mirror image of A(2) (weekend rainy), but now in row S instead of row R. Under the equal-probability model, , the same as the rainy-weekend probability — which makes sense because each state is equally likely and the two events are structurally identical.
| Mon | Tue | Wed | Thu | Fri | Sat | Sun | |
|---|---|---|---|---|---|---|---|
| S | . | . | . | . | . | X | X |
| C | . | . | . | . | . | . | . |
| R | . | . | . | . | . | . | . |
When row R (index 2) is completely empty and rows S and C contain the marked cells, the event is "no rain occurs on any day of the week." This is the same event as A(4) viewed from the opposite angle: rather than marking the allowed states, we observe which row is excluded. An entire empty row in a weather grid is always a strong visual signal: it says one weather state is universally forbidden throughout the week. Under the independence model, .
| Mon | Tue | Wed | Thu | Fri | Sat | Sun | |
|---|---|---|---|---|---|---|---|
| S | X | X | X | X | X | X | X |
| C | X | X | X | X | X | X | X |
| R | . | . | . | . | . | . | . |
Problem 4 — Building Complex Events: Unions, Intersections, and Complements on the 6×6 Grid
Return to the die×die sample space with 36 equally likely outcomes. Define three base events (sum = 7), (first die > second), and (at least one die = 6). Compute probabilities for the base events and ten compound events formed from them, illustrating each with a grid.
The six pairs that sum to 7 are . In 0-indexed grid coordinates these are the anti-diagonal cells (0,5),(1,4),(2,3),(3,2),(4,1),(5,0). Sum-7 is the most probable single-sum event: it lies on the central anti-diagonal of the 6×6 grid and contains more cells than any other sum. .
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | . | . | . | . | . | X |
| 2 | . | . | . | . | X | . |
| 3 | . | . | . | X | . | . |
| 4 | . | . | X | . | . | . |
| 5 | . | X | . | . | . | . |
| 6 | X | . | . | . | . | . |
The lower-triangular region of the 6×6 grid (all cells strictly below the main diagonal) encodes the event . As computed in Problem 2, this region has cells. The marked shape is a right triangle below the diagonal. .
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | . | . | . | . | . | . |
| 2 | X | . | . | . | . | . |
| 3 | X | X | . | . | . | . |
| 4 | X | X | X | . | . | . |
| 5 | X | X | X | X | . | . |
| 6 | X | X | X | X | X | . |
Event is the L-shaped union of row 5 (first die = 6) and column 5 (second die = 6). By inclusion-exclusion, . The single overlap cell is (5,5) = (6,6). .
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | . | . | . | . | . | X |
| 2 | . | . | . | . | . | X |
| 3 | . | . | . | . | . | X |
| 4 | . | . | . | . | . | X |
| 5 | . | . | . | . | . | X |
| 6 | X | X | X | X | X | X |
To compute , take all cells in together with all cells in , removing duplicates. The cells of that are also in are those where the sum is 7 and at least one die is 6: and , i.e., cells (0,5) and (5,0). So . The marked region on the grid is an anti-diagonal with two cells in common with the L-shaped event C.
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | . | . | . | . | . | X |
| 2 | . | . | . | . | X | X |
| 3 | . | . | . | X | . | X |
| 4 | . | . | X | . | . | X |
| 5 | . | X | . | . | . | X |
| 6 | X | X | X | X | X | X |
The intersection requires both conditions simultaneously: sum = 7 AND at least one die = 6. From the six pairs in , only and involve a 6. In grid coordinates these are (0,5) and (5,0). This tiny two-cell intersection demonstrates how powerful the combination of two conditions can be: adding the constraint "at least one die = 6" to "sum = 7" reduces the event from 6 cells to 2.
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | . | . | . | . | . | X |
| 2 | . | . | . | . | . | . |
| 3 | . | . | . | . | . | . |
| 4 | . | . | . | . | . | . |
| 5 | . | . | . | . | . | . |
| 6 | X | . | . | . | . | . |
We need cells in the lower triangle (first > second) that are also in the L-shape (at least one die = 6). In row 5 (first die = 6), the lower-triangle cells are those where second < 6, i.e., columns 0–4: five cells (5,0),(5,1),(5,2),(5,3),(5,4). Column 5 (second die = 6) paired with first > 6 is impossible since 6 is the maximum. So has 5 cells.
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | . | . | . | . | . | . |
| 2 | . | . | . | . | . | . |
| 3 | . | . | . | . | . | . |
| 4 | . | . | . | . | . | . |
| 5 | . | . | . | . | . | . |
| 6 | X | X | X | X | X | . |
The complement is the event "first die is NOT strictly greater than second," i.e., first ≤ second (upper triangle plus diagonal). From the six cells of , those with are : cells (0,5),(1,4),(2,3). The three pairs where — namely — are excluded by . So has 3 cells, each with the second die exceeding the first.
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | . | . | . | . | . | X |
| 2 | . | . | . | . | X | . |
| 3 | . | . | . | X | . | . |
| 4 | . | . | . | . | . | . |
| 5 | . | . | . | . | . | . |
| 6 | . | . | . | . | . | . |
The complement is "neither die shows 6." From the six cells of , we remove those containing a 6: and . The remaining four cells are , i.e., cells (1,4),(2,3),(3,2),(4,1). These are the sum-7 pairs where neither die is 6 — a fact sometimes useful because these outcomes tend to be "hidden" from one-die conditions.
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | . | . | . | . | . | . |
| 2 | . | . | . | . | X | . |
| 3 | . | . | . | X | . | . |
| 4 | . | . | X | . | . | . |
| 5 | . | X | . | . | . | . |
| 6 | . | . | . | . | . | . |
Start with the 11 cells of and remove the 2 cells in , namely (0,5) and (5,0). The remaining cells form the L-shape with its two tips clipped. These are outcomes where a 6 appears but the sum is something other than 7 (possible sums in : 7, 8, 9, 10, 11, 12; we remove only the sum-7 ones).
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | . | . | . | . | . | . |
| 2 | . | . | . | . | . | X |
| 3 | . | . | . | . | . | X |
| 4 | . | . | . | . | . | X |
| 5 | . | . | . | . | . | X |
| 6 | . | X | X | X | X | X |
Start with the 15 cells of (lower triangle) and remove those cells also in . From , the cells with are , i.e., (3,2),(4,1),(5,0). Removing these three from the 15 lower-triangle cells gives cells. This compound event captures outcomes where the first die wins the comparison but the total is not 7.
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | . | . | . | . | . | . |
| 2 | X | . | . | . | . | . |
| 3 | X | X | . | . | . | . |
| 4 | X | X | . | . | . | . |
| 5 | X | X | X | X | . | . |
| 6 | . | X | X | X | X | . |
From the 11 cells of , remove those where : the 5 cells of , namely (5,0),(5,1),(5,2),(5,3),(5,4). The remaining cells are: (5,5) and the five column-5 cells above the diagonal: (0,5),(1,5),(2,5),(3,5),(4,5). These are outcomes where at least one die shows 6 but the second die is at least as large as the first.
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | . | . | . | . | . | X |
| 2 | . | . | . | . | . | X |
| 3 | . | . | . | . | . | X |
| 4 | . | . | . | . | . | X |
| 5 | . | . | . | . | . | X |
| 6 | . | . | . | . | . | X |
The complement of is the event that neither condition holds: sum is not 7 AND no die shows 6. Since , its complement has cells. These are all cells in the top-left 5×5 sub-grid (no die is 6) except the anti-diagonal of sum-7. Alternatively, . Wait — let us recount: has 6 cells, has 11, has 2, so and the complement has cells.
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | X | X | X | X | X | . |
| 2 | X | X | X | X | . | . |
| 3 | X | X | X | . | . | . |
| 4 | X | X | . | X | X | . |
| 5 | X | . | X | X | X | . |
| 6 | . | . | . | . | . | . |
The complement of is the event that at least one of the two conditions fails: either sum ≠ 7 or no die shows 6 (or both). Since , the complement has cells. This is a very large event — only two outcomes ( and ) are excluded. The moral: intersections of two non-trivial events tend to be small, so their complements are large.
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| 1 | X | X | X | X | X | . |
| 2 | X | X | X | X | X | X |
| 3 | X | X | X | X | X | X |
| 4 | X | X | X | X | X | X |
| 5 | X | X | X | X | X | X |
| 6 | X | X | X | X | X | X |
Problem 5 — From Frequencies to Probability: 1000 Die Rolls
A six-sided die was rolled 1000 times. The observed counts were: , , , , , . Part A: compute relative frequencies for five events. Part B: verify additivity for disjoint events. Part C: explain what goes wrong for non-disjoint events. Part D: check that elementary frequencies sum to 1. Parts E–F: interpret the relationship between observed frequencies and the theoretical probability measure.
Before computing anything, let us record the six elementary frequencies. The total number of rolls is . The relative frequency of elementary outcome is . The resulting table shows frequencies that hover around the theoretical value , with natural random fluctuations. A table interactive makes the data easier to read.
| Face \ Count / Frequency | Count n(k) | Frequency f(k) | Total |
|---|---|---|---|
| 1 | 168 | 168 | 336 |
| 2 | 154 | 154 | 308 |
| 3 | 181 | 181 | 362 |
| 4 | 167 | 167 | 334 |
| 5 | 160 | 160 | 320 |
| 6 | 170 | 170 | 340 |
| Total | 1000 | 1000 | 2000 |
We compute relative frequencies by summing counts for the outcomes in each event and dividing by 1000. For event (even outcomes): , so . For : , . For : , . For (odd): , . For : , . In every case the empirical frequency is close to but not equal to the theoretical probability .
Take two disjoint events and . Their union is . The individual frequencies are and . Their sum is . This is not a coincidence: for any two disjoint events and , exactly (no outcome is counted twice), so always holds for disjoint events in any finite experiment. This finite additivity is a universal feature of relative frequencies.
Finite additivity is exactly what we verified above: for a finite list of disjoint events, the frequency of their union equals the sum of individual frequencies. The stronger axiom of countable additivity (or -additivity) extends this to countably infinite families of disjoint events. In finite experiments this distinction is invisible — you can never have infinitely many disjoint non-empty subsets of a finite sample space. But when we define probability abstractly (e.g., for continuous distributions or infinite sequences of trials), we must impose -additivity as an axiom, because it cannot be derived from finite experiments alone. Kolmogorov's axiom system makes this step explicit.
Let and . These events are NOT disjoint: outcome 3 belongs to both. The observed counts are and . Their union is with count , giving . However, . The discrepancy is , the frequency of outcome 3, which was counted once in , once in , but only once in . The inclusion-exclusion formula corrects this: .
The six elementary outcomes are mutually disjoint and their union is . Therefore: . This is always exactly 1, not approximately — it is an algebraic identity that follows from the fact that every roll contributes exactly one count to exactly one elementary frequency. This identity is the empirical analogue of the normalization axiom .
The relative frequencies we computed are not the probabilities — they are estimates of the probabilities derived from a finite experiment. The theoretical probability for a fair die is for each . Our empirical values () differ from by small amounts. The Law of Large Numbers guarantees that as the number of trials , the relative frequency converges to for every event (under suitable conditions). Probability is therefore the mathematical idealisation that the empirical frequencies approach in the long run.
There is a fundamental difference between a relative frequency and a probability. A frequency is an observed, concrete, finite quantity: it depends on the particular experiment we ran, and two repetitions of the same experiment will give different frequencies. A probability is a theoretical, abstract, timeless quantity: it is a property of the model, not of any particular run. The probability model (i.e., a probability measure on a measurable space ) is constructed to match the observed frequencies in the limit. Once constructed, it obeys the three Kolmogorov axioms exactly — not approximately. This conceptual leap from the empirical to the theoretical is the foundation of modern probability theory: we take the properties we observe to hold approximately in large samples and elevate them to exact axioms in the abstract model.
Problem 6 — The Axiomatic Point of View: Kolmogorov's Axioms
Give a full written discussion of the axiomatic foundation of probability theory. State Kolmogorov's three axioms, motivate each from the empirical observations of Problem 5, and explain the significance of countable additivity. Discuss what is gained and what is assumed when we move from a finite experimental setup to an abstract probability space.
A probability space in Kolmogorov's framework is a triple , where is the sample space, is a -algebra of events (subsets of that are "measurable"), and is a function satisfying three axioms. Axiom 1 (Non-negativity): for every event . Axiom 2 (Normalisation): . Axiom 3 (Countable additivity): if is a countable sequence of mutually disjoint events, then . These three axioms, together with the specification of the measurable space , completely determine the structure of a probability model. Everything else in probability theory — conditional probability, independence, random variables, expectations, characteristic functions — follows from these axioms by pure mathematical deduction.
Axiom 1 is the easiest to motivate empirically. A relative frequency is always a ratio of two non-negative integers: , where is the count of outcomes in (never negative) and is the total number of trials (strictly positive). Therefore always. If probability is the idealisation of frequency in the limit, it must inherit non-negativity. We cannot have a negative probability any more than we can have a negative count. Axiom 1 thus reflects the most basic intuition that probability measures "how often" something occurs, and frequencies are intrinsically non-negative.
Axiom 2 is equally natural. In every trial of any experiment, exactly one elementary outcome occurs. The entire sample space is therefore the "certain event" — something in always happens. Empirically, every die roll produces a face in , so exactly, in any finite experiment without exception. The normalisation is therefore not an approximation: it is an exact identity at every sample size. Axiom 2 simply elevates this identity to the abstract model.
Axiom 3, in its finite form, states that whenever the events are mutually disjoint. As we showed in Problem 5 Part B, this holds exactly for relative frequencies: if and are disjoint, then no outcome is counted in both and , so and thus . The same argument extends to any finite collection of disjoint events by induction. The finite version of additivity is therefore forced upon us by the way counting works — it is not an assumption but a theorem about frequencies, elevated to an axiom for the abstract model.
The full Axiom 3 is stronger than finite additivity: it applies to countably infinite sequences of disjoint events. Why do we need this? Consider the experiment of tossing a fair coin infinitely many times. The sample space is uncountably infinite, and interesting events — like "heads appears infinitely often" — cannot be expressed as finite unions of elementary outcomes. To assign probabilities to such events, we need the measure to be continuous with respect to monotone limits of event sequences. It turns out that this continuity is exactly equivalent to countable additivity. Without it, we cannot handle limits, cannot define distributions on the real line, cannot state the Law of Large Numbers or the Central Limit Theorem. Countable additivity is the minimal axiom that allows probability theory to interface with analysis.
The axiomatic approach gives probability theory three enormous advantages. First, generality: the same framework covers discrete spaces (coin tosses, die rolls), continuous spaces (Buffon's needle, Gaussian random variables), and abstract spaces (random processes, random graphs). Second, rigour: every probabilistic result can be proved from the axioms, and any apparent paradox must either be resolved within the system or signal a violation of the axioms. Third, unification: conditional probability, expectation, independence, stochastic processes, and statistical inference all emerge from the same three axioms, giving the entire theory a coherent logical structure. Without the axiomatic foundation, probability would remain a collection of ad hoc rules derived from intuition — useful in practice but fragile under scrutiny.
The axiomatic framework does not tell us what the probabilities should be — it only constrains the structure they must have. The assignment of probabilities to events is a modelling choice, external to the axioms. For a fair die we choose ; but the axioms do not compel this — they would be equally satisfied by and . Verifying that a model is appropriate requires empirical evidence (as in Problem 5) or physical reasoning. Moreover, the requirement that be a -algebra, rather than all subsets of , is a technical necessity: on uncountable spaces, it is mathematically impossible to define a countably additive probability on every subset (Vitali's theorem). The -algebra specifies which events are "measurable" and thus have a well-defined probability — a subtlety invisible in finite sample spaces but essential for the general theory.
The intellectual journey of this section can be summarised as follows. We started with concrete experiments — coin tosses, die rolls, weekly weather — and represented their outcomes and events as grids. We computed relative frequencies of events and observed that frequencies are always non-negative, always sum to 1 over , and always satisfy finite additivity for disjoint events. We then asked: what is the minimal set of rules that captures these properties abstractly, extends to infinite sample spaces, and supports rigorous mathematical deductions? The answer is Kolmogorov's three axioms. The grid representation, which made events visible as geometric shapes, is a stepping stone between the intuitive enumeration of outcomes and the formal measure-theoretic definition of a probability space. In the formal theory, the grid is replaced by a -algebra and a measure, but the spirit is the same: an event is a subset of , and its probability is a number assigned to that subset in a consistent, additive way.