With the fullness probability written as a deviation, the analysis raises both sides to the sixth power (the moment method) — hence the 7-wise-independence requirement. 8:36
Where the sixth moment lands
- There are
kintervals of lengthkcontainingh(x), so the sum becomesΣ_k k · (2/k)^6 · E[(L(I) − E L(I))^6].8:559:13 - Indicators:
X_i = 1ifh(i) ∈ I, else0; thenL(I) = Σ_{i∈S} X_i.10:13 Pr[X_i = 1] = |I|/m ≈ k/(2n); call itp.17:4318:13
Symmetrization
The trick for handling E[(Σ X_i − E Σ X_i)^p]. 11:30
Two facts used:
- Minkowski's inequality —
‖X‖_p = (E|X|^p)^{1/p}is a genuine norm forp ≥ 1(scaling, triangle inequality).12:28 - Jensen's inequality — for convex
f,f(E X) ≤ E[f(X)].13:04
The steps:
- Bound the 6-norm instead of the 6th moment; raise the answer to the 6th at the end.
13:44 - Replace
E[Σ X_i]withΣ X'_i, independent identically distributed copies — the expectation is just a number, so the value is unchanged.14:0114:29 |·|^pis convex forp ≥ 1, so Jensen pulls the inner expectation outside and it only gets bigger:‖Σ_i (X_i − X'_i)‖_6over both variables.15:0416:01X_i − X'_iis symmetric, so it has the same distribution as attaching independent random signsσ_i.16:01- By the norm property, this is at most
2·‖Σ_i σ_i X_i‖_6.16:32
Net result: the original 6th moment is at most 2^6 times the 6th moment of the symmetrized, mean-zero variable. 17:00
flowchart LR
A["E[(ΣX − E ΣX)^6]"] --> B["work with 6-norm<br/>(Minkowski)"]
B --> C["replace E ΣX by<br/>i.i.d. copies ΣX'"]
C --> D["pull E outside<br/>(Jensen)"]
D --> E["symmetric ⇒ random signs σᵢ"]
E --> F["≤ 2^6 · E[(Σ σᵢXᵢ)^6]"]
Why it pays off
- Expanding
E[(Σ σ_i X_i)^6]givesΣ_{i1..i6} E[σ_{i1}···σ_{i6}] · E[X_{i1}···X_{i6}], and the sign expectation is 0 or 1.19:1119:54 - It is 1 exactly when every distinct index appears an even number of times — so the surviving cases are one index six times, one four + one two, or three indices twice each.
20:3120:49 - Since
X_i ∈ {0,1},X_i^6 = X_i, so the six-times case contributesp; three-distinct contributesp^3.20:4921:15 - Dominant term: three distinct items each appearing twice — about
n^3choices, givingO(n^3 p^3) = O(k^3).21:3522:0622:26 - Dividing by
k^6and multiplying by thekintervals gives1/k^2per term — andΣ_k 1/k^2converges.22:26
Why bother symmetrizing at all
- Without it you would face
n^6monomials with positive and negative terms and would have to argue cancellation explicitly; symmetrization does that for you and leaves only non-negative terms, turning the problem into pure counting.23:2923:4824:47 - Nelson's own framing: "It's just a trick. It doesn't come from anywhere other than trickery."
24:47 - Why 7-wise: conditioning on
I ∋ h(x)uses one hash evaluation; the remaining six in the product must still act independently — 1 + 6 = 7.25:0925:34