起源故事 · 从酒厂到车间的"找差异"利器
Origin Story · From the Brewery to the Shop Floor
单样本 t 检验问"一组对不对标",而真实世界更常问"两组哪个更好":新催化剂 vs 旧催化剂、白班 vs 夜班、供应商 A vs 供应商 B。
Gosset 的 t 分布很快被扩展到两组比较,成为 双样本 t 检验。它的逻辑朴素而强大:把两组均值差(信号)除以
这个差本身的不确定性(噪声),得到信噪比 t。如今它是六西格玛 Analyze 阶段验证"改善到底有没有用"的第一把尺子。
The one-sample t-test asks "does this group hit the target?", but the real world more often asks "which of these two is better?" — new catalyst vs old, day shift vs night shift, supplier A vs supplier B.
Gosset's t-distribution was quickly extended to two independent samples, becoming the two-sample t-test. The idea is plain but powerful: divide the difference in group means (the signal) by the
uncertainty of that difference (the noise), and the ratio t tells the story. Today it's the first ruler we pick up in the Analyze phase to see whether an improvement actually moved the needle.
1 两组分布:它们真的分开了吗? Two Distributions: Have They Actually Pulled Apart?
重叠中overlapping2 t 的本质:信号 ÷ 噪声 What t Really Is: Signal ÷ Noise
蓝条 = 信号(均值差 Δ),灰条 = 噪声(差的标准误 SE)。t 就是蓝条比灰条长几倍。信号压过噪声,差异才站得住。 Blue bar = signal (mean difference Δ); gray bar = noise (standard error of that difference, SE). t is simply how many times longer the blue bar is than the gray one. Only when the signal outweighs the noise does the difference hold up.
3 现实里的双样本 t 检验 The Two-Sample t-Test in the Wild
改善前后对比:Improve 后取一批新数据,和改善前对比,验证 KPI 提升是否真的显著。
Before vs after improvement: pull a fresh sample after the Improve phase and compare it with the pre-change baseline to confirm the KPI lift is real.
两供应商比较:同一零件两家供货的强度 / 尺寸是否有实质差异,决定该选谁。
Supplier A vs B: same part from two vendors — test whether strength or dimensions differ enough to drive a sourcing decision.
两班组绩效:白班 vs 夜班、A 线 vs B 线的产出 / 缺陷率差异是真本事还是偶然。
Shift or line comparison: day vs night, line A vs line B — is the output or defect-rate gap genuine performance, or just chance?
A/B 实验:两版方案的转化率 / 满意度差异检验,是产品与营销决策的依据。
A/B testing: compare conversion or satisfaction between two variants — the backbone of product and marketing decisions.
一句话In One Line
"两组差了多少"只是信号,它不能单独说话 —— 必须和噪声(组内波动 + 样本量)放在一起看。
同样 2 分的良率差,在波动小、样本多时是铁证,在波动大、样本少时只是噪声。t 检验把这层直觉量化成信噪比:
t = 信号 / 噪声。所以提升 t(让差异显著)有三条路:拉大真实差距、压低组内波动、增加样本量 —— 这也正是改善与实验设计要发力的三个方向。
"How big is the gap" is only the signal, and it doesn't speak alone — it has to be read alongside the noise (within-group spread + sample size).
The same 2-point yield gap is rock-solid evidence when variation is tight and n is large, and just noise when variation is wide and n is small. The t-test turns that intuition into a precise signal-to-noise ratio:
t = signal / noise. So there are three ways to raise t: widen the real gap, shrink within-group variation, or grow the sample size — exactly the three levers improvement work and DOE are designed to pull.
常见误用Common Mistakes
只看均值差大就下结论。差距大但波动也大,可能不显著;要看信噪比 t。
Calling a difference real just because the means are far apart. A big gap can still be non-significant if within-group spread is large — read the signal-to-noise ratio t, not just Δ.
对配对数据用独立双样本(同一批前后测)。配对设计要用配对 t 检验,功效更高。
Running an independent two-sample test on paired data (e.g. the same units measured before and after). Paired designs call for a paired t-test — it removes between-subject variance and gives you far more power.
把统计显著当成"实际重要"。n 巨大时微小差异也显著,还要看效应量是否有业务价值。
Treating statistical significance as practical importance. With huge n, even trivial gaps turn significant — always check the effect size against what actually matters to the business.