In A/B testing metadata, what statistical approach determines if observed click-through rate differences are significant, not random?

A statistical significance test, such as a chi-squared test or a t-test, determines if observed click-through rate differences in A/B testing are significant, not random. A/B testing involves comparing two versions of a metadata element (e.g., title, synopsis) to see which performs better, typically measured by click-through rate (CTR). However, the observed differences in CTR between the two versions might simply be due to chance. A statistical significance test assesses the proba....