## Computational Linguistics

September 2007, Vol. 33, No. 3, Pages 305-354
(doi: 10.1162/coli.2007.33.3.305)
© 2007 Massachusetts Institute of Technology
A Sketch Algorithm for Estimating Two-Way and Multi-Way Associations
Article PDF (1.05 MB)
Abstract

We should not have to look at the entire corpus (e.g., the Web) to know if two (or more) words are strongly associated or not. One can often obtain estimates of associations from a small sample. We develop a sketch-based algorithm that constructs a contingency table for a sample. One can estimate the contingency table for the entire population using straightforward scaling. However, one can do better by taking advantage of the margins (also known as document frequencies). The proposed method cuts the errors roughly in half over Broder's sketches.