On the Testability of the Anchor-Words Assumption in Topic Models

Authors

Simon Freyaldenhoven, Shikun Ke, Dingyi Li, Jose Luis Montiel Olea

Posted to EERN: August 5, 2025

FEDERAL RESERVE RESEARCH: Philadelphia

Topic models are a simple and popular tool for the statistical analysis of textual data. Their identification and estimation is typically enabled by assuming the existence of anchor words; that is, words that are exclusive to specific topics. In this paper we show that the existence of anchor words is statistically testable: There exists a hypothesis test with correct size that has nontrivial power. This means that the anchor-words assumption cannot be viewed simply as a convenient normalization. Central to our results is a simple characterization of when a column-stochastic matrix with known nonnegative rank admits a separable factorization. We test for the existence of anchor words in two different data sets derived from monetary policy discussions in the Federal Reserve and reject the null hypothesis that anchor words exist in one of them.

Read the paper